This was part of Foundations of Multi-Agent and Mean Field Reinforcement Learning

Multi-scale Reinforcement Learning Algorithms for Mean Field Control Games

Jean-Pierre Fouque, University of California, Santa Barbara (UCSB)