This was part of Foundations of Multi-Agent and Mean Field Reinforcement Learning

Scalable Reinforcement Learning for Networked Multi-Agent Systems

Na Li, Harvard University