Correlated Mean Field Imitation Learning
arxiv(2024)
摘要
We investigate multi-agent imitation learning (IL) within the framework of
mean field games (MFGs), considering the presence of time-varying correlated
signals. Existing MFG IL algorithms assume demonstrations are sampled from Mean
Field Nash Equilibria (MFNE), limiting their adaptability to real-world
scenarios. For example, in the traffic network equilibrium influenced by public
routing recommendations, recommendations introduce time-varying correlated
signals into the game, not captured by MFNE and other existing correlated
equilibrium concepts. To address this gap, we propose Adaptive Mean Field
Correlated Equilibrium (AMFCE), a general equilibrium incorporating
time-varying correlated signals. We establish the existence of AMFCE under mild
conditions and prove that MFNE is a subclass of AMFCE. We further propose
Correlated Mean Field Imitation Learning (CMFIL), a novel IL framework designed
to recover the AMFCE, accompanied by a theoretical guarantee on the quality of
the recovered policy. Experimental results, including a real-world traffic flow
prediction problem, demonstrate the superiority of CMFIL over state-of-the-art
IL baselines, highlighting the potential of CMFIL in understanding large
population behavior under correlated signals.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要