【数据科学名家讲坛】Multi-agent Reinforcement Learning in Markov Potential Games and Beyond (Manxi WU, Assistant Professor, School of Operations Research and Information Engineering, Cornell University)
主题:Multi-agent Reinforcement Learning in Markov Potential Games and Beyond
报告人:Manxi WU, Assistant Professor, School of Operations Research and Information Engineering, Cornell University
主持人:Xinyu CHEN, Assistant Professor, School of Data Science, CUHK-Shenzhen
日期:22 June (Thursday), 2023
时间:10:30 to 11:30 AM, Beijing Time
形式:Onsite
地点:603 Meeting Room, Daoyuan Building
语言:English
摘要:
Infinite-horizon stochastic games provide a versatile framework for studying the repeated interaction among multiple strategic agents in dynamic environments. However, computing equilibria in such games is highly complex, and the long-run outcomes of decentralized learning algorithms in multi-agent settings remain poorly understood. The first part of this talk introduces a multi-agent reinforcement learning dynamics tailored for independent and decentralized settings, where players lack knowledge of the game model and cannot coordinate. The proposed dynamics guarantee convergence to a stationary Nash equilibrium in Markov potential games, demonstrating the effectiveness of simple learning dynamics even with limited information. In the second part of the talk, we extend the learning framework to encompass Markov near potential games, offering flexibility to incorporate a wide range of practically-relevant multi-agent interaction settings. We present efficient algorithms for approximating the stationary Nash equilibrium and substantiate their effectiveness through regret analysis and numerical experiments.
简介:
Manxi Wu is an Assistant Professor at Cornell University's School of Operations Research and Information Engineering. Her research uses game theory, optimization, and machine learning techniques to study the strategic behavior of agents in societal-scale systems. She also works on information and market mechanism design to enhance system efficiency, resiliency, and fairness. Manxi holds a Ph.D. in Social and Engineering Systems from MIT (2021). Prior to joining Cornell, she was a research fellow at the Simons Institute for the theory of computing and the EECS department at the University of California, Berkeley (2021-2022).
