LMGame-Bench: How Good are LLMs at Playing Games?

ICLR 2026

Lanxiang Hu, Mingjia Huo, Yuxuan Zhang, Haoyang Yu, Eric P. Xing, Ion Stoica, Tajana Rosing, Haojian Jin, Hao Zhang

Introduces LMGame-Bench, a unified Gym-style benchmark that tests LLM agents across platformer, puzzle, and narrative games, addressing vision brittleness, prompt variance, and data contamination.