AI写游戏？最强模型也不及格
让AI从头到尾写一个能玩的游戏，比想象中难得多。研究者搞了个新测试GameCraft-Bench，让AI在Godot游戏引擎里从零造游戏，一共140个任务。结果最强模型只拿到41.46%的分数，大部分AI连40%都不到。AI能做出一些像模像样的机制，但一到完整游戏就崩：内容不够、画面反馈不对、整体不协调。这不是你明天能拿来用的东西，但它划了一条线：AI写代码离真正交付一个能玩的游戏，还差得远。
📄 原文摘要(英文)
Game generation is an emerging application of coding agents, requiring models to transform natural-language specifications into playable interactive systems. Unlike traditional coding tasks, game generation takes place within a game engine, where scripts, scenes, assets, rendering, and runtime interactions must jointly produce coherent gameplay. We formalize end-to-end game generation as the problem of producing a complete game artifact that realizes a specification through observable player-game interaction in a target environment. We argue that evaluating this setting requires three desiderata: Engine Grounding, Artifact Completeness, and Interactive Verification. We propose an interaction-grounded evaluation framework that assesses executable gameplay through replayed demonstrations and rubric-guided multimodal judging. We instantiate this framework as GameCraft-Bench, a benchmark comprising 140 Godot tasks across 15 game families. Evaluations of frontier coding agents show that end-to-end game generation remains highly challenging: the strongest agent achieves only 41.46%, and most agents score below 40%. Further analysis reveals that while agents often implement recognizable mechanics, they struggle to deliver complete games with sufficient content, functional visual feedback, and coherent presentation. See https://tongxuluo.github.io/gamecraft-bench-website for demos, code, and data.