让AI当摄影师:一句话生成电影级运镜
拍电影最贵的不是演员,是运镜——一个镜头怎么推、怎么转、怎么跟,决定了观众看什么、怎么感受。现在AI能写剧本、能生成画面,但让它自己决定镜头怎么动,一直做不好。这篇把运镜拆成了四个AI角色:一个理解你说了什么、一个选机位、一个执行、一个回看画面挑毛病,像一个小型摄制组。结果是,你输入一句『从门口缓缓推进,绕过花瓶,最后停在主角脸上』,它就能输出一条可执行的3D镜头轨迹,还能拿参考视频当指令。它配了750个文本任务和60个视频任务的评测集,是目前最强的。这不是你明天就能用的工具,但它把『AI拍电影』从生成静态画面推进到了生成动态叙事——镜头语言是电影的灵魂,这一步比多生成几帧高清画面重要得多。
📄 原文摘要(英文)
Complex camera motion is central to visual storytelling, yet translating cinematographic intent into controllable, executable camera trajectories remains challenging. We introduce FilmFlow, an agentic framework that converts natural-language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. To generate these trajectories, a Director agent constructs executable camera plans by composing high-level motions from concurrent atomic operations that jointly control translation, rotation, and framing. The Director is supported by three specialized agents: an Interpreter that extracts scene-grounded cinematographic intent, a Scout that selects initial viewpoints, and a Critic that evaluates rendered results and provides visual feedback for iterative plan refinement. We also introduce CinemaBench, comprising 150 Blender scenes from self-created and licensed sources, with five camera instructions per scene for 750 text-directed tasks and 60 reference videos associated with a subset of scenes. CinemaBench supports evaluation of both text-directed camera generation and video reference-directed camera generation. Across a diverse set of evaluated baselines, FilmFlow achieves the strongest benchmark performance and the highest user preference, demonstrating effective spatial reasoning, temporal coordination, and visual composition for executable 3D cinematography.