让 AI 当摄影师:说句话,镜头自己会动
拍电影最烧钱的部分之一,是摄影师怎么运镜。现在有个叫 FilmFlow 的系统,你只要说一句「从门口推进,然后绕到主角侧面」,它就能在 3D 场景里生成一条可执行的镜头轨迹——不是给你几个选项,而是真的把推、拉、摇、移拆成原子动作,由四个分工的 AI 代理协作完成:一个理解你的意图,一个选机位,一个执行,一个看渲染结果挑毛病再改。它在 150 个 Blender 场景、750 条指令的测试里,比现有方法更准、用户也更爱看。它不是你明天就能用的工具,但它是「AI 从听懂话到真的会干活」这条路上,少见的把镜头语言变成可执行代码的一步。
📄 原文摘要(英文)
Complex camera motion is central to visual storytelling, yet translating cinematographic intent into controllable, executable camera trajectories remains challenging. We introduce FilmFlow, an agentic framework that converts natural-language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. To generate these trajectories, a Director agent constructs executable camera plans by composing high-level motions from concurrent atomic operations that jointly control translation, rotation, and framing. The Director is supported by three specialized agents: an Interpreter that extracts scene-grounded cinematographic intent, a Scout that selects initial viewpoints, and a Critic that evaluates rendered results and provides visual feedback for iterative plan refinement. We also introduce CinemaBench, comprising 150 Blender scenes from self-created and licensed sources, with five camera instructions per scene for 750 text-directed tasks and 60 reference videos associated with a subset of scenes. CinemaBench supports evaluation of both text-directed camera generation and video reference-directed camera generation. Across a diverse set of evaluated baselines, FilmFlow achieves the strongest benchmark performance and the highest user preference, demonstrating effective spatial reasoning, temporal coordination, and visual composition for executable 3D cinematography.