AI Pulse
📄 论文解读

让 AI 当摄影师:说句话,镜头自己会动

拍电影最烧钱的部分之一,是摄影师怎么运镜。现在有个叫 FilmFlow 的系统,你只要说一句「从门口推进,然后绕到主角侧面」,它就能在 3D 场景里生成一条可执行的镜头轨迹——不是给你几个选项,而是真的把推、拉、摇、移拆成原子动作,由四个分工的 AI 代理协作完成:一个理解你的意图,一个选机位,一个执行,一个看渲染结果挑毛病再改。它在 150 个 Blender 场景、750 条指令的测试里,比现有方法更准、用户也更爱看。它不是你明天就能用的工具,但它是「AI 从听懂话到真的会干活」这条路上,少见的把镜头语言变成可执行代码的一步。

📄 原文摘要(英文)

Complex camera motion is central to visual storytelling, yet translating cinematographic intent into controllable, executable camera trajectories remains challenging. We introduce FilmFlow, an agentic framework that converts natural-language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. To generate these trajectories, a Director agent constructs executable camera plans by composing high-level motions from concurrent atomic operations that jointly control translation, rotation, and framing. The Director is supported by three specialized agents: an Interpreter that extracts scene-grounded cinematographic intent, a Scout that selects initial viewpoints, and a Critic that evaluates rendered results and provides visual feedback for iterative plan refinement. We also introduce CinemaBench, comprising 150 Blender scenes from self-created and licensed sources, with five camera instructions per scene for 750 text-directed tasks and 60 reference videos associated with a subset of scenes. CinemaBench supports evaluation of both text-directed camera generation and video reference-directed camera generation. Across a diverse set of evaluated baselines, FilmFlow achieves the strongest benchmark performance and the highest user preference, demonstrating effective spatial reasoning, temporal coordination, and visual composition for executable 3D cinematography.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新