AI Pulse
📄 论文解读

让AI当摄影师:一句话生成电影级运镜

拍电影最贵的不是演员,是运镜——一个镜头怎么推、怎么转、怎么跟,决定了观众看什么、怎么感受。现在AI能写剧本、能生成画面,但让它自己决定镜头怎么动,一直做不好。这篇把运镜拆成了四个AI角色:一个理解你说了什么、一个选机位、一个执行、一个回看画面挑毛病,像一个小型摄制组。结果是,你输入一句『从门口缓缓推进,绕过花瓶,最后停在主角脸上』,它就能输出一条可执行的3D镜头轨迹,还能拿参考视频当指令。它配了750个文本任务和60个视频任务的评测集,是目前最强的。这不是你明天就能用的工具,但它把『AI拍电影』从生成静态画面推进到了生成动态叙事——镜头语言是电影的灵魂,这一步比多生成几帧高清画面重要得多。

📄 原文摘要(英文)

Complex camera motion is central to visual storytelling, yet translating cinematographic intent into controllable, executable camera trajectories remains challenging. We introduce FilmFlow, an agentic framework that converts natural-language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. To generate these trajectories, a Director agent constructs executable camera plans by composing high-level motions from concurrent atomic operations that jointly control translation, rotation, and framing. The Director is supported by three specialized agents: an Interpreter that extracts scene-grounded cinematographic intent, a Scout that selects initial viewpoints, and a Critic that evaluates rendered results and provides visual feedback for iterative plan refinement. We also introduce CinemaBench, comprising 150 Blender scenes from self-created and licensed sources, with five camera instructions per scene for 750 text-directed tasks and 60 reference videos associated with a subset of scenes. CinemaBench supports evaluation of both text-directed camera generation and video reference-directed camera generation. Across a diverse set of evaluated baselines, FilmFlow achieves the strongest benchmark performance and the highest user preference, demonstrating effective spatial reasoning, temporal coordination, and visual composition for executable 3D cinematography.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新