AI Pulse
📄 论文解读

大模型开无人机:飞得稳,却不知道何时该停

把大模型直接塞进无人机驾驶舱,不微调、不给操作手册,只告诉它“这是你的全部动作”。结果出人意料:2B 的小模型比顶级大模型更常飞进目标范围,却总在最后一步掉链子——要么提前宣布“我到了”,要么压根不宣布。多机编队时更离谱,小模型会把一架飞机的坐标原样复制给所有飞机。换句话说,模型看世界的能力没问题,坏在“行动纪律”:能飞,但不知道任务何时算完。这不是你明天能用上的技术,但它划出了一条清晰的边界——AI 离“自主执行任务”还差的那一步,不是感知,是知道何时收手。

📄 原文摘要(英文)

Multimodal Large Language Models (MLLMs) are strong perceivers of images and video. We ask how far that reach extends into acting: dropping an MLLM directly into a drone's control loop, with its entire action space declared solely in the prompt. Recent systems approach this setting but increasingly narrow the model's decision-making. We widen it back. We introduce DroneCATS-Agent, an architecture where the MLLM is a swappable component, and DroneCATS, a benchmark treating the model as the independent variable. Beyond merely flying toward a pixel, our agent entrusts the model to yaw and search, deliberate when unsure, and self-declare arrival---all without fine-tuning or function-calling schemas. Evaluating frontier and open models across four core capabilities---approaching a visible target, tracking a moving one, searching outside the initial view, and commanding a multi-drone fleet---reveals that even the simplest embodied settings are far from solved. Crucially, to identify what breaks first at the edge, our roster scales down to 2B parameters. The findings expose a stark paradox: it is not the flying that fails. Small open models often navigate into the success radius more reliably than frontier models, yet lose the episode by declaring arrival prematurely or not at all. Multi-drone commanding amplifies this divide, with small models failing by blindly copying a single coordinate across distinct views. Viewed as vision-language-action agents, the models' spatial perception holds up, but their action protocol does not. What separates a deployable edge model from a frontier model is not navigation, but the discipline to sustain a declared protocol and emit the correct terminating action. The open problem is closing this gap at onboard compute costs---yielding a fast model that plans persistently and knows exactly when it is done---and DroneCATS is built to measure that distance.

arXiv 原文

订阅 AI Pulse

每天 08:00 · 12:30 · 18:30 · 23:50 更新