Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
TLDR
Introduces DroneCATS-Agent and DroneCATS benchmark to evaluate MLLMs as vision-language-action agents for drone control, finding small models navigate but fail at declaring arrival.
Reasoning
The paper presents a novel benchmark and architecture for studying MLLMs as drone-control agents, with a useful focus on scaling down to small models and identifying failure modes. However, the abstract is truncated and does not clarify whether evaluations are real-world or simulated, and the work is not centered on world models.
Read-first score
Read-first score 14.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 0.
Field roles
Frontier
Rank sensitivity
Stability: volatile; rank range: 27.