Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
TLDR
Pelican-Unify 1.0 unifies vision-language understanding, reasoning, future video/action generation, and action in one embodied model, showing strong benchmark results.
Reasoning
The paper proposes a unified architecture with shared VLM and latent conditioning for future video/action generation, supported by benchmark results across understanding, video generation, and robot action. However, the abstract lacks details on baselines, limitations, and real-world deployment, making some claims hard to fully assess.
Read-first score
Read-first score 39.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 45.
Field roles
Rank sensitivity
Stability: volatile; rank range: 519.
Keyword Scores
Deep Analysis
Innovations
- Introduces Pelican-Unify 1.0 as a unified embodied foundation model that uses a single VLM to map scenes, instructions, visual contexts, and action histories into a shared semantic space.
- Uses the same VLM as a unified reasoning module that autoregressively produces task-, action-, and future-oriented chains of thought in one forward pass and projects the final hidden state into a dense latent variable.
- Proposes a Unified Future Generator (UFG) that conditions on the latent variable and jointly generates future videos and future actions through two modality-specific output heads within the same denoising process.
- Jointly backpropagates language, video, and action losses into the shared representation, enabling unified optimization of understanding, reasoning, imagination, and action instead of training isolated expert systems.
Methodology
Pelican-Unify 1.0 uses a single VLM for both understanding and reasoning, mapping diverse inputs into a shared semantic space and autoregressively outputting chains of thought plus a dense latent representation. A Unified Future Generator conditions on this latent variable and jointly generates future video and action outputs via two modality-specific heads within one denoising process. Language, video, and action losses backpropagate into the shared representation for joint optimization; training data details are not specified in the abstract.
Key Results
With a single checkpoint, Pelican-Unify 1.0 reports 64.7 on eight VLM benchmarks (best among comparable-scale models), 66.03 on WorldArena (first), and 93.5 on RoboTwin (second-best average among compared action methods). The authors interpret these results as showing the unified paradigm preserves specialist strength.
Limitations
- No explicit limitations are stated in the title or abstract.