Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model
TLDR
Dynin-Robotics introduces a unified diffusion VLA model jointly predicting actions, future observations, goals, and instructions, improving robot policies via goal-guided action generation and selection.
Reasoning
The paper presents a novel unified formulation that couples action and dynamics prediction, with strong evaluation across multiple benchmarks and datasets. However, the abstract is truncated and provides limited details on real-world deployment, baseline comparisons, and the precise conditions under which composed prediction helps.
Read-first score
Read-first score 36.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 34.
Field roles
Rank sensitivity
Stability: volatile; rank range: 580.
Keyword Scores
Deep Analysis
Innovations
- Shared trajectory model unifying visual goal prediction, dynamics prediction, and action generation/selection for language-conditioned robot policies.
- Dynin-Omni omnimodal masked-diffusion backbone representing language, visual observations, goals, and actions as discrete tokens.
- Single model trained via varying conditioning and target spans to handle action prediction, action-conditioned next-observation prediction, terminal goal-state prediction, and trajectory-to-instruction reconstruction.
- Test-time scaling interfaces including goal prediction, action-candidate evaluation, and joint refinement of action and future-state predictions.
- Continual pretraining on approximately 1.33 million trajectories from 48 Open X-Embodiment datasets with separate downstream adaptation.
- Block-parallel implementation accelerating model-side action decoding by up to 29.2x.
Methodology
Dynin-Robotics uses the Dynin-Omni omnimodal masked-diffusion backbone, tokenizing language, visual observations, goals, and actions as discrete tokens. The same model is trained by varying conditioning and target spans across action prediction, action-conditioned next-observation prediction, terminal goal-state prediction, and trajectory-to-instruction reconstruction. It is continually pretrained on approximately 1.33 million trajectories from 48 Open X-Embodiment datasets, adapted separately to downstream domains, and evaluated on VLABench, LIBERO, LIBERO-Plus, and a Franka Research 3 robot.
Key Results
Robot pretraining improves adaptation within a fixed Stage-2 step budget on two VLABench tasks, and the full objective mixture improves shifted-instruction success over Policy-only post-training under the same coupled decoder. Goal guidance combined with joint action-next-state denoising further improves shifted-instruction success over action-only decoding, with competitive LIBERO and zero-shot LIBERO-Plus performance, 78.4% average success across four Franka Research 3 manipulation conditions, and up to 29.2x faster action decoding from the optimized block-parallel implementation.
Limitations
- The abstract notes that the benefit of combining goal guidance with joint action-next-state denoising depends on how the predictions are composed.