TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation
TLDR
A force-conditioned tactile world model for real-time contact-rich manipulation, predicting tactile latent dynamics and outperforming baselines in real-robot experiments.
Reasoning
The paper presents a novel tactile world model that effectively integrates global force and local tactile sensing, with strong empirical validation on real robots across multiple tasks. However, the abstract lacks discussion of limitations or failure cases, and the approach is not explicitly compared to model-based RL methods.
Read-first score
Read-first score 58, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 32.
Field roles
Rank sensitivity
Stability: volatile; rank range: 369.
Keyword Scores
Deep Analysis
Innovations
- Force-conditioned tactile world model (TacForceWM) that predicts short-horizon tactile latent dynamics from dual-finger tactile observations conditioned on high-frequency wrist force and torque signals.
- Predictive Tactile-Conditioned Policy that leverages predicted latents as anticipatory contact priors, models current-to-future tactile evolution via cross-attention, and adaptively fuses visuo-tactile features through a tactile-guided gating module.
- Lightweight latent space forecasting enabling real-time inference for high-frequency manipulation control.
Methodology
TacForeSight comprises two components: TacForceWM, a tactile world model that predicts future tactile latent states conditioned on wrist force/torque, and a Predictive Tactile-Conditioned Policy that uses these predictions as anticipatory priors via cross-attention and tactile-guided gating. The framework operates in a compact latent space for efficient real-time inference. Real-robot experiments were conducted on five representative contact-rich manipulation tasks and three in-process perturbation settings, comparing against existing baselines.
Key Results
TacForeSight consistently outperforms existing baselines across five tasks and three perturbation settings, particularly under dynamic contact disturbances.