TacSushi: Tactile-Grounded World-Action Modeling for Dexterous Sushi Manipulation
Quick summary
arXiv:2609.19613v1 Announce Type: cross Abstract: Dexterous food manipulation requires control under deformation, occlusion, and uncertain contact. We present TacSushi, a tactile-grounded, Cosmos3-based world-action policy that learns from recorded future consequences while acting on current observations. The backbone encodes current RGB, language, and hand state, and feature-wise gated fusion incorporates fingertip tactile features into the action representation. During training, a decoder conditioned on demonstrated action chunks predicts logged future visual observations, task progress, rel
Key takeaways
- arXiv:2609.19613v1 Announce Type: cross Abstract: Dexterous food manipulation requires control under deformation, occlusion, and uncertain contact.
- We present TacSushi, a tactile-grounded, Cosmos3-based world-action policy that learns from recorded future consequences while acting on current observations.
- The backbone encodes current RGB, language, and hand state, and feature-wise gated fusion incorporates fingertip tactile features into the action representation.
Why it matters
The significance is not only the legal text but how it changes product design. Decisions around “TacSushi: Tactile-Grounded World-Action Modeling for Dexterous Sushi Manipulation” may reshape data collection, model training, output accountability and market access.
Member comments