4DStreamCtrl: Interactive Video Generation with Online 4D Control
Quick summary
arXiv:2608.25479v2 Announce Type: replace-cross Abstract: Generative video models now synthesize footage nearly indistinguishable from reality. Their promise as interactive tools hinges on fine-grained control of how objects and the camera move over time, yet each existing approach captures only part of this: camera-parameter methods steer the viewpoint but cannot move objects, 2D-trajectory methods act in the image plane and ignore depth and occlusion, and recent 3D methods add geometry but run only offline at a fixed length. In particular, none combines 3D-consistent control of both camera a
Key takeaways
- arXiv:2608.25479v2 Announce Type: replace-cross Abstract: Generative video models now synthesize footage nearly indistinguishable from reality.
- Their promise as interactive tools hinges on fine-grained control of how objects and the camera move over time, yet each existing approach captures only part of this: camera-parameter methods steer the viewpoint but cannot move objects, 2D-trajectory methods act in the image plane and ignore depth and occlusion, and recent 3D methods add geometry but run only offline at a fixed length.
- In particular, none combines 3D-consistent control of both camera a
Why it matters
The importance of “4DStreamCtrl: Interactive Video Generation with Online 4D Control” will be measured by what changes in practice. User behavior, access conditions, verifiable performance and responsible-use outcomes are the signals worth following.
Member comments