AI
4Director: Controlling Video World Models with Rigid 3D Geometry
Publication: Hugging Face Daily Papers
Author: Not available in collected metadata
Source published: 30/09/2026, 20:00:00 UTC
Briefing created: 02/10/2026, 12:01:35 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 02/10/2026, 03:18:24 UTC.
Briefings
The paper introduces 4Director, a video world model that enables precise control over camera and object motion using an explicit 4D scene representation. By reconstructing objects as canonical meshes and applying one prescribed rigid transformation per frame, the method ensures geometric consistency and prevents unobserved geometry regeneration. The system renders controlled scenes as depth videos, utilizing a Motion Adapter to synthesize view-consistent appearance, illumination, and non-rigid dynamics. Training involves the RealCOD-Rigid dataset containing 20,774 clips annotated with rigid 3D scenes, evaluated using Identity-Gated IoU to measure adherence to motion and identity preservation. Experiments show 4Director consistently outperforms prior methods in both visual quality and control capabilities.
Key points
- 4Director uses an explicit 4D scene representation where each object is reconstructed as a canonical mesh and moved by a single prescribed rigid transformation per frame to ensure geometric consistency.
- The method introduces Identity-Gated IoU to jointly evaluate adherence to prescribed object motion while preserving object identity, outperforming prior methods in visual quality and control.
Context and limitations
The study relies on a single video world model architecture and a specific dataset of 20,774 clips; results may not generalize to other architectures or data distributions.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 02/10/2026, 12:01:35 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeial5jqendcyvkwya7ivveeqfnithwi7sivy5l6g4xaj7cxllnjkfi