MVTrack4Gen Uses Multi-View Tracking to Boost Video Diffusion Consistency

Researchers have introduced MVTrack4Gen, a method that adds an auxiliary multi-view point tracking head to video diffusion models to improve geometric consistency across camera viewpoints. The approach addresses a longstanding gap between visual quality and spatial accuracy in novel-view video synthesis, where existing methods either struggled with dynamic objects or drifted as camera angles changed. By routing attention features through a tracking objective, the model learns to maintain motion alignment across perspectives and has achieved state-of-the-art geometric consistency on multiple benchmarks. However, the method requires access to multi-view point tracks during training, which could make it costly to apply to custom or in-the-wild datasets. Code and pretrained checkpoints have not yet been released, meaning independent reproducibility depends on a future public release.