Yingshuang Zou, Xiaoyu Shi, Yawen Luo, Ziang Li, Qinghe Wang, Mengfei Li, Chengfeng Zhao, Xintao Wang, Pengfei Wan, Kun Gai, Yuan Liu · 2026 · arXiv (Cornell University)
DOI: 10.48550/arxiv.2610.26801 · cited by 0 works (OpenAlex) · open-access PDF
Die jüngsten Fortschritte in der Text-zu-Video-Generation haben eine hochgläubige Single-Shot-Synthese ermöglicht, aber die praktische Erstellung von Storytelling erfordert Multi-Shot-Videos mit sowohl starker Inter-Shot-Konsistenz als auch Feinstaub-Steuerbarkeit. Die bestehende Multi-Shot-Video-Generation verfolgt fast starke Konsistenz, fällt aber immer noch in der Steuerbarkeit knapp. In diesem Papier schlagen wir Mise-en-Video (MeV) vor, ein hochsteuerbares Multi-Shot-Video-Generations-Framework, das es Video-Erstellern ermöglicht, das Stapeln des Multi-Shots im 3D-Raum durchzuführen und dann das entsprechende Multi-Shot-Video zu
Machine translation (Meta M2M100); the English original follows.
Recent advances in text-to-video generation have enabled high-fidelity single-shot synthesis, yet practical storytelling creation requires multi-shot videos with both strong inter-shot consistency and fine-grained controllability. Existing multi-shot video generation approaches achieve strong consistency but still fall short in controllability. In this paper, we propose Mise-en-Video (MeV), a highly controllable multi-shot video generation framework that allows video creators to conduct staging the multi-shot in the 3D space and then generate the corresponding multi-shot video. To achieve this, our framework combines a hierarchical attention mechanism for multi-level narrative consistency with 3D-aware layout guidance for precise, per-shot spatial control. To support training and evaluation, we develop standardized annotation pipelines and construct a 160K-video dataset with hierarchical multi-shot texts and oriented 3D bounding boxes. Extensive experiments demonstrate that MeV consistently outperforms strong baselines in video quality, inter-shot consistency, and subject-level controllability.
Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese
Topics: Computer science, Consistency (knowledge bases), Bounding overwatch, Annotation, Artificial intelligence, Construct (python library)
GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.26801, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txtSources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange