Newest papers

RayCo4D: Ray-Conditioned Continuous Motion Model for Monocular 4D Dynamic Reconstruction

Yuanxiang Ni, Xianliang Huang, Ruihan Hou, Feng Xie, Hao Zhang · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28351 · cited by 0 works (OpenAlex) · open-access PDF

Japanese

モノコラルビデオからダイナミックな3Dシーンを再構築するには、騒音と間隔的に目に見える観測から動きを推測する必要がある。長距離トラックは貴重な地理的制約を提供するが、分断された時間のカバーを共有、継続的な動きに統合することは困難である。我々は、モノコラル4D再構築のための放射線条件付き継続的な動きモデルである「textbf{RayCo4D}」を導入するが、それぞれのトラックは、カメラライトに制約されたリファレンスタイム3Dクエリと関連付けられ、その画像と深さの観測は、地元の複数の関連を介して共通のラテンモーションノードを制限

Machine translation (Meta M2M100); the English original follows.

Abstract

Reconstructing dynamic 3D scenes from monocular video requires inferring motion from noisy and intermittently visible observations. Long-range tracks provide valuable geometric constraints, but integrating their fragmented temporal coverage into shared, continuous motion remains challenging. We introduce \textbf{RayCo4D}, a ray-conditioned continuous motion model for monocular 4D reconstruction that explicitly separates visual measurements from latent 3D motion states. Each track is associated with a reference-time 3D query constrained to its camera ray, and its image and depth observations constrain shared latent motion nodes through local many-to-many associations. Each node maintains an $\mathrm{SE}(3)$ pose and body-frame velocity at sparse support times. A white-noise-on-acceleration process prior couples neighboring states and defines continuous-time interpolation, allowing observations across visibility intervals to jointly constrain the same latent state sequence.The inferred shared motion is transferred to Gaussian primitives through dual-quaternion blending, while reference-anchored local $\mathrm{SE}(3)$ residuals capture fine-scale non-rigid deformation beyond the shared scaffold. Experiments on diverse monocular dynamic scenes show that RayCo4D achieves competitive novel-view synthesis quality, improves structural and temporal consistency under rapid motion and incomplete tracks, and supports continuous-time rendering.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer vision, Artificial intelligence, Computer science, Monocular, Motion (physics), Visibility

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange