Newest papers

Industrial ReMEmbR: Scaling Spatiotemporal Memory to Robot Fleets

Jad Yammine, Malek Wahidi, Abrar Anwar, Yan Chang, Mihir Acharya, Anthony Rizk · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28624 · cited by 0 works (OpenAlex) · open-access PDF

Chinese

仓库机器人舰队不断观察操作条件,但将这些观察作为可重复使用的语义记忆所造成的重大计算,通信和存储成本。例如,解释重复的走廊封锁可能需要在多个转移中审查多个机器人的视频。我们介绍了IndustrialRemembr,一个共享的空间时记系统,它将NVIDIA ReMEmbR扩展到机器人舰队,并通过仅根据需求生成场景描述来减少服务器侧计算。在每个机器人上,NVIDIA Jetson将视频剪辑编码为Cosmos-Embed1的检索嵌入式,与Cosmos3-Edge的视觉代码,以及与Wan2.2 VAE一起重建隐藏的内容,而不会上传原始摄像头框架。编码

Machine translation (Meta M2M100); the English original follows.

Abstract

Warehouse robot fleets continuously observe operational conditions, but preserving these observations as reusable semantic memory incurs substantial computation, communication, and storage costs. For example, explaining recurring aisle blockages can require reviewing video from multiple robots across several shifts. We present IndustrialRemembr, a shared spatiotemporal memory system that extends NVIDIA ReMEmbR to robot fleets and reduces server-side computation by generating scene descriptions only on demand. On each robot, an NVIDIA Jetson encodes video clips into retrieval embeddings with Cosmos-Embed1, vision tokens with Cosmos3-Edge, and reconstruction latents with the Wan2.2 VAE, without uploading raw camera frames. The encoding models are re-used to detect people in image patches, zeroing them out to support PII abstraction for GDPR-compliant deployments. We split Cosmos3-Edge at its vision-language boundary, placing the vision encoder on the robot and the language decoder on an on-premises server. A Nemotron agent retrieves memories by content, position, and time and queries the decoder using cached vision tokens. This design eliminates caption generation at write time, while cached-token decoding reproduces the unsplit model's output in all 450 tested decodes.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Robot, Encoding (memory), Decoding methods, Computer vision, Cache

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange