Newest papers

LocaLeJEPA: Maximum Entropy Representations under Geometric Priors

Kartik Tandon, Alessio Borgi, Pavel Snopov, Inés García‐Redondo, Davide D’Ascenzo, Sebastiano Cultrera di Montesano, Fabrizio Silvestri, Pietro Liò, Francesca Dominici, Randall Balestriero, Claudio Battiloro · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28458 · cited by 0 works (OpenAlex) · open-access PDF

Korean

Joint-Embedding Predictive Data Architectures (JEPA)는 자기 감독 학습에 대한 매력적인 접근 방식을 제공하지만 일반적으로 표현의 붕괴에 취약합니다. LeJEPA는 이론적으로 토착 된 배포 코드 일치 객체를 도입함으로써이 문제를 해결합니다. 그러나이 접근 방식을 기본적으로 유클리드 가정에 묶여 있으며 전 세계적인 목표는 도메인-특별한 지오메트릭 엔트로피아 프리어를 반영하지 않습니다. 예를 들어, 이와 동일한 CNNs 또는 hyperbolic ViTs를 도입합니다. 따라서 우리는 LeJEPA를 도입합니다. LeJEPA의 광범위한 이론적 개혁에 의해 동기를 부여되는 프레임 레소카아-최대화 특성을 반영합니다

Machine translation (Meta M2M100); the English original follows.

Abstract

Joint-Embedding Predictive Architectures (JEPA) offer an appealing approach to self-supervised learning, but are typically prone to representation collapse. LeJEPA resolves this by introducing a theoretically grounded distribution-matching objective that drives the embedding towards an isotropic Gaussian. However, this approach is fundamentally tied to Euclidean assumptions, and its global target does not reflect domain-specific geometric priors, such as the use of non-Euclidean embedding geometries, e.g., equivariant CNNs or hyperbolic ViTs. We thus introduce LocaLeJEPA, a framework motivated by a manifold-theoretic reformulation of LeJEPA's entropy-maximization property. The accompanying LocaLeReg, a novel locally Euclidean distribution-matching regularizer, enables a stable and scalable implementation of the LocaLeJEPA framework. We then perform extensive experiments in the vision setting on models trained on ImageNet-1K. LocaLeJEPA significantly outperforms LeJEPA when paired with hyperbolic ViT-S/8 and equivariant ResNet-50 backbones, and also with ordinary Euclidean ViT-S/8 and ViT-L/14 backbones. This holds both in terms of linear and k-NN classification performance on ImageNet and on a series of downstream tasks tested. We view the LocaLeJEPA formalism as a principled approach to the JEPA paradigm that better respects intrinsic data geometry while also accommodating generalizations to exotic embedding geometries. Code available at https://github.com/alessioborgi/LocaLeJEPA.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Embedding, Euclidean geometry, Equivariant map, Mathematics, Invariant (physics), Entropy (arrow of time)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange