Newest papers

LocaLeJEPA: Maximum Entropy Representations under Geometric Priors

Kartik Tandon, Alessio Borgi, Pavel Snopov, Inés García‐Redondo, Davide D’Ascenzo, Sebastiano Cultrera di Montesano, Fabrizio Silvestri, Pietro Liò, Francesca Dominici, Randall Balestriero, Claudio Battiloro · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28458 · cited by 0 works (OpenAlex) · open-access PDF

French

LeJEPA résout cela en introduisant un objectif de compatibilité de code de distribution théoriquement fondé qui conduit à l'intégration vers un Gaussian isotopique. Cependant, cette approche est fondamentalement liée aux hypothèses euclidiennes, et son objectif global ne reflète pas les prémices géométriques de l'entropie-maximisation spécifiques au domaine de LeJEPA, tels que l'utilisation de géométries de l'intégration de paradigmes non euclidiennes, par exemple, l'équivalent CNNs ou les ViTs hyperboliques. Nous introduisons ainsi LocaLeJEPA, un cadre motivé par une réformation théorique de la vision manifold de la mission de LeJEPA, alors que la

Machine translation (Meta M2M100); the English original follows.

Abstract

Joint-Embedding Predictive Architectures (JEPA) offer an appealing approach to self-supervised learning, but are typically prone to representation collapse. LeJEPA resolves this by introducing a theoretically grounded distribution-matching objective that drives the embedding towards an isotropic Gaussian. However, this approach is fundamentally tied to Euclidean assumptions, and its global target does not reflect domain-specific geometric priors, such as the use of non-Euclidean embedding geometries, e.g., equivariant CNNs or hyperbolic ViTs. We thus introduce LocaLeJEPA, a framework motivated by a manifold-theoretic reformulation of LeJEPA's entropy-maximization property. The accompanying LocaLeReg, a novel locally Euclidean distribution-matching regularizer, enables a stable and scalable implementation of the LocaLeJEPA framework. We then perform extensive experiments in the vision setting on models trained on ImageNet-1K. LocaLeJEPA significantly outperforms LeJEPA when paired with hyperbolic ViT-S/8 and equivariant ResNet-50 backbones, and also with ordinary Euclidean ViT-S/8 and ViT-L/14 backbones. This holds both in terms of linear and k-NN classification performance on ImageNet and on a series of downstream tasks tested. We view the LocaLeJEPA formalism as a principled approach to the JEPA paradigm that better respects intrinsic data geometry while also accommodating generalizations to exotic embedding geometries. Code available at https://github.com/alessioborgi/LocaLeJEPA.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Embedding, Euclidean geometry, Equivariant map, Mathematics, Invariant (physics), Entropy (arrow of time)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange