Newest papers

Open-Vocabulary Models and Label Propagation for Uncertainty-aware Pseudo-Labeling of Object Detection Datasets

Jonathan Klees, Timo Heller, Matthias Rottmann · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.29788 · cited by 0 works (OpenAlex) · open-access PDF

Portuguese

Os modelos de detecção de potenciais objetos dependem de conjuntos de dados anotados em grande escala que requerem um esforço de anotação manual substancial. Os custos de rotulagem aumentam ainda mais quando a incerteza de anotação é capturada através de rótulos macios, já que múltiplas anotações devem ser coletadas para cada objeto. Com base nessas representações, abordamos este desafio introduzindo um quadro semi-supervisionado para a anotação consciente da incerteza dos conjuntos de dados de detecção de objetos. Nossa abordagem utiliza detectores de objetos de vocabulário aberto para gerar propostas regionais e representações de objetos semânticamente significativas. Com base nessas representações, construímos um gráfico de semelhança de nível de objeto e propagamos informações de rótulos probabilísticos.

Machine translation (Meta M2M100); the English original follows.

Abstract

Object detection models rely on large-scale annotated datasets that require substantial manual annotation effort. The labeling costs further increase when annotation uncertainty is captured through soft labels, as multiple annotations must be collected for each object. We address this challenge by introducing a semi-supervised framework for the uncertainty-aware annotation of object detection datasets. Our approach leverages open-vocabulary object detectors to generate region proposals and semantically meaningful object representations. Based on these representations, we construct an object-level similarity graph and propagate probabilistic label information. Our framework assigns soft labels to previously unlabeled objects, quantifying both aleatoric and epistemic uncertainty. We evaluate our method on four object detection benchmarks with soft-label annotations and demonstrate that high-quality annotations can be obtained with only a small fraction of manually labeled objects. Furthermore, we show that detectors trained on semi-automatically annotated data achieve performance comparable to models trained on fully manually annotated data. We achieve state-of-the-art downstream detection performance for the task of semi-supervised object detection on the COCO dataset, with 40.5% AP virtually matching the performance of the model trained on fully manually constructed data (40.9%) at only 1% of labeling costs. These results highlight the potential of open-vocabulary models and graph-based label propagation for efficient, accurate and uncertainty-aware pseudo-labeling.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Annotation, Computer science, Object detection, Artificial intelligence, Probabilistic logic, Object (grammar)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange