Newest papers

Conducting Reliable Keyword Estimation with Unreliable ASR in Police Audio Data

Robert Cole Molloy, Rhiannon N. Miller, Stephen Morgan, Anjalie Field · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.26614 · cited by 0 works (OpenAlex) · open-access PDF

French

L'extraction d'informations d'intervalle provenant de grands ensembles de données audio à l'aide de la transcription humaine est coûteuse et coûteuse. Les systèmes de reconnaissance automatique de la parole (ASR) offshore offrent une alternative évolutive facile à utiliser, mais les erreurs de transcription systématiques, en particulier dans les paramètres spécifiques au domaine, peuvent détourner les analyses en aval et conduire à des conclusions peu fiables. Nous enquêtons sur la question de savoir si des transcriptions ASR imparfaites peuvent encore être utilisées pour obtenir des estimations de fréquence de mots clés statistiquement valables en combinant des sorties de modèle avec un petit ensemble d'exemples marqués par l'homme, en suivant les cadres d'apprentissage basés sur la pré

Machine translation (Meta M2M100); the English original follows.

Abstract

Extracting insights from large audio data sets using human transcription is expensive and time-consuming. Off-the-shelf Automatic Speech Recognition (ASR) systems offer an easy-to-use scalable alternative, but systematic transcription errors, especially in domain-specific settings, can bias downstream analyses and lead to unreliable conclusions. We investigate whether imperfect ASR transcripts can still be used to obtain statistically valid keyword frequency estimates by combining model outputs with a small set of human-labeled examples, following Prediction Powered Inference and Design-based Supervised Learning frameworks. We evaluate this approach on police radio communications from Baltimore and Chicago, a domain in which keyword distributions could provide valuable insights into police activity, but off-the-shelf ASR systems exhibit systematic errors on operationally important terminology. Using bootstrap-based confidence interval coverage as our evaluation metric, we find that our approach substantially increases the number of domain-specific keywords that can be analyzed with statistically valid confidence intervals, from 43.0% using ASR alone and 27.2% using only a small set of human-labeled transcriptions to 56.2% in the Baltimore dataset, with similar improvements observed in Chicago data. Our results demonstrate that post-hoc error correction can improve statistical validity of downstream analyses even for poor-quality transcriptions, offering an avenue for better leveraging off-the-shelf ASR models for large-scale speech analysis.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Inference, Speech recognition, Transcription (linguistics), Scalability, Set (abstract data type)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange