Newest papers

Conducting Reliable Keyword Estimation with Unreliable ASR in Police Audio Data

Robert Cole Molloy, Rhiannon N. Miller, Stephen Morgan, Anjalie Field · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.26614 · cited by 0 works (OpenAlex) · open-access PDF

Japanese

人間のトランスクリプションを使用して大規模なオーディオデータセットから洞察を抽出することは高価で時間がかかります。 屋外の自動スピーチ認識(ASR)システムは、使いやすいスケーラブルな代替手段を提供しますが、特にドメイン特定の設定で体系的なトランスクリプションエラーは、下流の分析を偏見し、信頼できない結論につながります。 私たちは、不完全なASRトランスクリプションが依然として統計的に有効なキーワード周波数推定を得るために使用されるかどうかを調査しますが、モデル出力と小規模なヒューマンラベルされた例を組み合わせることによって、予測パワーインベントインベントとデザインベースの監督学習枠組みに従って。 私たちは、バルティモアとシカ

Machine translation (Meta M2M100); the English original follows.

Abstract

Extracting insights from large audio data sets using human transcription is expensive and time-consuming. Off-the-shelf Automatic Speech Recognition (ASR) systems offer an easy-to-use scalable alternative, but systematic transcription errors, especially in domain-specific settings, can bias downstream analyses and lead to unreliable conclusions. We investigate whether imperfect ASR transcripts can still be used to obtain statistically valid keyword frequency estimates by combining model outputs with a small set of human-labeled examples, following Prediction Powered Inference and Design-based Supervised Learning frameworks. We evaluate this approach on police radio communications from Baltimore and Chicago, a domain in which keyword distributions could provide valuable insights into police activity, but off-the-shelf ASR systems exhibit systematic errors on operationally important terminology. Using bootstrap-based confidence interval coverage as our evaluation metric, we find that our approach substantially increases the number of domain-specific keywords that can be analyzed with statistically valid confidence intervals, from 43.0% using ASR alone and 27.2% using only a small set of human-labeled transcriptions to 56.2% in the Baltimore dataset, with similar improvements observed in Chicago data. Our results demonstrate that post-hoc error correction can improve statistical validity of downstream analyses even for poor-quality transcriptions, offering an avenue for better leveraging off-the-shelf ASR models for large-scale speech analysis.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Inference, Speech recognition, Transcription (linguistics), Scalability, Set (abstract data type)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange