Newest papers

Forty Questions: Identifying a Language Model from One-Word Answers

Tapan Parikh · 2026 · arXiv

DOI: 10.48550/arXiv.2610.28281 · open-access PDF

Chinese

一个API背后的模型可以通过其单词的答案来识别日常问题,如“命名声音”或“命名诗人”。一个模型的个人资料记录了它对每个问题给出的每个答案的频率。我们将新答案归因于最有可能给出的模型。在94个模型中,40个答案确定了准确的模型92.5%的时间,而1.1%是偶然的。通过OpenRouter构建的配置文件在盲标下识别了DeepInfra服务的所有10个模型。

Machine translation (Meta M2M100); the English original follows.

Abstract

A model behind an API can be identified from its one-word answers to everyday questions such as "Name a sound" or "Name a poet". A model's profile records how often it gives each answer to each question. We attribute new answers to the model most likely to have given them. On a panel of 94 models, 40 answers identify the exact model 92.5% of the time, against 1.1% by chance. Profiles built through OpenRouter identified all ten models served by DeepInfra under blinded labels. A system prompt lowers accuracy by 6 to 16 points. We applied the method to 96 endpoints of 13 open models on OpenRouter

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Is this paper real? This page was built from OpenAlex and arXiv records, not generated. Software can verify any reference in one call: GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.28281, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txt

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange