Qiuyang Mang, Wenhao Chai, Runyuan He, Dongruixuan Li, Zihan Zheng, Yujun He, Xuanyi Zhou, Hao Wang · 2026 · arXiv
DOI: 10.48550/arXiv.2610.29932 · open-access PDF
可以LLM代理人为边界计算机科学研发做出贡献吗?我们引入了FrontierCS2,这是48个开放任务的基准。我们拿起一份论文和其作者发布的代码,并删除论文的贡献。删除的代码成为设置栏的人类参考。早期开放的基准给每个代理人一个问题声明,并在运行后评分一个程序。FrontierCS2将代理人放入研究环境中。代理人继承了工作存储库,并可以在任何时候提交补丁。
Machine translation (Meta M2M100); the English original follows.
Can LLM agents make contributions to frontier computer science R&D? We introduce FrontierCS 2, a benchmark of 48 open-ended tasks. We take a paper and the code its authors released and delete the paper's contribution. The deleted code becomes the human reference that sets the bar. Earlier open-ended benchmarks give each agent a problem statement and grade one program after the run. FrontierCS 2 places the agent inside a research environment. The agent inherits a working repository and may submit a patch at any point. For each patch, a judge returns a development-suite score but keeps the e
Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese
GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.29932, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txtSources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange