Newest papers

ExeBench-FHD: Addressing Fidelity Issues in Decompiler Evaluation

Akarsh Ashok, Dinil Mon Divakaran, Vivek Balachandran · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28212 · cited by 0 works (OpenAlex) · open-access PDF

Chinese

ExeBench是最常用的数据基准之一,用于评估基于LLM的解调器。我们分析了ExeBench,并识别了九个问题,影响了测试混合器如何忠实地测量解调器。其中三个阻止了LLM解调器从ExeBench的功能中恢复C代码。这些是对整数和浮点类型混合时的模糊的参数顺序,未使用的参数,优化组装可能会下降,并且存储在函数组装代码外的常数。另外六个影响了测试有效性:没有返回的非空函数,位置持有人类型,优化器删除的静态或线性函数,函数被称为主体,试验体和断片定义。我们介绍了ExeBench-FHD,

Machine translation (Meta M2M100); the English original follows.

Abstract

ExeBench is one of the most widely used benchmarks for evaluating LLM-based decompilers. We analyze ExeBench and identify nine issues that affect how faithfully a test measures a decompiler. Three of them prevent LLM decompilers from recovering C code from ExeBench's function. These are ambiguous parameter order when integer and floating-point types are mixed, unused parameters that optimized assembly may drop, and constants stored outside the function's assembly code. Six more affect test validity: non-void functions without a return, placeholder types, static or inline functions removed by the optimizer, functions named main, trivial bodies and truncated definitions. We present ExeBench-FHD, a backward-compatible revision of ExeBench that adds 16 new fields: call-site assembly, data sections, test wrappers, linked-binary disassembly and five warning flags. In ExeBench, 38.9% of functions have at least one of the five flags; dropping records with any of the four warning flags (all except unused_param, which marks functions that the new wrappers make evaluable) keeps 63.9% of the corpus. In an evaluation at -O2 on four architectures, the new fields raise GPT 6 Sol's re-execution rate by up to 26.5%, 19.1% and 21.0% on functions that read data sections, mix parameter types and have unused parameters, respectively.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Fidelity, Code (set theory), Test (biology), Integer (computer science), Order (exchange)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange