VeeReview: Measuring Build-Verify Pairs in Agent-Authored Pull Requests from a V-Model Perspective

Gabriel Dautovi, Jie JW Wu · 2026 · arXiv

DOI: 10.48550/arXiv.2610.29143 · open-access PDF

Japanese

背景: pull request をレビューするには、提案された変更に対応する検証証が必要です。コードエージェントベンチマークと pull request 結果の研究は、この関係を直接評価しません。目標: V-Model の build and verify pairs が pull request で検証証証を測定し、 agent-authored and human-authored changes との比較をサポートできるかどうかをテストします。方法: VeeReview は、リポジトリ信号と言語モデル判決を使用して 4 組の build and verify pairs を分類します。 3 組は、決定的な信号によって制限されたモデル判定を使用し、異なる規則を適用します。

Machine translation (Meta M2M100); the English original follows.

Abstract

Context: Reviewing a pull request requires verification evidence that addresses the proposed change. Coding agent benchmarks and studies of pull request outcomes do not directly assess this relationship. Objective: We test whether the V-Model's build and verify pairs can measure verification evidence in pull requests and support comparisons between agent-authored and human-authored changes. Method: VeeReview classifies four build and verify pairs using repository signals and a language-model judge. Three pairs use model judgements constrained by deterministic signals, and a rule over the diff

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Is this paper real? This page was built from OpenAlex and arXiv records, not generated. Software can verify any reference in one call: GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.29143, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txt

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange