Newest papers

Separate Field Scoring Protects Unused Tools When Agents Pool Tool-Use Experience

Abhijit Chakraborty · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.30867 · cited by 0 works (OpenAlex) · open-access PDF

Japanese

同じディレクトリからツールを呼び出すエージェントは、どのツールがどのリクエストに役立つかについて学ぶものを集めることができます。我々は、同じディレクトリから同じツールを呼び出したエージェントは、ツールのリクエストに、同じツールが使用されていない3つのカタログのうちの2つと、両方のインベーダーで分離して、持っているツールのリクエストに、持っている使用例を測定します。使用するツールのための追加のテキストエントリとして、インデックスに使用したツールの使用例を追加すると、Hit@5(ゴールドツールがトップ5に含まれているかどうか)が、それらのツールのために高く、それらのツールの使用を自分のフィールド SYN

Machine translation (Meta M2M100); the English original follows.

Abstract

Agents that call tools from a shared catalog can pool what they learn about which tool serves which request. We measure what pooled usage examples do to tool retrieval, reporting separately the held-out tools, for which no agent has usage, and all other tools. Adding usage examples to the index as extra entries for used tools raises Hit@5 (whether a gold tool is in the top five) for those tools and lowers it for held-out tools, by a large margin on two of three catalogs and with both embedders we tested. Giving used tools the same number of equally long entries filled with other tools' text lowers held-out Hit@5 about as much, but gives little or none of the gain. We call our method of scoring usage as its own field SYNAPSE. On StableToolBench, the held-out gold tool appears in its top five more often than with a router that reserves slots for usage (0.785 against 0.683), and this held-out lead holds on all three catalogs with both embedders. This protection persisted when we replaced each tool's usage with other tools' text, and a constant score offset for tools with usage gives similar held-out Hit@5 in most settings. The gain for tools with usage, in contrast, needs usage about the right tool. The router keeps more of the gain on labeled queries on TOUCAN with both embedders and on ToolRet with one, so the better choice depends on the workload. Splitting the usage among ten simulated agents shows that pooling helps exactly as much as giving one agent the same records.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Pooling, Computer science, Offset (computer science), Router, Field (mathematics), Margin (machine learning)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange