Newest papers

Which Model for Which Role? Cost-Efficient Pareto Recommendation for LLM Agentic Workflows

Qian Xie, Wenyue Hua, Yueli He, Sripad Karne, Armaan Agrawal, Nikos Pagonas, Eugene Wu, Kostis Kaffes, Tianyi Peng, Nairen Cao · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.26676 · cited by 0 works (OpenAlex) · open-access PDF

Chinese

LLM代理工作流越来越多地使用不同的模型用于专业角色。 用户可能更喜欢任务质量和部署成本之间的不同对比,有时还考虑延迟。 寻找好的任务由评估多个候选人产生一个单独的搜索成本。 我们引入了成本相关的Gitins(CC-Gittins),一个单个目标的成本意识Gitins搜索对帕雷托建议的多目标扩展。 它利用评估和部署成本之间的对比:部署成本更高的任务也需要评估更多的成本。 搜索在寻找更高的质量和更低的部署成本之间交替,重复使用每个评估来告知两个搜索。 每个批次后,CC-Gittins建议在不确定性调整的质量和部署估计下非命名的任务。 我们评估CC-Gittins在质量前沿的成本 - 负担

Machine translation (Meta M2M100); the English original follows.

Abstract

LLM agentic workflows increasingly employ different models for specialized roles. Users may prefer different trade-offs between task quality and deployment cost, sometimes also considering latency. Finding good assignments incurs a separate search cost from evaluating multiple candidates. We introduce Cost-Coupled Gittins (CC-Gittins), a multi-objective extension of single-objective cost-aware Gittins search for Pareto recommendation. It exploits the coupling between evaluation and deployment costs: assignments that cost more to deploy also cost more to evaluate. The search alternates between seeking higher quality and lower deployment cost, reusing each evaluation to inform both searches. After each batch, CC-Gittins recommends assignments that are nondominated under uncertainty-adjusted estimates of quality and deployment cost. We evaluate CC-Gittins on eight quality--cost matrices from workflows with two to five roles and up to 1,681 candidate assignments. We also evaluate the method with latency as a third objective. Across the eight benchmarks, CC-Gittins recovers a substantial fraction of the true Pareto frontier at roughly 10% of the exhaustive-evaluation cost, and recovers most of the frontier with few false positives by 30%.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Workflow, Software deployment, Computer science, Pareto principle, Exploit, Task (project management)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange