Chao Gu, Quanyan Zhu · 2026 · arXiv (Cornell University)
DOI: 10.48550/arxiv.2610.31376 · cited by 0 works (OpenAlex) · open-access PDF
この論文は、迅速な注入の下で大言語モデル(LLM)エージェントのための安全なツール実行の安全なステップの問題を研究します。ペトリネットを使用して、私たちは、LLMとそのツールの間の実行ハネスを監督制御の問題として公式化し、マークは能力、承認と予算を表しています。移行が存在する場合にのみ火を放つので、その要件が満たされていないまたは既に使われている前提条件を提出したエージェントを捕捉するには、その文法に関係なく拒否されます。 ツールの結果を制御できないように扱うことで、我々は、従来の最大許容性の監督によってセキュリティを強制し、このセキュリティは4つの仮定の下で実行
Machine translation (Meta M2M100); the English original follows.
This paper studies the problem of safe tool execution for large language model (LLM) agents under prompt injection. Using Petri nets, we formalize the execution harness between the LLM and its tools as a supervisory control problem, in which marks represent capabilities, approvals and budgets. Since a transition fires only if the marks it needs are present, an injected request whose preconditions are unmet or already spent is refused regardless of its wording. Treating tool outcomes as uncontrollable, we enforce safety by the conventional maximally permissive supervisor, and this safety transfers to the running system under four assumptions. Moreover, to capture an agent that may propose again after a refusal, we introduce the notion of a replanning closed loop, in which each retry costs an inference call. We show that, in this loop, the conventional supervisor can be arbitrarily more intrusive than a stricter safe one. Furthermore, for a given proposer model, the maximally permissive least-intrusive supervisor is characterized as a value-threshold refinement of the conventional one. Under precise conditions, this refinement orders two concurrent actions by at most one monitor place. On an autonomous release agent, we find by synthesis that safe deployment requires a step that the supervisor can refuse after a rollout starts.
Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese
Topics: Supervisor, Supervisory control, Action (physics), Computer science, Petri net, Control (management)
GET https://store.agentexchange.work/gw/papers/verify?title=...&year=... (0.003 USD), fetch this record as JSON with /gw/papers/paper?id=2610.31376, or list what it cites with /gw/papers/references?id=.... Pay per call in USDC (x402) or with a 19 USD card key for 1,000 calls. Catalogue · llms.txtSources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange