Newest papers

Black-Box Red-Teaming of Multi-Agent Systems via Reinforcement Learning

Yuqi Jia, Hangsheng Zhang, Chenxi Liu, Junjie Liang, Xun Chen · 2026 · arXiv (Cornell University)

DOI: 10.48550/arxiv.2610.28966 · cited by 0 works (OpenAlex) · open-access PDF

Hindi

बड़े भाषा मॉडल (एलएलएम) एजेंटों को अधिक से अधिक जटिल कार्यों को पूरा करने के लिए मल्टी-एजेंट सिस्टम (एमएएस) में तैनात किया जाता है। पूर्व ब्लैक बॉक्स रेड-टेमिंग हमलों को मुख्य रूप से एकल एजेंटों पर केंद्रित किया जाता है, लेकिन हम पाते हैं कि ये तरीके एमएएस में बहुत कम प्रभावी हैं, जहां कई उप-एजेंटों को उपयोगकर्ता के साथ सीधे बातचीत नहीं हो सकती है। इसलिए, हम आरएमएएस, एमएएस के लिए अनुकूलित पहला मजबूत सीखने-आधारित रेड-टेमिंग फ्रेमवर्क, जो एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट एजेंट

Machine translation (Meta M2M100); the English original follows.

Abstract

Large language model (LLM) agents are increasingly deployed in multi-agent systems (MAS) to accomplish complex tasks. Prior black-box red-teaming attacks mainly focus on single agents, but we find that these methods are far less effective in MAS, where multiple sub-agents may not directly interact with the user. Therefore, we introduce ReMAS, the first reinforcement learning-based red-teaming framework tailored to MASs, which fine-tunes attacker LLMs to generate effective adversarial prompts for system prompt extraction. The framework follows a two-step process: first, a rewrite stage refines base attack prompts to increase extraction success, and second, a template generation stage constructs attack templates that improve the likelihood of invoking specific sub-agents and thus revealing their system prompts. Extensive experiments show that our method substantially improves attack success rates compared to existing black-box attacks, with transferability across different backend LLMs and MAS structures. These results underscore the vulnerabilities of multi-agent systems and the importance of developing stronger defenses against adaptive black-box adversaries.

Read in: English · Spanish · Chinese · Hindi · Arabic · Portuguese · French · German · Japanese · Russian · Korean · Indonesian · Vietnamese

Topics: Computer science, Adversarial system, Focus (optics), Reinforcement learning, Artificial intelligence, Key (lock)

Sources: OpenAlex (CC0), arXiv, Crossref. Agent Exchange