Skip to content

Multi-Agent Systems Explained: How Teams of AI Agents Work Together

By Published 15 min read
A bright supervisor node above four glass agent panels, linked by lines, with dashed handoff arcs between the agents — a team of AI agents
On this page

Multi-agent systems are AI setups in which several agents, each a model using tools, work together on one task. A lead agent splits the work, specialists handle the parts in parallel or in sequence, and the results are combined. They can beat a single agent on broad research, but cost far more and fail often.

This guide explains how multi-agent systems work, the main orchestration patterns, when they beat a single agent and when they don't, what they cost, why they fail, the frameworks and protocols behind them, the security risks, and how businesses — including UAE government entities and real-estate firms — are using them.

Key takeaways

  • It's a team, not a smarter model. A lead agent plans and delegates; specialist agents do parts of the work; someone, or something, checks the result.
  • It wins on breadth and loses on sequence. Across 260 tested configurations, multi-agent setups gained up to 80.8% on tasks that split cleanly and lost 39% to 70% on step-by-step planning.
  • It's expensive. Anthropic measured multi-agent systems using about 15 times the tokens of a chat.
  • It fails often. A peer-reviewed study found failure rates of 41% to 86.7% across seven open-source multi-agent systems, mostly from design and coordination problems.
  • The plumbing has standardised. MCP (agents to tools) and A2A (agents to agents) now sit under the Linux Foundation, and the UAE plans to move half its government operations to agentic AI by 2028.

What is a multi-agent system?

A multi-agent system is a group of AI agents that work together on a goal, each with its own role, tools and context. Instead of one agent doing everything, work is divided among specialists and coordinated, usually by a lead agent.

Definition

Multi-agent system — several AI agents, each a language model using tools in a loop, working together on one task (Anthropic). Gartner describes them as collections of AI agents that interact to achieve individual or shared complex goals.

Single agentMulti-agent system
StructureOne model with a set of toolsA lead agent plus specialist agents
ContextOne context window holds everythingEach agent has its own context and hands back a summary
StrengthCoherent, sequential work; simpler to debugParallel, breadth-first work; separating concerns
CostLowerSeveral times higher
Main riskOverloaded context or too many toolsCoordination failures and compounding errors

The difference from ordinary automation matters too. In a workflow, code decides the path; in an agent, the model decides its own next step. Multi-agent systems combine both: some are fixed pipelines of agents, others let a lead agent decide whom to call. For what agents are and how they act, see agentic AI explained.

How do multi-agent systems work?

Most multi-agent systems follow a handful of patterns. The most common is the orchestrator-worker: a lead agent breaks a request into subtasks, sends them to specialist agents, and combines what comes back.

The orchestrator-worker pattern

  1. 01Plan
    • Lead agent reads the goal
    • Splits it into subtasks

    One agent owns the plan

  2. 02Delegate
    • Specialist agents
    • Own context each
    • Parallel where possible

    Research, analysis, drafting

  3. 03Work
    • Tools and data
    • Search, read, calculate

    Each specialist returns a summary

  4. 04Check
    • Verifier or reviewer agent
    • Rules and citations

    Where most systems are weakest

  5. 05Combine
    • Lead agent assembles
    • Human approves actions

    One voice in the final output

Anthropic's Research feature, OpenAI's manager pattern and Google's coordinator agents all follow this shape.
PatternHow it worksBest for
Orchestrator-worker (supervisor, manager)A lead agent delegates to specialists and merges their resultsBreadth-first research and analysis
HandoffsThe active agent passes the conversation to a better-suited peerCustomer triage and routing
RouterOne classification step sends each request to the right agentSimple, single-shot requests
Sequential pipelineAgents run in a fixed order, each feeding the nextRepeatable business processes
Parallel fan-outAgents work at the same time and results are mergedSpeed, if a checking step follows
HierarchicalPlanners break goals down for sub-planners and workersVery large, divisible projects such as code migrations
Generator and reviewerOne agent produces work; another critiques it until it passesQuality control
Group chat or debateAgents discuss and a manager decidesOpen-ended exploration

Every major framework now includes these patterns. OpenAI's Agents SDK supports handoffs and agents called as tools, Google's Agent Development Kit reached version 2.0 in May 2026 with graph-based multi-agent workflows, and Microsoft Agent Framework 1.0, released in April 2026 as the successor to AutoGen and Semantic Kernel, ships sequential, concurrent, handoff, group-chat and manager-led orchestration.

When do multi-agent systems beat a single agent?

When a task splits into independent parts that can be explored in parallel. When a task is sequential, or when one strong agent can already do it, adding agents usually makes results worse and always makes them more expensive.

What the data shows

What the evidence shows

  • Anthropic, June 2025: its multi-agent research system, a Claude Opus 4 lead with Claude Sonnet 4 subagents, beat a single Opus 4 agent by 90.2% on an internal research evaluation, and parallel subagents cut research time by up to 90% on complex queries.
  • Anthropic, February 2026: with a newer model, the gap on the BrowseComp benchmark was small: 86.57% for a multi-agent setup against 83.73% for the best single agent.
  • Google, MIT and others, April 2026: across 260 configurations and six benchmarks, multi-agent setups ranged from +80.8% on decomposable financial reasoning to −70.0% on sequential planning; every multi-agent variant was 39% to 70% worse on planning tasks.

The same study found that once a single agent's success rate passed about 45%, adding agents produced negative returns, because coordination costs outweighed the remaining room for improvement. That's why the builders' advice converges. OpenAI recommends getting the most out of a single agent before splitting work across several, and splitting only for complex branching logic or tool overload.

The most instructive reversal came from Cognition, the maker of the Devin coding agent. In June 2025 it argued against building multi-agent systems; in April 2026 it said a narrower class works — setups where extra agents contribute intelligence, such as reviewers, but writes stay with a single agent.

Common misconception

"Multi-agent systems are about 90% better." That figure came from one internal evaluation with 2025 models. With a newer model, Anthropic's own multi-agent advantage on BrowseComp was under three percentage points, and independent research finds the benefit depends almost entirely on the shape of the task.

What do multi-agent systems cost?

Several times more than a single agent, mainly in tokens. Anthropic found agents use about four times the tokens of a chat, and multi-agent systems about 15 times, so they only pay off when the task is valuable enough.

  • Tokens. In Anthropic's analysis, token usage alone explained 80% of the variance in research performance: more agents find more because they read more.
  • Coordination. In the Google-MIT study, messages between agents added 58% to 515% over a single agent, depending on the architecture.
  • Model mix. Cursor built the same SQLite project with different model combinations and got similar quality for costs ranging from $1,339 to $10,565; worker agents consumed at least 69% of the tokens, so putting cheaper models on the workers saved most.
  • Scale. Anthropic's 16 parallel agents wrote a 100,000-line C compiler able to build the Linux kernel, over nearly 2,000 sessions and about $20,000 of API costs.

Why do multi-agent systems fail?

Mostly because of how they're designed and coordinated, not because the models are weak. Agents repeat steps, ignore their instructions, lose track of what others are doing, stop too early or never stop, and nobody checks the final answer properly.

What the data shows

Why multi-agent systems fail (MAST study, NeurIPS 2025)

  • 1,642 annotated execution traces from seven open-source multi-agent systems; failure rates of 41% to 86.7%.
  • 44.2% of failures come from system design, such as disobeying the task specification or repeating steps.
  • 32.3% come from misalignment between agents, such as derailing the task or ignoring another agent's input.
  • 23.5% come from task verification: stopping early, or checking incompletely or wrongly.

Errors also compound. In the Google-MIT study, agents working independently amplified errors 17.2 times, while a central orchestrator that checked work before combining it contained this to 4.4 times. Builders report the same problems in practice:

  • Runaway delegation. Early versions of Anthropic's research system spawned 50 subagents for simple queries and distracted each other with excessive updates.
  • Collisions. When Anthropic's compiler project became one giant task, all 16 agents hit the same bug and overwrote each other's fixes.
  • Bottlenecks. In Cursor's experiments, flat agents coordinating through shared locks meant 20 agents ran at the effective throughput of two or three; a hierarchy of planners, workers and a judge worked instead.
  • Conflicting assumptions. Cognition found parallel agents making incompatible decisions that nobody reconciled.

What frameworks and protocols do multi-agent systems use?

Most teams build on a vendor framework and connect agents through two open protocols: MCP, which links an agent to tools and data, and A2A, which links agents to each other.

LayerMain options (September 2026)
FrameworksOpenAI Agents SDK; Microsoft Agent Framework 1.0; Google Agent Development Kit 2.0; LangGraph; CrewAI
Agent-to-tool protocolMCP (Model Context Protocol), donated in December 2025 to the Linux Foundation's Agentic AI Foundation, co-founded by Anthropic, Block and OpenAI
Agent-to-agent protocolA2A (Agent2Agent), version 1.0 in March 2026 with signed agent cards; joined the Agentic AI Foundation in August 2026
ObservabilityTracing in the frameworks (OpenAI's is on by default) and emerging OpenTelemetry conventions for agents

The protocols are complementary, not competing: an agent might use MCP to read a CRM and A2A to ask another company's agent for a quote. How agents transact with each other is covered in agent-to-agent transactions, and where agents are distributed and sold in AI agent marketplaces.

How secure are multi-agent systems?

Less secure than single agents, because every message between agents is another place for an attack to enter and spread. Security bodies now treat inter-agent communication as its own risk category.

  • New risk categories. The OWASP Top 10 for Agentic Applications, published in December 2025, lists insecure inter-agent communication (ASI07) and cascading failures (ASI08), alongside goal hijacking and rogue agents.
  • Hijacking works. In a public red-teaming competition analysed by NIST's Center for AI Standards and Innovation, more than 400 participants made over 250,000 attack attempts on 13 frontier models in agentic scenarios, and at least one attack succeeded against every model.
  • Trust boundaries. Treat messages from other agents like untrusted input, give each agent only the permissions it needs, and put a human approval gate before anything that pays, sends or signs.

These controls belong in a company's wider rules for autonomous AI — see AI governance.

Where are multi-agent systems used in business?

In research, software engineering, document-heavy processes and customer operations — mostly in pilots and early production, with results reported by the companies themselves.

OrganisationWhat it doesReported result
Allianz (Project Nemo, Australia)Seven task-specific agents handle simple food-spoilage claims after storms, from coverage checks to fraud detection80% less claim processing and settlement time; under five minutes to final human review; a human makes every payout decision (company claim)
Anthropic (Research)A lead agent directs parallel search subagents and a citation agent90.2% better than one agent on an internal evaluation (company claim)
CursorPlanner, worker and judge agents on large coding projectsOver a million lines of code written by hundreds of concurrent agents (company claim)
Cognition (Devin)A manager agent spawns child agents; a separate review agent checks each pull requestThe review agent catches an average of two bugs per pull request, about 58% of them severe (company claim)

Coding is the most mature use; the tools are covered in AI coding agents. For deciding which business processes to hand to agents at all, see AI agents for business.

What is the UAE doing with agentic and multi-agent AI?

The UAE federal government has committed to moving half its sectors, services and operations to agentic AI within two years, and some entities already run networks of collaborating agents.

  • The framework. In April 2026 the UAE announced a framework to transform 50% of government sectors, services and operations into agentic AI models within two years, with ministers assessed on the speed of adoption.
  • First agents. In May 2026 the government launched its first cohort of four AI agents, for procurement, tax auditing, customer happiness and technical support, and began training 80,000 federal employees in agentic AI tools.
  • A multi-agent example. In June 2026 the National Centre of Meteorology deployed two agentic assistants built on a network of autonomous but collaborating agents on one platform, with specialists making every final decision.
  • Real estate. Dubai Land Department's AI advertising platform had monitored more than 279,000 property ads on Property Finder, Dubizzle and Bayut by April 2025, and 29% of them had been modified automatically — AI in the regulator's workflow, though not described as multi-agent. The wider landscape is in the Dubai proptech guide.

How could real-estate firms use multi-agent systems?

Where work splits into parallel research or checkable steps. We found no verified real-estate multi-agent deployment that publishes outcome data, so the uses below are patterns the evidence supports, not proven results.

UsePatternWhy it fitsWatch out for
Market and land due diligenceOrchestrator with parallel research agents; one agent writes the reportBreadth-first research is where multi-agent systems gain mostToken costs; verify every figure
Transaction documents (sales contracts, KYC, escrow paperwork)Sequential specialists with an audit agent and human sign-offMirrors the claims-processing patternKeep humans on payments and approvals
Listing compliance and marketing copyGenerator and reviewerReviewers catch missing permit numbers and banned claimsThe reviewer needs explicit rules to check
Lead and customer triageRouter or handoffsRoutes enquiries to the right specialist agent or personNo published production metrics yet

Should you build a multi-agent system?

Only after a single agent has hit a real limit. Start with one well-equipped agent, measure it, and add agents where the task genuinely splits.

  1. Start single. Split only when one agent struggles with too many tools, overlapping instructions or a task that clearly divides into parallel parts.
  2. Match the pattern to the task. Parallel for research, sequential for processes, handoffs for triage; avoid multi-agent designs for step-by-step planning.
  3. Add a checker. A verification or review agent with clear rules is the difference between 4.4 and 17.2 times error amplification.
  4. Mix models. Use a strong model to plan and cheaper models to do the work.
  5. Trace everything. Log every agent's inputs, outputs and tool calls so failures can be diagnosed.
  6. Gate the actions. Anything that pays, sends, signs or deletes needs a human approval step.
  7. Budget for tokens. Price the task at several times single-agent cost before you promise savings.

What comes next for multi-agent systems?

More adoption, more cancellations and more standards, in that order. Gartner lists multiagent systems among its top strategic technology trends for 2026, while placing agentic AI at the peak of its hype cycle.

  • Adoption: Gartner's 2026 CIO survey found 17% of organisations had deployed AI agents, with more than 60% expecting to within two years.
  • Cancellations: Gartner forecasts that over 40% of agentic AI projects will be cancelled by the end of 2027, and that 40% of enterprises will demote or decommission autonomous agents by 2027 because of governance failures.
  • Standards: MCP and A2A are now governed together under the Agentic AI Foundation, and NIST launched an AI Agent Standards Initiative in February 2026.
  • UAE: the federal target of 50% of government operations on agentic AI falls due in 2028.

Final takeaway

Multi-agent systems are teams of AI agents, and like human teams they're worth their overhead only when the work can genuinely be divided. They shine on broad, parallel research and on checkable pipelines with a reviewer in the loop; they struggle on sequential reasoning and cost several times more than a single agent. The evidence points to a disciplined approach: start with one agent, split the work only where it divides, put a verifier and a human gate in the loop, and use cheaper models for the workers. For UAE organisations facing a government-wide push to agentic AI, that discipline is the difference between a working team and an expensive argument between bots.

AI strategy

Working out where AI fits in your business?

I help teams separate the use cases worth automating from the ones that only demo well — then build the workflow, the integrations and the guardrails.

Sources

Primary sources checked for this article. Figures reflect the dates shown.

  1. How we built our multi-agent research system — Anthropic, June 13, 2025
  2. System Card: Claude Opus 4.6 — Anthropic, February 2026
  3. Why Do Multi-Agent LLM Systems Fail? — arXiv (UC Berkeley et al.; NeurIPS 2025 Datasets and Benchmarks), October 26, 2025
  4. Towards a Science of Scaling Agent Systems — arXiv (Google Research, Google DeepMind, MIT et al.), April 8, 2026
  5. A practical guide to building agents — OpenAI, April 2025
  6. Agent orchestration — OpenAI Agents SDK — OpenAI
  7. Don't Build Multi-Agents — Cognition, June 12, 2025
  8. Multi-Agents: What's Actually Working — Cognition, April 22, 2026
  9. Building a C compiler with a team of parallel Claudes — Anthropic, February 5, 2026
  10. Scaling long-running autonomous coding — Cursor, January 14, 2026
  11. Agent swarms and the new model economics — Cursor, July 20, 2026
  12. When the storm clears, so should the claim queue — Allianz, November 3, 2025
  13. Microsoft Agent Framework Version 1.0 — Microsoft, April 3, 2026
  14. Release v2.0.0 · google/adk-python — Google (GitHub), May 19, 2026
  15. A2A Protocol Ships v1.0: Production-Ready Standard for Agent-to-Agent Communication — A2A Protocol (Linux Foundation), March 12, 2026
  16. A New Chapter for A2A: Joining the Agentic AI Foundation — A2A Protocol (Linux Foundation), August 27, 2026
  17. Donating MCP to the Agentic AI Foundation — Anthropic, December 9, 2025
  18. Gartner Predicts Over 40% of Agentic AI Projects Will Be Canceled by End of 2027 — Gartner, June 25, 2025
  19. What the 2026 Hype Cycle for Agentic AI Reveals — Gartner, April 15, 2026
  20. Gartner Says Applying Uniform Governance Across AI Agents Will Lead to Enterprise AI Agent Failure — Gartner, May 26, 2026
  21. OWASP Top 10 for Agentic Applications - The Benchmark for Agentic Security in the Age of Autonomous AI — OWASP GenAI Security Project, December 9, 2025
  22. Insights into AI Agent Security from a Large-Scale Red-Teaming Competition — NIST (CAISI), March 23, 2026
  23. Mohammed bin Rashid unveils framework to deploy agentic AI across 50% of government sectors within 2 years — Government of Dubai Media Office, April 23, 2026
  24. Mohammed bin Rashid Al Maktoum attends national retreat on UAE Government's Agentic AI project — Government of Dubai Media Office, May 20, 2026
  25. NCM launches country's first Agentic AI assistants for meteorological sector — Emirates News Agency (WAM), June 29, 2026
  26. Dubai Land Department strengthens transparency with AI-enabled real estate advertising governance — Dubai Land Department, April 2025
Share
  • #Multi-Agent Systems
  • #AI Agents
  • #Orchestration
  • #Agentic AI
  • #AI Security

FAQ

Frequently asked questions

Keep reading

A wall of glass agent tiles with one lifted out, lit and carrying a verification shield — AI agent marketplaces

Trend14 min read

AI Agent Marketplaces: The Next App Store?

What an AI agent marketplace is, where businesses buy agents in 2026 — AWS, Google, Microsoft, Salesforce, ChatGPT, Claude — plus fees, pricing and security.

Next step

Have a project in mind? Let's build something great together.

Book a free consultation call — get a clear, honest read on your lead-gen, SEO or web project within 24 hours.