Quant Memo
Core

Multi-Agent Research Pipelines

Why splitting an LLM research task across several specialized agents — one to retrieve, one to analyze, one to critique — often beats asking one agent to do everything in a single pass.

Prerequisites: LLM Agents and Tool Use, Agentic Research Workflows

Ask a single LLM to "research whether this company's margin guidance is credible, using the latest 10-K, the last four earnings calls, and analyst estimates, and write a memo" and you're asking one model, in one pass, to retrieve the right documents, read and synthesize a lot of material, form a judgment, and write it up clearly — all at once, with no opportunity to check its own retrieval before it starts reasoning on top of possibly-wrong sources. A multi-agent pipeline breaks this into separate agents, each with a narrower job, so a mistake at one stage (a bad retrieval, an unsupported claim) can be caught by another agent before it becomes the final answer.

Why splitting the task helps

A single agent doing everything at once has no natural checkpoint: if its first retrieval call misses the most relevant passage, it just reasons confidently on top of whatever it did retrieve, and there's no separate step where that gap gets noticed. Splitting the pipeline into a retriever agent (whose only job is finding and returning the most relevant source passages), an analyst agent (which reasons over those passages and drafts conclusions), and a critic agent (which checks the analyst's draft against the retrieved sources for unsupported claims) creates a natural point where each agent's narrower, more checkable output can be verified before the next stage builds on it. It also lets each agent's prompt be simpler and more focused, which tends to make each individual step more reliable than one agent trying to juggle every responsibility in a single long prompt.

Worked example: a three-agent margin-credibility pipeline

Stage 1, the retriever agent, is given the task "find passages discussing gross margin drivers from the latest 10-K and the last four earnings calls" and returns eight specific passages with source citations — nothing else, no analysis. Stage 2, the analyst agent, receives only those eight passages (not the full documents) and drafts: "management's guidance for margin expansion relies on an assumed 3% reduction in input costs, mentioned in Q3's call but not repeated in the 10-K or Q4's call" — a specific, checkable claim tied to specific passages. Stage 3, the critic agent, is given the analyst's draft plus the same eight passages and checks each claim: it confirms the Q3 mention, confirms the absence in Q4, and flags one sentence in the draft — "margins are likely to disappoint" — as not actually supported by any of the eight passages, since it's the analyst's own inference stated as fact. That flagged sentence gets revised to "margins carry execution risk on the assumed cost reduction" before the memo is finalized — a correction that a single-pass agent, with no separate critic step, would have had no structural opportunity to catch.

Retriever finds passages Analyst drafts conclusions Critic checks vs. sources flags unsupported claim back to analyst
Each stage's narrower output is checkable by the next; the critic stage exists specifically to catch claims the analyst stated as fact but the sources don't support.

What this means in practice

Multi-agent pipelines cost more — more LLM calls, more latency, more infrastructure to route messages between agents — so they're worth it specifically when the task has natural checkpoints (retrieval quality, factual grounding, output format) where an intermediate check can catch a mistake before it compounds. They are not a free accuracy upgrade for every task: a simple, well-defined lookup with a single ground-truth answer often does better as one focused agent call than as an over-engineered pipeline with agents checking each other for no real reason.

Splitting an LLM task across specialized agents — retriever, analyst, critic — creates checkpoints where a mistake made at one stage (bad retrieval, an unsupported claim) can be caught before it reaches the final output, at the cost of more calls and more orchestration than a single agent doing everything in one pass.

Related concepts

Practice in interviews

Further reading

  • Anthropic, Building Effective Agents
ShareTwitterLinkedIn