From Framework to Generalist Team: Magentic-One

Magentic-One is a concrete test of how AutoGen’s conversation-centered design can support open-ended work rather than a single narrow application. The important question is not whether its five-agent roster should be copied, but how the system turns specialized capabilities, shared task state, and progress signals into a recoverable workflow. Understanding that architecture lets the reader distinguish a framework substrate from a particular generalist team and see why planning and replanning matter when a conversation spans tools, files, web pages, and code.

A framework becomes a team by assigning tools and boundaries

The 2024 Magentic-One paper describes a generalist multi-agent system implemented on AutoGen version 0.4. Its team contains an Orchestrator, a Coder, a ComputerTerminal, a FileSurfer, and a WebSurfer. The names are useful only if they are read as responsibility boundaries. The Orchestrator directs the work. The Coder writes and reasons about programs. The ComputerTerminal executes code or shell commands. The FileSurfer handles local files through a read-only preview application. The WebSurfer operates a browser and reports what it observes.

This is not a claim that AutoGen itself consists of those five agents. AutoGen is the framework that provides the conversational substrate and extensibility. Magentic-One is an application architecture built on that substrate for a particular scope: ad hoc tasks involving files, web interaction, coding, and computer actions. The distinction matters because a framework can support many topologies, while an application must choose a concrete team, control policy, tool set, and termination behavior. Treating one reference team as the definition of the framework would confuse an example of composition with the space of possible compositions.

Magentic-One uses a tool-centric division of labor. Instead of giving each participant a human-style title such as researcher, analyst, or critic and asking each to operate whatever tools are needed, it assigns broad capabilities to agents that are centered on a web browser, files, code writing, or code execution. The Orchestrator chooses the broad capability. The selected worker then chooses among a smaller set of actions within that capability. The hierarchy reduces the immediate decision space: the Orchestrator need not choose among every browser click, file operation, or line of code at once.

The WebSurfer illustrates the boundary. It receives a natural-language request, maps it to a browser action, and reports the new page state with a screenshot and written description. Its action space includes navigation, page interaction, and reading tasks. The Orchestrator does not directly manipulate every page element; it relays a task to a participant that understands the browser state. Similarly, FileSurfer navigates a read-only preview application and can work across several file types, while the ComputerTerminal carries out execution deterministically when asked. The agents are different not because they have different personalities, but because the outside state and action vocabulary differ.

The Coder occupies another boundary.