Overview
Using BrowseComp-V3 and RunAgent Super Browser as complementary lenses, this series explains why multimodal browser agents lose continuity across changing pages, images, and search hops. It moves from benchmark diagnosis to state-aware design: fresh perception, selective memory, semantic target ownership, verified transitions, efficiency trade-offs, and the limits of current evidence.
Learning outcomes
- Browser-agent reliability depends on keeping the goal, percept, page state, memory, action, and outcome aligned.
- BrowseComp-V3 separates whole-task Success Rate from Process Score, exposing partial progress before a late continuity failure.
- Super Browser makes freshness, selective memory, semantic ownership, and verified transitions explicit as a reliability contract.
- Its 89.47% Mind2Web Hard result supports the integrated design under reported conditions, but not any single mechanism's causal effect.
Keywords
Preview every chapter · Unlock full text, audio, and video from chapter 4
PlansFAQ
Why do multimodal browser agents fail after finding the right information?
They often lose continuity between the goal, current page, evidence identity, and dispatched action. A correct local observation can become globally wrong after a page change or search hop.
How can a browser agent reuse a target safely after the page changes?
It should reuse a cached target only when page-state signals, the URL, and mutation level still satisfy a stated freshness invariant. If the relevant state has changed, it must re-ground.
What do Success Rate and Process Score reveal about browser-agent performance?
Success Rate measures complete-task completion, while Process Score measures the share of required subgoals achieved. Their gap can expose useful progress before a final continuity failure.
Does Super Browser's reported success prove which mechanism made it work?
No. Its 89.47% result on 66 Mind2Web Hard tasks is end-to-end evidence under the reported setup, not single-component causal evidence. Controlled ablations are still needed.