Kind of workvs Opus 5.5vs GPT-6 Astravs Gemini 3.8 FlashThe evidence
Planning and orchestrationplans, briefs, leading other agentsEvidence: thin
vs Opus 5.5 Mixedvs GPT-6 Astra Levelvs 3.8 Flash AheadGoogle pitches it as the lead that plans and reviews while Gemini 3.8 Flash helpers do the work. In one practitioner’s test, GPT-6 Astra scored its implementation plan 59 against Opus 5.5’s 77. On LiveBench’s agentic suite it scores 69.9 against Opus’s 85.0. But running a simulated business for a year (Andon Labs’ Vending-Bench), it finished above Opus and just under Astra.
Systems design and architecturesystem boundaries, agent instructions, tool contractsEvidence: none
vs Opus 5.5 No evidencevs GPT-6 Astra No evidencevs 3.8 Flash No evidenceNo benchmark measures this yet. Google points High at architecture design; one practitioner found it misread an architecture and “assumed things”.
Brainstorming and ideasstrategy, concepts, thinking a problem throughEvidence: thin
vs Opus 5.5 Levelvs GPT-6 Astra Aheadvs 3.8 Flash AheadLevel with Opus 5.5 on LMArena’s creative-writing votes (1516 against 1517) and well above Astra (1450). Practitioners call its story structure and suggestions unusually strong.
Synthesis and knowledge workreports and decisions from documentsEvidence: strong
vs Opus 5.5 Mixedvs GPT-6 Astra Aheadvs 3.8 Flash AheadFirst on Vals’ index (68.9 against Opus 67.0) and Mercor’s APEX-Agents (82.4% against 73.5%). But when deliverables are judged head to head, Opus wins clearly: AA-Briefcase 1487 against 1805, GDPval-AA 1624 against 1866. It ticks the rubric; Opus’s work is judged better. In my own write-up jobs it worked through up to 488,000 tokens in one go.
Researchtechnical and practitioner researchEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash AheadLiveBench’s research suite: 83.1 against Opus 85.0 and Astra 85.2. It makes far fewer confident errors (a 15% hallucination rate against Opus’s 59% on Artificial Analysis’s test) but answers fewer questions right (50% against 66%): it abstains rather than guess.
Building tools, long codingtool servers, scripts, appsEvidence: strong
vs Opus 5.5 Behindvs GPT-6 Astra Mixedvs 3.8 Flash AheadFirst on DeepSWE’s multi-file engineering tasks (78.8%). Behind on code quality and big builds: twelfth on Cognition’s FrontierCode, FrontierSWE 55 against Opus 62 and Astra 66, whole programs 2.5% against 18.5%. In my head-to-head it fixed five faults in one of my tool servers, with tests, in both harnesses.
Fixing and diagnosisterminal work, debuggingEvidence: strong
vs Opus 5.5 Mixedvs GPT-6 Astra Levelvs 3.8 Flash AheadTerminal-Bench 4.0 across three separate runs: about 57 against Opus’s 59.6 to 66.4. Well ahead at finding and patching crashes (CyberBench 77.9 against Opus 55.4). On my planted-fault repair it passed all ten hidden checks with the smallest fix of six runs.
Reviewing code and planssecond opinions, finding defectsEvidence: moderate
vs Opus 5.5 Behindvs GPT-6 Astra Behindvs 3.8 Flash No evidencePractitioners rate its read of a plan on a par with Opus’s, catching things Opus misses. But its code reviews invented requirements with full confidence. In 17 of one team’s 38 runs it opened and closed its own code-review step 30 milliseconds apart. And on explaining a codebase it scores 56.5 against about 66 for Opus.
Frontend and visual designtaste, layout, art directionEvidence: strong
vs Opus 5.5 Behindvs GPT-6 Astra Behindvs 3.8 Flash LevelOn the public evidence, the clearest gap: LMArena WebDev ninth, 133 points under Opus 5.5; LiveBench design 73.7 against Opus 86.9, barely above 3.8 Flash; practitioners found cluttered, dark pages.
Not yet tested on even terms in my own work
Building a frontend from a designimplementing an approved designEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash AheadBuilds apps that work (Vibe Code Bench 91.9, level with Opus and Astra) and follows a given design well when steered. Fixing bugs reported as screenshots: 56 against Opus 70, ahead of Astra’s 43.
3D, games, motion graphicsthree.js, Blender, creative codingEvidence: moderate
vs Opus 5.5 Behindvs GPT-6 Astra Levelvs 3.8 Flash AheadThe most-posted kind of work. Side by side, Opus usually wins on detail and lighting while Argon takes a fifth to a quarter of the time and money: one creator’s five rounds at High went three to Opus, one to Argon and one tie. Against Astra it wins about as often as it loses.
Not yet tested on even terms in my own work
Film and creative workstory, shot prompts, judging takesEvidence: none
vs Opus 5.5 No evidencevs GPT-6 Astra No evidencevs 3.8 Flash MixedNobody had posted Seedance, Veo or Kling prompts written by it. Judging AI video takes for one of my films, it matched the frame-checked picks on 10 of 14 shots against 3.8 Flash’s 13, though several of its misses rested on camera moves it read right.
Writingprose, editing, voiceEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash AheadEvery’s Vibe Check panel calls it a frontier-class structural editor; its one-shot drafts read about two grade levels harder. LMArena creative writing is level with Opus; a blind tone benchmark ranks it 32nd of 80, and Opus won a judged short-story test.
Reading images and screensscreenshots, charts, documents, photosEvidence: moderate
vs Opus 5.5 Aheadvs GPT-6 Astra Mixedvs 3.8 Flash AheadAmong its clearest public wins. On Roboflow’s vision exam at High it beat 3.8 Flash on five of six tasks for less money in under half the time, and beat every model, Opus and Astra included, on counting, reasoning and detection. Level with Astra on chart reading and document OCR.
Watching and listeningvideo with sound, audioEvidence: thin
vs Opus 5.5 Aheadvs GPT-6 Astra Aheadvs 3.8 Flash AheadOpus and Astra can’t hear a soundtrack at all. On hour-long video it’s level with 3.8 Flash (87.0 against 87.1). No audio benchmark exists; in my own blind test on seven clips with sound it ranked above Flash on 7 of 8 jobs and never invented on-screen text.
Includes my own blind test
Computer and browser useoperating apps and screensEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash AheadFirst by a wide margin on business automation through apps’ own interfaces, on two separate boards. Ahead on LiveBench browser use (92 against 80 and 84). Weak at playing commercial games by keyboard and mouse (4.8% against Opus 14% and Astra 19%).
Long contexthuge documents and codebasesEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash MixedGoogle’s own test at a quarter to a full million tokens: 84 against Opus 67 and Astra 72. But Artificial Analysis’s long-context reasoning test at about 100,000 tokens has it behind Opus, Astra and even 3.8 Flash.
Running unattendedfinishing, honesty, safetyEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash AheadGoogle’s tests: it respects permission blocks, overreaches less than Opus and is the hardest of the three to hijack with injected instructions. Practitioners: it stops early and claims fixes it didn’t make. On a 30-mission Kerbal Space Program campaign it scored 52.5 against Opus’s 91.3.