Cameron Tang
The server room on the top floor of my studio building, lit warm, its racks glowing
Level 3 · The server room

Field report 01 · 16 October 2026

Gemini 4 ArgonGoogle DeepMind · generally available 13 October 2026

A real frontier contender. Not the new leader.

It beats Claude Opus 5.5 and GPT-6 Astra on business automation and on reading what it sees, and it tops two boards of graded professional work. It trails Opus on code quality, whole programs, long unattended runs and design. And after two days of putting it to real work in my own studio, the biggest thing I learned is that the setup you run it in matters as much as the model.

Where it leads
+8.8pts
over the better of Opus 5.5 and GPT-6 Astra on Zapier’s business-automation board (51.29 against 42.47). First on Vals’ and Mercor’s graded professional work too.
Where it trails
2.5%
of whole programs fully built on Vals’ ProgramBench, against 18.5% for Opus 5.5. Behind on code quality and design as well.
What it costs
$2 / $10
per million tokens in and out until 30 November. From 1 December, $4 / $20: exactly Opus 5.5’s price.
In my own work
21
real jobs, each graded by Claude Opus 5.5 against what Argon actually ran, plus four first-day tests.
The evidence ↓

02 · The shape of the evidence

It leads on automation and on what it sees. It trails on code quality, long runs and design.

Every benchmark that scored Argon beside Opus 5.5 or GPT-6 Astra: 93 of them, from Google’s own launch table, independent leaderboards and other model makers. Each dot is one benchmark, placed by how far Argon finished above or below the better of the two.

35ahead of both Opus 5.5 and GPT-6 Astra
23between them, or level
35behind both

How the scale works. Most boards score out of 100, so a dot sits at the plain difference in points. Boards rated by votes or judging panels (Elo) are turned into the share of head-to-head wins the gap predicts: 133 points behind is about 32% of wins, shown as −18. Vending-Bench, a simulated year’s bank balance, is a percentage difference, and Gray Swan’s attack success rate is flipped, since lower is better there. 16 dots come from Google’s own launch material; where it repeats a third party’s number, it’s shown once. Each board ran its own setup and effort levels, so a dot is that board’s result, not a like-for-like test.

All 106 results as a table ↓

03 · What people made with it

In its first days, people built games, 3D worlds and animations with it. Opus usually still won on the detail.

I collected 354 posts and videos from the first day and a half of general release: 192 on X, 110 moments in 35 YouTube videos, 21 on Reddit, 16 on Hacker News, 10 on GitHub and 5 on blogs. Here are nine to start with, losses to Opus among them. Each one plays here through the platform it was posted on.

3D scene
Rated strong

Three.js stylised village, code only, no assets

LexnLin on X · 13 Oct

A procedurally built alpine village (timber houses, river, bridges, pines, snow peaks) in three.js with no external assets, rendered in four visual styles. The poster says every style was decent where other models fell short on some.

Watching video
Rated strong

Watched 20 s of Subway Surfers, rebuilt the game in 4 min

asmirkn on X · 13 Oct

Gave Argon a 20-second gameplay clip and asked it to rebuild the game; 4 minutes later a playable three.js version came back.

3D scene
Rated decent

Space train scene: 4 min vs 1 h 53 min

EnvolDev on X · 13 Oct

Same prompt: Argon 4 min 20 s and $3.40; Opus 5.5 1 h 53 min and $23.46. Poster: Opus still ahead on volumetric clouds, locomotive mechanics and camera work.

vs Opus 5.5: Argon worse
3D scene
Rated decent

Torii island: Argon vs Opus, same prompt

Mr_Salio on X · 13 Oct

Poster: quality about the same, Opus ‘a little bit better’.

vs Opus 5.5: Argon worse
Animation
Rated strong

Cinematic 3D explainer of an electric motor: Argon vs Opus

rubenssoto_ai on X · 13 Oct

Same task for both: a cinematic 3D animation explaining a Tesla-style motor. Argon $3.83, Opus 5.5 $16.36.

vs Opus 5.5: similar
Reading imagesHigh
Rated strong

Floor plan image to a walk-through 3D house, rooms placed correctly

Skill Leap AI on YouTube · 13 Oct

A walk-through house with a live minimap of the presenter’s position; kitchen, dining, main bedroom and bathroom where the plan puts them; prompt-only extras included; a night mode.

3D scene
Rated decent

3D Lamborghini: Argon (opencode) vs Opus (Claude Code) vs Astra (Codex)

akartit on X · 13 Oct

Picks Argon for car design (2,526 lines). Harness tip: in opencode set OPENCODE_EXPERIMENTAL_OUTPUT_TOKEN_MAX=65536, because Argon writes big files in one go and the default 32K cap silently drops the write.

vs Opus 5.5: Argon bettervs GPT-6 Astra: Argon better
3D scene
Rated strong

Procedural 3D battle helicopter from an Argon and Nano Banana loop

thtbee_ on X · 13 Oct

A futuristic battle helicopter made purely in three.js, procedurally, from a multi-round self-iteration loop between Argon and Nano Banana; workflow to follow.

3D scene
Rated weak

Ship in a bottle: $0.19 vs $12.06

vib3coded on X · 13 Oct

Opus built a whole little world (dolphins, gulls, lighthouse, rocking bottle, interactions); Argon simpler for 64x less.

vs Opus 5.5: Argon worse

Ratings are my research’s reading of the work shown, not the poster’s claim. The thinking level is the poster’s, where they gave one; most didn’t.

Browse all 353 ↓

04 · In my own work

Benchmarks are someone else’s setup. So I put it to work in mine.

From the day after release I handed Argon real jobs across my studio, and had Claude Opus 5.5 grade each one against what Argon actually ran, not its own account of it. Two things came back: where it’s genuinely useful to me already, and how much the setup it works in decides the result.

The way I look at it, a model is only as good as the workshop it’s working in: the instructions it’s given, the tools and skills it can reach, and how much of the job it can hold in its head at once. My Claude setup has a lot of that work in it.

On day one, Argon got Google’s own app, Antigravity, which condenses a conversation’s memory once it reaches about 128,000 tokens. So on day two I moved it into a different agent app, DeepSeek Harness, running Argon on Google’s Vertex AI, where its million-token window only condenses at about 839,000, and set it up much closer to how Claude works for me: my core instructions, memory, skills, tools and computer use. It still isn’t level with my Claude setup.

My rule for comparing models

A comparison only counts when every model worked in an equally good setup. Otherwise you’re measuring the workshop, not the model.

So any result from an uneven setup is marked unestablished until I run it again on even terms. Real work on even terms is the strongest evidence there is; benchmarks and other people’s tests don’t decide it.

Day one · Google’s Antigravity app

Condensed at about 128,000 tokens

01,048,576 tokens
  • A tidy summary replaces the conversation, and the raw figures go with it.
  • Far less of my own setup around it than Claude has.

Day two · DeepSeek Harness on Vertex AI

Condenses only at about 839,000

01,048,576 tokens
  • Long jobs finish in one unbroken turn.
  • My instructions, memory, skills and tools around it, much closer to Claude’s.

Same model, same job, two harnesses

The head-to-head

To check it wasn’t just a feeling, I gave Argon the same job twice on 15 October, once in each harness, with the same brief, the same starting code and nobody steering: fix five faults in one of my tool servers, with tests. A fresh Claude Opus 5.5 graded both blind, with the harness names hidden.

Both passed all nine hidden checks. The grader called DeepSeek Harness’s fix the better by a modest margin: stronger tests, nothing test-only left in the live code, and 2 unsupported claims against 4. It went live in my system that morning, after Claude repaired one edge case.

What it can’t show: one job, run once in each harness. And the cost runs the other way only because DeepSeek Harness had no caching that morning; it’s been fixed since.

DeepSeek HarnessAntigravity
Time to finish
12.3minutes
16.4minutes
Model replies
27
47
Tool calls
48
69
Times its memory was condensed
0
2
Hidden checks passed
9 of 9
9 of 9
Unsupported claims in its report
2
4
Cost at list price
$16no caching yet
$3cached

What condensing did

The code worked. The write-ups after each condense didn’t.

On day one, in Antigravity, Argon did three long infrastructure jobs for me. The code was fine: 171 of 171 and 38 of 38 tests passed, and all six tool servers it wired up answered. But two of its written reports, one after five rounds of condensing and one after seven, described settings, files and test results that didn’t exist. In one long report-building job the app condensed eleven times in under an hour, and every invented figure in it was written within one to four minutes after a condense, without going back to the source.

In DeepSeek Harness, sixteen write-up batches each ran as one unbroken turn of 9 to 46 minutes, up to 488,000 tokens, and never condensed once. Taking the condensing away took away that run of invented figures. Smaller slips remained, like a tool name built from two, a detail joined to the wrong entry, or a card that dropped a qualifier. Which is why every batch still gets an Opus grade.

One long job in Antigravity · the hour it ran

0 min60 min

11condenses in 55 minutes, each one a summary in place of the conversation

The longest write-up batch · DeepSeek Harness

0 min60 min

0condenses in 46 minutes and 91 tool calls

The biggest · DeepSeek Harness

01,048,576 tokens

0condenses as its memory grew from 63,000 to 488,000 tokens in one turn. Graded good as delivered.

The graded jobs

21 real jobs, each graded by Claude Opus 5.5

Each was graded against Argon’s own tool calls and output, never its summary. Two came back good as delivered, eight close to good and eleven usable once fixed. None was unusable. Most are write-ups of dated entries in a long private record, from evidence files and transcripts; the rest are the infrastructure jobs and the head-to-head above.

Infrastructure jobUsable with fixesAntigravity · day one
Infrastructure jobUsable, low endAntigravity · day one
Infrastructure jobUsable with fixesAntigravity · day one
Head-to-headUsable with fixesAntigravity
Head-to-headUsable with fixesDeepSeek Harness · the winner
Write-up batchUsable with fixes24 entries · 91 calls · 46 min
Write-up batchUsable with fixes1 entry · 39 calls · 9 min
Write-up batchGood as delivered1 entry · 40 calls · 9 min
Write-up batchClose to good1 entry · 35 calls · 10 min
Write-up batchClose to good1 entry · 33 calls · 9 min
Write-up batchClose to good2 entries · 39 calls · 11 min
Write-up batchClose to good1 entry · 43 calls · 9 min
Write-up batchClose to good2 entries · 43 calls · 9 min
Write-up batchUsable with fixes1 entry · 44 calls · 10 min
Write-up batchClose to good4 entries · 43 calls · 11 min
Write-up batchUsable with fixes8 entries · 41 calls · 16 min
Write-up batchUsable with fixes3 entries · 71 calls · 18 min
Write-up batchClose to good5 entries · 53 calls · 16 min
Write-up batchGood as delivered6 entries · 44 calls · 13 min
Write-up batchUsable with fixes5 entries · 65 calls · 20 min
Write-up batchClose to good10 entries · 50 calls · 11 min

The first-day tests

Four tests, before any of that

Fixing planted faults in a small job service

10/10

hidden checks passed, and passed again on two reruns. It took 6.4 minutes and cost about $0.85. Its fix was the smallest of six runs on the same test; five GPT-6 Astra and GPT-6.1 Sol runs ten days earlier passed them too.

Shows: clean, scoped repair. Can’t show: how it compares; the others ran in their own harness, and Argon ran it once.

Watching and listening to clips from my films

7 of 8

jobs where Argon ranked above Gemini 3.8 Flash, graded blind across 24 calls on seven clips. All four times a model invented on-screen text, it was Flash. Only Argon at High heard one four-second sound the way I did: a struck wooden knock. It also caught a headless mannequin growing a small human hand two and a half minutes into one of my films.

Shows: both ran through the same tool with the same prompts, so this one is on even terms. Can’t show: more than seven clips, one run each.

Judging AI video takes for a miniature film

10 of 14

shots where its pick matched the frame-checked pick (3.8 Flash: 13). But several of its misses rested on camera moves it read right and Flash didn’t, and its trim points landed on the frame. At High it twice spent its whole 32,768-token allowance thinking and answered nothing.

Shows: Medium did as well as High here, at half the cost. Can’t show: the prompts were close, not identical, and the frame-checked picks are a judgement call, not ground truth.

Building a 3D industrial scene in Blender from a brief

Unestablished

28 minutes, about $7.58 at list price, against 51 minutes, $19.67 for Opus 5.5 and 56 minutes, $15.48 for Sonnet 5.5 on the same job earlier. Judging the three blind, I found its main close-up the flattest, more cartoon than real. But it ran in Antigravity, whose condensing lost parts of the brief.

Shows: its speed and cost. Can’t show: whether its 3D holds up, until I run it again on even terms.

05 · Running it

On the boards, High bought about a point at most. And it needs room to think.

Argon has three thinking levels: low, medium (the default) and high, and nothing above high. Google publishes no results by level, but three independent boards ran more than one. In each chart the gold line joins Argon’s levels.

FrontierCode

Code quality: Medium beat High

47.55 at Medium against 45.87 at High, for $6.74 a task against $11.11.

Cognition’s FrontierCode 1.1, five trials per setting. Argon ran in Cognition’s own harness, Opus in Claude Code, Astra in Codex.

AutomationBench

Automation: High bought 1.2 points

51.29 at High against 50.08 at Medium, for $1.70 a task against $1.54.

Zapier’s AutomationBench 1.0.6, at standard list prices.

SenseBench

Word sense: Low came within 0.1 of High

95.02% at Low against 95.12% at High, for a $7.09 run against $37.42: over five times the cost.

SenseBench, 4,861 items. Submitted on 13 October, not yet accepted. Argon at Low used no thinking tokens at all.

One YouTube tester’s hard-logic runs went the other way: Medium failed six of six, High passed sixteen of sixteen. And in my own listening test High was the one that heard the knock. So test your own job at both.

The empty-answer trap

32,768 tokens of thinking. No answer.

Argon’s thinking comes out of the same allowance as its answer. Judging four takes of one shot at High, with my tool’s output cap at 32,768 tokens, it spent the whole allowance thinking and returned nothing, twice. Medium never failed, at half the cost and in well under half the time.

Google’s advice is to never set the cap below 32,768. At High, give it the full allowance, 65,536 when streaming.

High, the two failed attempts32,768 thinking · 0 answer
Empty
High, average answered call4,810 tokens out
Medium, average call1,405 tokens out

Thinking hatched, answer in gold, on the 32,768-token cap. Averages over that test’s 17 comparisons.

What it costs

Half Opus’s price until December. Then the same.

On Vertex AI and the Gemini API, Argon costs $2 / $10 per million input and output tokens until 30 November, with cached input at $0.10. From 1 December it’s $4 / $20, the same as Claude Opus 5.5. Its US and EU endpoints cost 10% more, and on Vertex the launch price is paid as 50% credits back on net spend.

Cheap tokens aren’t cheap tasks, though. Cursor measured Argon taking 115 steps where Opus took 54 for the same score.

Per million tokens: input filled, output outlined.

Gemini 3.8 Flashuntil 31 December
$0.75 / $3.75
Gemini 4 Argonuntil 30 November
$2 / $10
Gemini 4 Argonfrom 1 December
$4 / $20
Claude Opus 5.5standard
$4 / $20
GPT-6 Astrastandard
$10 / $50

How I brief it

What works, from Google’s guide and my own jobs

Google’s developer guide and my two days of jobs agree on more than they differ.

  1. Start at Medium, then test High on your hardest job.Google’s default, and its own advice: pick the lowest level that meets your quality bar. High paid off for me on fine listening, not on judging takes.
  2. Give it room to think.Never cap output below 32,768 tokens. At High, its thinking can use all of that and leave nothing for the answer.
  3. Give it a way to verify its work.Tests, scripts, screenshots. It’s Google’s second tip, and in my jobs, the code it could test passed its checks.
  4. Keep its memory whole.Run long jobs where the conversation doesn’t condense mid-task, or have it reopen its sources before it writes a single figure.
  5. Grade what it did, not what it says it did.A second model reading its actual tool calls is how I found every slip on this page.
  6. Tell it when to just act.Google’s safety report says it stops to plan or ask more often than earlier models. On an unattended run, say up front what it may do without asking.
  7. Put the fixed material first.Static content at the start of the prompt is cached at 95% off, from 6,144 tokens on Vertex.
  8. Don’t ask it for a length.Google says it doesn’t follow length targets.

06 · By kind of work

Eighteen kinds of work, and where it stands on each.

My reading of the strongest evidence for each, public and my own, against each rival. Where the evidence is thin, it says so.

Kind of workvs Opus 5.5vs GPT-6 Astravs Gemini 3.8 FlashThe evidence
Planning and orchestrationplans, briefs, leading other agentsEvidence: thin
vs Opus 5.5 Mixedvs GPT-6 Astra Levelvs 3.8 Flash Ahead
Google pitches it as the lead that plans and reviews while Gemini 3.8 Flash helpers do the work. In one practitioner’s test, GPT-6 Astra scored its implementation plan 59 against Opus 5.5’s 77. On LiveBench’s agentic suite it scores 69.9 against Opus’s 85.0. But running a simulated business for a year (Andon Labs’ Vending-Bench), it finished above Opus and just under Astra.
Systems design and architecturesystem boundaries, agent instructions, tool contractsEvidence: none
vs Opus 5.5 No evidencevs GPT-6 Astra No evidencevs 3.8 Flash No evidence
No benchmark measures this yet. Google points High at architecture design; one practitioner found it misread an architecture and “assumed things”.
Brainstorming and ideasstrategy, concepts, thinking a problem throughEvidence: thin
vs Opus 5.5 Levelvs GPT-6 Astra Aheadvs 3.8 Flash Ahead
Level with Opus 5.5 on LMArena’s creative-writing votes (1516 against 1517) and well above Astra (1450). Practitioners call its story structure and suggestions unusually strong.
Synthesis and knowledge workreports and decisions from documentsEvidence: strong
vs Opus 5.5 Mixedvs GPT-6 Astra Aheadvs 3.8 Flash Ahead
First on Vals’ index (68.9 against Opus 67.0) and Mercor’s APEX-Agents (82.4% against 73.5%). But when deliverables are judged head to head, Opus wins clearly: AA-Briefcase 1487 against 1805, GDPval-AA 1624 against 1866. It ticks the rubric; Opus’s work is judged better. In my own write-up jobs it worked through up to 488,000 tokens in one go.
Researchtechnical and practitioner researchEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
LiveBench’s research suite: 83.1 against Opus 85.0 and Astra 85.2. It makes far fewer confident errors (a 15% hallucination rate against Opus’s 59% on Artificial Analysis’s test) but answers fewer questions right (50% against 66%): it abstains rather than guess.
Building tools, long codingtool servers, scripts, appsEvidence: strong
vs Opus 5.5 Behindvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
First on DeepSWE’s multi-file engineering tasks (78.8%). Behind on code quality and big builds: twelfth on Cognition’s FrontierCode, FrontierSWE 55 against Opus 62 and Astra 66, whole programs 2.5% against 18.5%. In my head-to-head it fixed five faults in one of my tool servers, with tests, in both harnesses.
Fixing and diagnosisterminal work, debuggingEvidence: strong
vs Opus 5.5 Mixedvs GPT-6 Astra Levelvs 3.8 Flash Ahead
Terminal-Bench 4.0 across three separate runs: about 57 against Opus’s 59.6 to 66.4. Well ahead at finding and patching crashes (CyberBench 77.9 against Opus 55.4). On my planted-fault repair it passed all ten hidden checks with the smallest fix of six runs.
Reviewing code and planssecond opinions, finding defectsEvidence: moderate
vs Opus 5.5 Behindvs GPT-6 Astra Behindvs 3.8 Flash No evidence
Practitioners rate its read of a plan on a par with Opus’s, catching things Opus misses. But its code reviews invented requirements with full confidence. In 17 of one team’s 38 runs it opened and closed its own code-review step 30 milliseconds apart. And on explaining a codebase it scores 56.5 against about 66 for Opus.
Frontend and visual designtaste, layout, art directionEvidence: strong
vs Opus 5.5 Behindvs GPT-6 Astra Behindvs 3.8 Flash Level
On the public evidence, the clearest gap: LMArena WebDev ninth, 133 points under Opus 5.5; LiveBench design 73.7 against Opus 86.9, barely above 3.8 Flash; practitioners found cluttered, dark pages.
Not yet tested on even terms in my own work
Building a frontend from a designimplementing an approved designEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
Builds apps that work (Vibe Code Bench 91.9, level with Opus and Astra) and follows a given design well when steered. Fixing bugs reported as screenshots: 56 against Opus 70, ahead of Astra’s 43.
3D, games, motion graphicsthree.js, Blender, creative codingEvidence: moderate
vs Opus 5.5 Behindvs GPT-6 Astra Levelvs 3.8 Flash Ahead
The most-posted kind of work. Side by side, Opus usually wins on detail and lighting while Argon takes a fifth to a quarter of the time and money: one creator’s five rounds at High went three to Opus, one to Argon and one tie. Against Astra it wins about as often as it loses.
Not yet tested on even terms in my own work
Film and creative workstory, shot prompts, judging takesEvidence: none
vs Opus 5.5 No evidencevs GPT-6 Astra No evidencevs 3.8 Flash Mixed
Nobody had posted Seedance, Veo or Kling prompts written by it. Judging AI video takes for one of my films, it matched the frame-checked picks on 10 of 14 shots against 3.8 Flash’s 13, though several of its misses rested on camera moves it read right.
Writingprose, editing, voiceEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
Every’s Vibe Check panel calls it a frontier-class structural editor; its one-shot drafts read about two grade levels harder. LMArena creative writing is level with Opus; a blind tone benchmark ranks it 32nd of 80, and Opus won a judged short-story test.
Reading images and screensscreenshots, charts, documents, photosEvidence: moderate
vs Opus 5.5 Aheadvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
Among its clearest public wins. On Roboflow’s vision exam at High it beat 3.8 Flash on five of six tasks for less money in under half the time, and beat every model, Opus and Astra included, on counting, reasoning and detection. Level with Astra on chart reading and document OCR.
Watching and listeningvideo with sound, audioEvidence: thin
vs Opus 5.5 Aheadvs GPT-6 Astra Aheadvs 3.8 Flash Ahead
Opus and Astra can’t hear a soundtrack at all. On hour-long video it’s level with 3.8 Flash (87.0 against 87.1). No audio benchmark exists; in my own blind test on seven clips with sound it ranked above Flash on 7 of 8 jobs and never invented on-screen text.
Includes my own blind test
Computer and browser useoperating apps and screensEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
First by a wide margin on business automation through apps’ own interfaces, on two separate boards. Ahead on LiveBench browser use (92 against 80 and 84). Weak at playing commercial games by keyboard and mouse (4.8% against Opus 14% and Astra 19%).
Long contexthuge documents and codebasesEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Mixed
Google’s own test at a quarter to a full million tokens: 84 against Opus 67 and Astra 72. But Artificial Analysis’s long-context reasoning test at about 100,000 tokens has it behind Opus, Astra and even 3.8 Flash.
Running unattendedfinishing, honesty, safetyEvidence: moderate
vs Opus 5.5 Mixedvs GPT-6 Astra Mixedvs 3.8 Flash Ahead
Google’s tests: it respects permission blocks, overreaches less than Opus and is the hardest of the three to hijack with injected instructions. Practitioners: it stops early and claims fixes it didn’t make. On a 30-mission Kerbal Space Program campaign it scored 52.5 against Opus’s 91.3.

07 · The record

Every number and every post, with its source.

All 106 benchmark results

Filter by who ran them, by area or by name. Each links to its source, with that board’s notes.

Open ↓

Loading…

All 353 posts and videos

Filter by kind of work and by how it went. Each plays on the platform it was posted to. One of the 354 collected has since been deleted, so it’s left out.

Open ↓

Loading…

What nobody knows yet

  • How well it listens. No audio benchmark exists yet, so my seven clips are the main evidence here.
  • Its visual design and 3D on even terms. My own 3D test ran in Antigravity, so it waits for a retest.
  • Whether it writes good prompts for video models. Nobody had posted Seedance, Veo or Kling prompts written by it.
  • What the boards still to rate it will say: Artificial Analysis’s 3D arena, ARC-AGI, EQ-Bench, SimpleBench, Design Arena, and the official Terminal-Bench and OSWorld boards.

How this was put together

  • The public evidence was read on 14 October, the day after general release: Google’s own posts, model card, evaluation method and safety report, every independent leaderboard that had scored it, and posts and videos from X, YouTube, Reddit, Hacker News, GitHub and blogs.
  • My first-day tests ran on 14 October, and the graded jobs on 14 and 15 October.
  • Every figure on this page is generated from that data, or checked against its source before the page is built.
  • Prices double on 1 December, and the boards keep moving: read it as a report of its week.