ZeroNoise Logo zeronoise
Post
Verification loops over line review: Osmani's "define done" and Sanfilippo's bit-identical emulator port
•
5 min read
• 91 docs
Practitioners argue that agent output quality comes from checks the agent can run itself. Also covered: GPT-6.1 Sol's default context in Codex rises to 500k, T3 Code nightly adds /goal, and Theo's case for judging models by cost per completed task.

Quality comes from checks the agent can run

Addy Osmani made the clearest argument this period. He says agents write better code "at scale" because they make checking cheap. Tests, benchmarks, specs and real end-to-end runs used to be what made good code expensive, and now you can ask an agent for them. So the job shifts from "review every line" to "build loops the agent can run itself" . He also says to make taste compound: when the agent gets something wrong, write the fix into shared config, a hook or a test so it doesn't happen twice. You still own what ships, but you review evidence as well as diffs .

He was responding to a complaint that asking Claude to review code is a slot machine that finds new bugs every time. His fix for that has three steps :

  1. Define "done" before review starts. Without that, a reviewer (human or agent) can always find something to improve.
  2. Give Claude checks it can run, such as bash commands, tests or clicking through the app in a browser, and require them to pass before it says it's finished.
  3. When nothing blocks, merge and ship.

Salvatore Sanfilippo (antirez) shows the same idea on hardware, in a video where Opus 5.5 reworks his RP2040 ZX Spectrum emulator and adds a Commodore 64 emulator. The video is in Italian. Several steps are worth copying:

  • Make a separate scratch copy first. Before porting his C64 emulator into the device project, he had the agent make a gitignored, uncommitted copy inside the repo. It converted that copy to instruction-at-a-time execution on its own and reported back before any integration. He warned it would get tangled if it converted and ported at the same time .
  • Use the old implementation as the oracle. The agent ran the old cycle-accurate emulator and the new one side by side, requiring matching images and registers. After 10,000 frames the output was still bit-identical .
  • Measure, then redesign. The faithful port ran at about 10% of real speed. The bottleneck was the VIC video chip . He told the agent to capture register writes and render frames from them instead of emulating the chip cycle by cycle . The result runs Spectrum and C64 in one device at 400 MHz, including timing-heavy C64 demos at 50 FPS with sound .
  • Give the agent instrumentation and inputs. It simulated key presses itself . He says its first port worked on the device first try , and its instrumentation checked for delays, dropped frames and audio problems . His C64 emulator also exposes a direct API for stepping, debugging and grabbing frames, which he prefers to an MCP layer he sees as adding friction .

Separately, MaciekCodes reports that his own coding agent, "a 'while loop' and a few tools," improved itself quickly .

GPT-6.1 Sol: bigger default context in Codex, and plan math

Tibo (OpenAI) says GPT-6.1 Sol's default context in Codex & Work went from 272k to 500k, about 80% more. The aim is fewer compactions and better handling of long, nuance-heavy tasks. You can set it higher or lower, up to Sol's 1M maximum . Subscription usage of Sol carries no long-context fees .

Theo thinks the default speed was raised too much and is now barely slower than "fast" . He estimates he could use Sol Ultrafast as his main model on the $500 plan and only just hit his limits . That figure is his total usage (583/week), and it leaves out his long-running ts-rust work . He also built a dashboard that tracks Claude usage across his accounts to roughly predict how long his limits will last .

Theo: judge models by cost per completed task

In a new video, Theo argues that per-token price is the wrong measure for agentic work. Token-hungry models can wipe out a low sticker price. For agentic dev work he says caching, reliability and token efficiency matter much more . He says bills are rising because agents now run longer and finish bigger tasks . He favors GLM 5.3 Flash for real-world agentic work, citing its vision, tool calls and long-running work .

The sponsored segment of the video (Railway) still describes a usable pattern. On his Lakebed project, agents set up production, staging and per-PR environments for him. Claude or Codex connects through Railway's MCP, spins up an environment, verifies a change, ships by merging to main, then checks on the environment afterward .

For local compute limits, he moved ts-rust's build and test commands onto Blacksmith runners. Each thread still takes a while, but he is far less bottlenecked when running many in parallel .

T3 Code nightly

Theo added a proper /goal flow with a visual callout to the T3 Code nightly . A user showed off the new inline rendering in chat by asking the agent whether a monitor mount would clamp onto their desk . Theo says he hadn't expected the feature to be so useful . For hazy features he still uses Matt's "grilling" skill, noting that modern models are good at asking questions .

Smaller notes

  • Riley Brown shared a grokbot-webhook skill. Claude Code hands X/Twitter research to GrokBot, waits for the answer, then continues with the task . He says it works with any agent, including Codex .
  • Kent C. Dodds shared the Kody v2026.10.11 release (release notes). Cron jobs, webhooks, subscriptions and inbound email now run with the permissions of whoever enabled them, checked live on every run, with no fallback to the org Owner . His caption: "This is what 122 PRs in one day looks like" .
  • Armin Ronacher says no single agent runtime wins. VMs, sandboxes, durable objects or a plain JavaScript interpreter each fit different situations .
Verification loops over line review: Osmani's "define done" and Sanfilippo's bit-identical emulator port
Summary
Coverage start
1 day ago
Coverage end
17 hours ago
Frequency
Daily
Published
16 hours ago
Reading time
5 min
Research time
1 hr 41 min
Documents scanned
91
Documents used
21
Citations
34
Sources monitored
111 / 111
Insights
Skipped contexts
Source details
Source Docs Insights Status
LangChain Blog 0 0
Brent Traut 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Aman Karmani 0 0
Jacob Jackson 0 0
Cursor Blog | RSS Feed 0 0
Nicholas Moy 1 0
Mike Krieger 0 0
Sualeh Asif 0 0
Michael Truell 0 0
Google Antigravity 0 0
Aman Sanger 0 0
cat 0 0
Mark Chen 0 0
Greg Brockman 0 0
Tongzhou Wang 0 0
fouad 0 0
Calvin French-Owen 0 0
Hanson Wang 0 0
Ed Bayes 0 0
Alexander Embiricos 0 0
Tibo 4 2
Romain Huet 0 0
DHH 8 0
Jane Street Blog 0 0
Miguel Grinberg's Blog: AI 0 0
xxchan's Blog 0 0
<antirez> 0 0
Brendan Long 0 0
The Pragmatic Engineer 0 0
David Heinemeier Hansson 0 0
Armin Ronacher ⇌ 4 2
Mitchell Hashimoto 0 0
Armin Ronacher's Thoughts and Writings 0 0
Peter Steinberger 0 0
Theo - t3.gg 38 13
Sourcegraph 0 0
Anthropic 0 0
Cursor 0 0
LangChain 0 0
Anthropic 0 0
LangChain 0 0
Cursor 0 0
Riley Brown 0 0
Riley Brown 15 4
Jason Zhou 0 0
Boris Cherny 0 0
Mckay Wrigley 0 0
geoff 7 1
Peter Steinberger 🦞 0 0
AI Jason 0 0
Alex Albert 0 0
Latent.Space 0 0
Logan Kilpatrick 1 0
Fireship 0 0
Fireship 0 0
Kent C. Dodds 🐨 2 1
Practical AI 0 0
Practical AI Clips 0 0
Stories by Steve Yegge on Medium 0 0
Kent C. Dodds Blog 0 0
ThePrimeTime 1 1
Theo - t3․gg 1 1
ThePrimeagen 0 0
Ben Tossell 0 0
swyx 🗽 @aiDotEngineer NYC 2 0
AI For Developers 0 0
Geoffrey Huntley 0 0
Addy Osmani 4 2
Andrej Karpathy 2 1
Simon Willison 0 0
Matthew Berman 0 0
Changelog 0 0
Simon Willison’s Newsletter 0 0
Agentic Coding Newsletter 0 0
Latent Space 0 0
Simon Willison's Weblog 0 0
Elevate 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Sualeh Asif 0 0
Mike Krieger 0 0
Michael Truell 0 0
Cat Wu 0 0
Kevin Hou 0 0
Aman Sanger 0 0
Nicholas Moy 0 0
Andrey Mishchenko 0 0
Jerry Tworek 0 0
Romain Huet 0 0
Thibault Sottiaux 0 0
Alexander Embiricos 0 0
xxchan 0 0
Salvatore Sanfilippo 1 1
Armin Ronacher 0 0
David Heinemeier Hansson (DHH) 0 0
Alex Albert 0 0
Logan Kilpatrick 0 0
Shawn "swyx" Wang 0 0
Jason Zhou 0 0
Riley Brown 0 0
McKay Wrigley 0 0
Boris Cherny 0 0
Ben Tossell 0 0
Geoffrey Huntley 0 0
Peter Steinberger 0 0
Addy Osmani 0 0
Simon Willison 0 0
Andrej Karpathy 0 0
Harrison Chase 0 0