ZeroNoise Logo zeronoise
Post
Treat verification as infrastructure: Addy Osmani's agent-manager playbook and Theo's case for "gardening" your repo
•
6 min read
• 119 docs
Two practitioner guides agree on the main point this period: agents improve when they have fast, definitive checks to run against their own work. Also covered: Simon Willison's pattern for long AI-written PR descriptions, Theo's warning about agent-built MCP auth, how Monaco structures agent work, and a counterpoint on MaxxBench.

Give agents a pass/fail check, then remove what slows it down

Addy Osmani frames running agents as managing people. His main rule: give the agent something that returns a definite pass or fail (tests, build exit codes, linters, diff scripts, screenshots) and have it show the result. Don't accept "looks done" . He notes the command that runs these checks is "the single most useful line" in CLAUDE.md . Ways to wire it into Claude Code:

  • Ask: "Run the auth tests after, and continue until they pass."
  • /goal: a separate model checks a condition after every turn.
  • Stop hook: blocks the turn from finishing until, for example, the typecheck passes.
  • /code-review: sends the diff to a fresh subagent. Scope it to correctness and tell it to ignore style, or it will always find something .

His other rules:

  • Correct twice, then write it down. Put it in CLAUDE.md or a shared skill .
  • Use hooks or deny rules only for hard requirements. Drop ALL-CAPS instructions, "think harder" and "don't be lazy" .
  • Plan, then split the work. Agree a plan first. Use /batch to split a mechanical change into 5–30 worktree tasks, each with its own PR. Check the slices don't overlap and land shared interfaces first .
  • Reset after two failed corrections. Start a fresh session with a better prompt .
  • Answer five questions before an unattended run: What does done look like? How does it verify itself? What are its boundaries? What turn or spend limits apply? Where does output go, and who approves it? Pilot on three files first .

Theo's new video ("Coding Isn't About Code Anymore") explains why this matters more for agents than for people. A 5-minute dev-server start blocks an agent "insanely deeply" and, with 5-minute cache TTLs, wastes tokens on missed cache reads. Slow CI limits how much work you can run in parallel . His examples of this upkeep:

  • He deleted about half of T3 Code's unit tests, roughly 250,000 lines. He restored 4 of 11,000 and reports no regressions the deleted tests would have caught .
  • When a bad test reappears, the contributor goes back to the agent thread and asks the agent why it added the test. The team then fixes the root cause .
  • A "thread transfer impact" check runs on every PR. It replays real Codex and Claude thread data through a simulated pipeline and flags data-transfer regressions in the PR, where a babysitting agent will see them. It takes under 45 seconds .

This adds to last period's verify-before-review material. The check is part of the repo itself, and it tells agents what to optimize for.

Long AI-written PR descriptions: write a short human intro, collapse the rest

Simon Willison treats PRs opened by Claude Code or Codex as his unit of work . To keep the agent's description readable, he opens with a short paragraph he has vetted, sometimes adds a screenshot, and puts the full agent-written text inside <details><summary>. GitHub Markdown supports this. The summary line is the model name and effort level, such as "Claude Opus 5.5 Medium" .

He also shared a prompt sequence worth copying. He asked Opus 5.5 in regular Claude chat to compare a SQLite parse_number() extension written in C and in Rust. The Rust builds were 298–321 KB against 14 KB for C, but they were faster . After he asked it to write a custom C decimal parser, the new C version ran at 16–19 ns per row, against 32–55 ns for the Rust versions. He then had it package the work as a report in simonw/research .

Don't trust agents on MCP auth

Theo says that every time he has Opus set up an MCP authentication path, it "makes horrible assumptions" and the result doesn't work . Asked about remote machines, it proposed curling a script, copying codes by hand on mobile and notifying the agent manually . He is writing an "MCP the right way" guide for his agents. Their first draft rendered the MCP URL as a clickable link, and he warns not to trust anything agents say about MCP or connection strategies . If you build MCP auth with an agent, test the remote case yourself.

On usage, Theo ran 8–25 Opus 5.5 threads most of the day and used less than 20% of a $200 Claude plan . His Codex plans get the heavy use because he reviews with Sol, often while Opus reviews the same code in parallel . He also banned a user whose bot left more than 1,000 "review" comments on a T3 Code PR .

Mihail Eric: research the code first, and understand your harness

On Latent Space, the Stanford CS146S instructor argues that large codebases need more than a single prompt:

  1. research the code
  2. propose alternatives for a human to choose between
  3. write a plan/spec
  4. implement and test

He teaches the harness itself. Students build an agent loop of about 200 lines, then proxy Claude Code's traffic to read its system, plan and compaction prompts . swyx says context for subagents is still "very hacky": they over-fit to stray comments when given too much .

At Monaco, Monocoder (built on Coder) provides isolated environments for long-horizon multi-agent work, and a Slack agent named HAL debugs issues and opens PRs . Their rule is "buy to learn, build to keep." They still use Devin for code review .

Claude Duet: how to start new Claude Code sessions

Riley Brown found that asking Duet to create a Claude Code session doesn't work. Use New Session on your phone, pick the computer and folder, and type the first prompt . Requests to existing sessions need approval and Face ID . He runs Amphetamine so his Mac never sleeps . He rates Claude Code's computer use well below Codex's .

A counterpoint on MaxxBench

Last period's MaxxBench result showed large score drops on modified DeepSWE tasks. Salvatore Sanfilippo (in Italian) argues those drops overstate how much weaker the models are. Some modified specs leave out details the hidden tests check. Models sometimes target the tests they expect rather than the written spec. Smaller models are less able to override what they learned earlier . He proposes about 100 genuinely new tasks of the same difficulty, run on the same harness .

Quick notes

  • DeepSeek V4.1 Flash 1017 Ultrafast is on Vercel AI Gateway. Vercel says it generates over 1,000 tokens per second; the model ID is deepseek/deepseek-v4.1-flash-1017-ultrafast .
  • TensorFold recipes are in Omarchy's local-AI catalogue (omarchy-local-ai) for Qwen3.8-27B, Flash Next and Nemotron 3.5 Bolt . DHH says TensorFold will be key to Omarchy's out-of-the-box local agents on NVIDIA .
  • Asahi Linux published an LLM policy that "broadly forbid[s]" generative AI . DHH says Asahi rejects upstreaming his group's agent-accelerated Apple Silicon work . Armin Ronacher defends Asahi's right to the policy .
  • Open question: ThePrimeagen says tasks that took Claude 5.5 10 minutes take 40 as a project grows, and asked for ways to prevent it .
Treat verification as infrastructure: Addy Osmani's agent-manager playbook and Theo's case for "gardening" your repo
Summary
Coverage start
1 day ago
Coverage end
9 hours ago
Frequency
Daily
Published
8 hours ago
Reading time
6 min
Research time
4 hrs 28 min
Documents scanned
119
Documents used
21
Citations
42
Sources monitored
106 / 111
Insights
Skipped contexts
Source details
Source Docs Insights Status
LangChain Blog 0 0
Brent Traut 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Aman Karmani 0 0
Jacob Jackson 0 0
Cursor Blog | RSS Feed 0 0
Nicholas Moy 0 0
Mike Krieger 0 0
Sualeh Asif 0 0
Michael Truell 0 0
Google Antigravity 2 1
Aman Sanger 0 0
cat 0 0
Mark Chen 0 0
Greg Brockman 1 0
Tongzhou Wang 0 0
fouad 0 0
Calvin French-Owen 0 0
Hanson Wang 0 0
Ed Bayes 0 0
Alexander Embiricos 0 0
Tibo 0 0
Romain Huet 0 0
DHH 14 3
Jane Street Blog 0 0
Miguel Grinberg's Blog: AI 0 0
xxchan's Blog 0 0
<antirez> 0 0
Brendan Long 0 0
The Pragmatic Engineer 0 0
David Heinemeier Hansson 0 0
Armin Ronacher ⇌ 4 0
Mitchell Hashimoto 0 0
Armin Ronacher's Thoughts and Writings 0 0
Peter Steinberger 0 0
Theo - t3.gg 35 11
Sourcegraph 0 0
Anthropic 0 0
Cursor 0 0
LangChain 0 0
Anthropic 0 0
LangChain 0 0
Cursor 0 0
Riley Brown 1 1
Riley Brown 8 2
Jason Zhou 3 1
Boris Cherny 0 0
Mckay Wrigley 0 0
geoff 8 0
Peter Steinberger 🦞 0 0
AI Jason 0 0
Alex Albert 0 0
Latent.Space 0 0
Logan Kilpatrick 1 0
Fireship 0 0
Fireship 0 0
Kent C. Dodds 🐨 2 0
Practical AI 0 0
Practical AI Clips 0 0
Stories by Steve Yegge on Medium 0 0
Kent C. Dodds Blog 0 0
ThePrimeTime 1 1
Theo - t3․gg 1 1
ThePrimeagen 14 3
Ben Tossell 0 0
swyx 🔜 aie.codes 14 2
AI For Developers 0 0
Geoffrey Huntley 0 0
Addy Osmani 2 1
Andrej Karpathy 0 0
Simon Willison 2 1
Matthew Berman 0 0
Changelog 0 0
Simon Willison’s Newsletter 0 0
Agentic Coding Newsletter 0 0
Latent Space 1 1
Simon Willison's Weblog 3 3
Elevate 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Sualeh Asif 0 0
Mike Krieger 0 0
Michael Truell 0 0
Cat Wu 0 0
Kevin Hou 0 0
Aman Sanger 0 0
Nicholas Moy 0 0
Andrey Mishchenko 0 0
Jerry Tworek 0 0
Romain Huet 0 0
Thibault Sottiaux 0 0
Alexander Embiricos 0 0
xxchan 0 0
Salvatore Sanfilippo 1 1
Armin Ronacher 0 0
David Heinemeier Hansson (DHH) 0 0
Alex Albert 0 0
Logan Kilpatrick 0 0
Shawn "swyx" Wang 0 0
Jason Zhou 0 0
Riley Brown 1 1
McKay Wrigley 0 0
Boris Cherny 0 0
Ben Tossell 0 0
Geoffrey Huntley 0 0
Peter Steinberger 0 0
Addy Osmani 0 0
Simon Willison 0 0
Andrej Karpathy 0 0
Harrison Chase 0 0