ZeroNoise Logo zeronoise
Post
Human Judgment Moves Upstream in the Software Factory
15 hours ago
4 min read
134 docs
Addy Osmani’s practical software-factory playbook is the day’s highest-alpha signal: event-driven queues, verification budgets, and explicit human gates. New releases extend the loop toward cheaper model execution, mobile session control, and agent interoperability.

🔥 TOP SIGNAL

Build the gate before scaling the agent. Addy Osmani says most teams can go surprisingly far with stock Claude Code or Codex, multiple sessions, good SPECs, constraints, and explicit human-involvement criteria; a factory earns its keep when work becomes repeatable and event-driven across GitHub, Slack, or Linear queues in isolated environments.

The design principle is relocation, not removal: humans still choose the problem, architecture, quality bar, trusted verification signals, and when the evidence is sufficient to ship, while deterministic checks move earlier and run continuously.

⚡ TRY THIS

  • Use a bounded issue-to-draft-PR contract. Tell the agent to read GitHub issue #123 and the repository instructions; implement only the acceptance criteria; leave authentication, billing, migrations, and existing test assertions alone; work in a branch; run npm run lint, npm test, and npm run build; stop if a required check cannot run; then open a draft PR listing checks, remaining risks, and human decisions. Do not merge.

  • Turn labels into the control plane. For incoming issues, use four states: ready-to-implement, ready-to-spec, needs-info, and wait-to-implement. Only let sessions claim work marked ready; the label becomes the queue, the lock, and a parking place for work that is not rejected permanently.

  • Budget verification like performance. Run fast checks such as linting and type checking early; reserve mutation, browser, security, and the full test suite for the draft-PR boundary so the development loop stays fast. Osmani says verification, retries, browser checks, and human review can make a task take 2–4× longer; track cost per merged PR and code shelf life, and pair each run status with per-stage timing—his sample quick-finder run took 7 minutes, while a favorites feature took 56 minutes after two rejections and a human decision.

  • Persist the context your parallel sessions create. Osmani warns that five or ten concurrent sessions create cold mental models; ask agents to save their trajectory and lessons to a local or repository file instead of leaving the reasoning in chat history. A complementary pattern from Armin Ronacher: ask the agent to make the OpenAPI spec “agent discoverable”—returning the relevant spec when it summarizes a task—and he reports the agent wired an embedding model on Cloudflare five minutes later.

📡 WHAT SHIPPED

  • Codex crossed 20M active users. Tibo reports 20M active users and announced a banked reset for every Codex and ChatGPT Work user. A separate rate-limit update says some users have had worse cache hit rates than in prior stable weeks, which may explain faster usage drain; OpenAI is investigating.

  • GPT-5.6 Sol got a temporary price cut. OpenAI says API and credit pricing will drop by more than 20% for the next three months.

  • Mobile session control is converging. Claude Code can now start a session from a phone: machines running claude remote-control appear as device cards in the Code tab, where the user taps a machine and chooses a directory. Antigravity’s Remote Control exposes active sessions through supported browsers and iOS/Android, rolling out to all users beginning with Ultra subscribers. Ben Tossell had identified the absence of mobile-created Claude sessions as a reason users could move to Codex.

  • Simon Willison’s CLI stack caught up with tool-using models.llm 0.32.1 fixes fresh installs by pinning openai<3 after the OpenAI Python library dropped httpx; the coming 0.33 release will switch to httpx2. llm-openrouter 0.7 adds compatibility with LLM 0.32, OpenRouter’s Responses API, and server-side Shell, WebFetch, and WebSearch tools enabled with options such as -T WebSearch.

  • Kody Exchange launched an agent-interoperability surface. Kent C. Dodds says it replaces copy-pasting between agents by letting them connect directly, and it is free to try without an account. The positioning matches Ali Spittel’s formulation—“I want to use my agent to use your thing”—which Dodds calls a major part of Kody’s appeal.

  • LangChain Academy Tutors puts instruction inside the coding-agent loop. Its tutors use skills to teach concepts, ask questions, run quizzes, and give feedback, with customizable teaching style; the project links to the lca-tutors repository.

🎬 GO DEEPER

  • ▶️ Peter Steinberger — “No Doors for Agents”. Steinberger’s talk supplies the conceptual frame for the product shifts above: the event recap attributes to him, “The text box is AI’s radio-on-TV phase.” Read that alongside mobile session control and agent-to-agent surfaces.

  • Study Addy Osmani’s Factory reference repo, demo app, and workshop. This is the implementation path behind the queue, verification, and human-gate patterns; Osmani presents it as a reference setup rather than a claim that every team needs a factory.

  • Study llm-openrouter 0.7. The interesting bit is not another model wrapper but the small, explicit tool surface—Responses API plus shell and web primitives—that lets a CLI agent use routed models without hiding the execution boundary.

Editorial take: The coding-agent frontier is becoming a supervised operating loop—queue work, preserve context, spend a verification budget, and only then widen autonomy; cheaper models and mobile controls make that loop easier to run, not safer to skip.

Human Judgment Moves Upstream in the Software Factory
Research extraction
Berkeley RDI Center on Decentralization & AI
Peter Steinberger
Profile

Transcript unavailable. The supplied bundle contains only a single line of YouTube page footer navigation (About, Press, Terms, etc.) and no talk captions, timestamps, or descriptive transcript text. Therefore no exact timestamped excerpt about agent interfaces, coding agents, or agent infrastructure can be extracted from this source.

Peter Steinberger - No Doors for Agents
Elevate

Addy Osmani (firsthand; runs agentic workflows on production client apps with real auth/payments and on open-source projects) shares his software-factory playbook:

  • When a factory is worth it: "You can get surprisingly far with your stock coding harness" — Claude Code or Codex, multiple sessions, SPECs with verification baked in, constraints, and batches of GitHub issues with human-involvement criteria. A factory earns its keep only when work must be repeatable and event-driven (Slack/GitHub Issues/Linear queues) in isolated cloud environments with explicit human babysitting .

  • Minimal factory prompt (his example):

    Read GitHub issue #123 and the repository instructions before changing code. Implement only the stated acceptance criteria. Do not modify authentication, billing, migrations, or existing test assertions. Work in a branch and keep the diff reviewable. Run npm run lint, npm test, and npm run build. If a required check cannot run, stop and explain why. Open a draft pull request with the checks you ran, the remaining risks, and any decision a human still needs to make. Do not merge.

  • Core factory primitives: steering (human redirects mid-run), notifications (blocked because requirement ambiguous, task risky, or human input needed), and handoff (move task/state/context; good handoffs record what happened, what's left, and why the handoff is needed) . The human can shape work early, steer during implementation, or stop it shipping .

  • Triage pattern (Warp): label every incoming issue as ready-to-implement / ready-to-spec / needs-info / wait-to-implement; the label is the queue, the lock, and a place to park work without permanently saying no — sessions only pick up what's marked ready .

  • Verification philosophy: push quality checks as early and continuously as possible — type systems, automated tests, mutation testing, security scanners, linting for architecture rules; more checks ≠ quality, tune for signal-to-noise . Budget like a performance budget: fast checks (lint, type checking) early; the full suite (mutation, browser, security) closer to PR time; don't slow the dev loop .

  • Costs and metrics: individual tasks take 2–4x longer once verification, retries, browser checks, and human review are included ; useful metrics are cost per merged PR and "code shelf life" as comprehension-debt measures . In his 82-minute sample factory run, the quick finder feature took 7 minutes, while favorites took 56 minutes (2 rejections + a human decision) — same factory, so pair run taxonomy with per-stage timing .

  • Run outcomes: Vercel marks every run success / flawed / blocked / manual; only "success" ships . Flawed = wrong thing implemented or missing context; blocked = missing credential; manual = trust boundary the factory may not cross . A manual run isn't done when the factory stops, but when the human knows what to do next .

  • Pitfalls to design around: agents can game green tests by changing the test or the logic — green doesn't mean intent was followed ; his example of an agent silently dropping a wanted auth provider because the UI had room for three . Treat GitHub issues/Slack as untrusted input (supply-chain attack surface); Vercel runs agents in isolated sandboxes holding only the secrets a task needs . Parallel sessions create comprehension debt — he once pasted a dark-mode prompt into the wrong project's session ; mitigation is asking agents to persist their trajectory/lessons to a repo file and reviewing only where automated back-pressure weakens or consequences become subjective .

  • Human judgment relocates, not disappears: someone still chooses the problem, architecture, quality bar, which verification signals to trust, and when evidence is sufficient to ship — "the agent wrote it" doesn't cut it .

  • Tooling landscape: buy-vs-build — Factory, Warp, and HumanLayer are all working on commercial software factories . He published an open reference implementation at https://github.com/addyosmani/factory, plus a demo app (https://github.com/addyosmani/factory-demo/) and a step-by-step workshop (in ADVICE.md) .

Human judgment doesn't leave the software factory. It relocates.
Simon Willison's Weblog

Simon Willison shipped LLM 0.32.1, his command-line tool for accessing LLMs, on 21 August 2026 . Fresh installs had broken because the OpenAI Python library dropped its httpx dependency, which LLM only pulled in transitively; this release pins openai<3, and the pending 0.33 release will switch from httpx to httpx2. Practical takeaway: developers doing fresh installs should use 0.32.1 (or pin openai<3) until 0.33 lands . The post's recent-articles list also includes 'Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things' and 'Conceptual integrity and counting lines of code', both potentially relevant to coding-agent model choice and workflow design .

llm 0.32.1
swyx

MongoDB announced at #MongoDBlocal Build Fest an Atlas Managed MCP Server for Agents and native Atlas access inside Claude Code, ChatGPT, Codex, Grok Build, Devin AI, and Cursor, designed to let developers stay in flow and ship production AI . Also announced: Automated Embeddings in MongoDB Atlas, VoyageAI's voyage-code-4, GA'd Embedding & Reranking API, and Vector Search for Stream Processing — reducing setup and workarounds . swyx highlighted this as a huge step up from last year's Build Fest, noting SF builders rediscovering MongoDB in the AI engineering era . Official post: https://mongodb.social/6017B1isMS.

ICYMI: Everything announced at [#MongoDBlocal](https://x.com/hashtag/MongoDBlocal) Build Fest is designed to help developers stay in flow… it was a blast covering Build Fest this year - they didnt know this but I learned to code with MongoDB over 10 years ago (shoutout MERN s…
swyx

@swyx recommends setting your {codex | claude | gemini | devin} automations to autonomously research how to improve SEO/AEO every week, calling it "free, should-be-commoditizing-but-weirdly-untapped alpha" . He is continuing a "Kill My SaaS" series: another SaaS is targeted and results of "Kill My SaaS 1" are promised next week; the post links back to the SEO/AEO automation tip .

btw if you havent set your {codex | claude | gemini | devin} automations to autoresearch how to improve your seo/aeo every week you are r… i have another saas to kill (will share results of Kill My SaaS 1 next week!!) ![](https://pbs.twimg.com/media/HQReaKZWYAAXW40.jpg) ![](h…
Simon Willison's Weblog

Matt Webb used ChatGPT as a patient interactive tutor to learn quaternions — not to write code — for his app Galactic Compass 2 (after v1.0, for rotation work), and says outsourcing thinking to AI pushed him to learn more rather than stopping learning. Firsthand account .

Quoting Matt Webb
Peter Steinberger 🦞

Peter Steinberger (@steipete, Creator of OpenClaw, OpenAI) spoke at the Agentic AI Summit 2026 (Aug 1–2, UC Berkeley; ~5,000 in person, ~100,000 online) and shared his talk "No Doors for Agents": https://www.youtube.com/watch?v=W3ha2lLyLhc. Quotes below come from Dawn Song's (@dawnsongtweets) secondhand event recap; Steinberger's tweet is firsthand confirmation of his talk and his own quote.

  • Michele Catasta (Replit President & Head of AI): stop treating evaluation as the last check before shipping — think of it as an engine that helps you ship a better agent every single day .
  • Alex Graveley (co-creator of GitHub Copilot): "The bottleneck becomes your attention as an agent-using engineer… We're moving from seeing the code to seeing the entire business" .
  • Jonathan Cohen (Nvidia VP of Applied Research): "An agent isn't just an LLM — it's an LLM surrounded by what I call infrastructure... another word for that is computer science" .
  • Andrew Ng: "There will be no AI job apocalypse... we just can't find enough skilled AI engineers" .
  • Ryan Lopopolo (ex-OpenAI Dark Factory lead, now Agentic Google Cloud Platform): "We are in a capability overhang—models are far more capable than they're able to side-effect into the world today" .
  • Steinberger's own quote: "The text box is AI's radio-on-TV phase…. Every new medium starts by imitating the old one" .
I had the pleasure of speaking at the Agentic AI Summit in Berkeley alongside an incredible bunch of folks. My talk was about "No Doors f… 🚀 The future of AI is agentic — this is one message echoed across every stage at the Agentic AI Summit 2026 (Aug 1 & 2), the largest gath…
ThePrimeagen
  • Jared Palmer (Apr 2024): even 10x better reasoning won't make agents real until cost and reliability are solved — running frontier models in a loop is "comical" at current prices, requiring middleware for task-appropriate model sizing, queue/batching, and state/file/memory passing; provider error rates are "abysmal", so agent loops "effectively rolling the dice again and again" need near-100% reliability .
  • ThePrimeagen (Aug 2026) calls this "still relevant": intelligence has increased significantly but "the price is still very absurd". His contrarian take: "10x faster and 10x cheaper and dumber than 5.6 sol is a sweet spot for a literal billion people" .
  • In a reply, ThePrimeagen says he "wont even talk about reliability as Claude is competing with Github" .
Even if we get 10x better reasoning in the next wave of models, I see 2 major problems that will likely delay agents being real: cost and… bro saw around cornerns this tweet is still relevant as we have: \* not 10x'd our "intelligence" but it has increased significantly \* th… i wont even talk about reliability as Claude is competing with Github ![](https://pbs.twimg.com/media/HQQXP07X0AAg3lt.png)
Simon Willison's Weblog

Thomas Ptacek (in "Stop Making TUIs") argues developers should build real native user interfaces even for the smallest personal tools, because coding agents have reduced the cost of a usable GUI "to almost nothing" — "Go build a native UI" . Simon Willison confirms from firsthand experience: his vibe-coded SwiftUI macOS menu bar apps for bandwidth and GPU monitoring, built March 2026, are still in daily use, and he says he's "running out of excuses" not to apply this to other projects . Essay: https://sockpuppet.org/blog/2026/08/20/stop-making-tuis/

Stop Making TUIs
Ben Tossell

@bentossell (builder/investor in dev tools; not a hands-on coder) argues that Claude not supporting creation of local sessions from mobile is "gifting users to codex" — i.e., OpenAI's Codex is picking up users because of Claude Code's missing mobile workflow support . He re-emphasized the point by linking his original post to a @claudedevs post, suggesting the issue is being discussed in the Claude Devs community . This is an opinion/observation, not first-hand engineering data: the actionable takeaway is that mobile-initiated agent sessions are a competitive differentiator, and Codex currently has that edge.

claude not supporting creating local sessions from mobile must be gifting users to codex oh [https://x.com/claudedevs/status/2090933157243863142?s=46](https://x.com/claudedevs/status/2090933157243863142?s=46) [https://x.com/be…
Simon Willison's Weblog

Simon Willison released llm-openrouter 0.7, an LLM plugin for models hosted by OpenRouter . It is now compatible with LLM 0.32, which works much better with reasoning LLMs available through OpenRouter . Models now use OpenRouter's implementation of the Responses API . Three new server-side tools were added — Shell, WebFetch, and WebSearch — enabled with options like -T WebSearch. Posted 21st August 2026 .

llm-openrouter 0.7
Ben Tossell

@bentossell: Claude's lack of support for creating local sessions from mobile appears to be driving users to Codex .

claude not supporting creating local sessions from mobile must be gifting users to codex
Kent C. Dodds 🐨

Kent C. Dodds demonstrates a self-expiring Dropbox dump system he built — /Public/delete-me/{1-day,7-days,31-days} retention folders (dropbox-delete-me) — with screenshots of a Grok chat titled 'Dropbox delete-me sweep' discussing it . He calls 'doing stuff like this' 'too easy' , and frames the lesson: 'If software you use doesn't have a feature you want, you can just build it yourself' . No prompts or code are shared, just the result and chat UI.

[#KodyCodes](https://x.com/hashtag/KodyCodes) 🐨 Doing stuff like this is just too easy. ![macOS Finder in column view showing the Dropbox… If software you use doesn't have a feature you want, you can just build it yourself [#KodyCodes](https://x.com/hashtag/KodyCodes) 🐨 [http…
Kent C. Dodds 🐨

Kent C. Dodds (@kentcdodds) says agent interoperability is central to Kody (@kodykoala), the coding agent he promotes: "This is a big part of what makes [@kodykoala] so special!" in reply to Ali Spittel's (@ASpittel) post, "i really don't want to use your agent, i want to use my agent to use your thing" . The endorsed pattern — users want their own primary agent to drive third-party tools/agents rather than adopt a new agent per tool — is a firsthand product-positioning signal from a prominent practitioner, though it gives no workflow specifics.

This is a big part of what makes [@kodykoala](https://x.com/kodykoala) so special! [https://x.com/ASpittel/status/2090889137062826240](ht… i really don't want to use your agent, i want to use my agent to use your thing.
Jason Zhou

@jasonzhou1993 promoted treg_ai, an open-source tool that connects Claude/Codex to source influencers, claiming he sourced 1000+ influencers for ~$0.025 . The repo is at https://github.com/superdesigndev/treg.

Meet Claude for finding influencers Sourced 1000+ influencers for just $0.025 Just connect your Claude/Codex to [@treg_ai](https://x.com/… open-sourced here: [https://github.com/superdesigndev/treg](https://github.com/superdesigndev/treg)
Kent C. Dodds 🐨
  • Kent C. Dodds (@kentcdodds) says he'll show how he turned his products into "self-healing software" using Cursor automations .
  • Upcoming joint session with Sentry (@sentry, with @sergical): Kent will cover how he set up Cursor AI automations with Sentry to fix "all the frustrations he had with personal assistants," and built kody.codes (http://kody.codes) as a result .
  • Event: "Agentic Loops with Kent" — register at https://luma.com/agentic-loops-with-kent.
  • Timeless pattern: agentic loops combining Cursor automations with error-monitoring (Sentry) to create self-healing products; firsthand account from Kent.
Gonna show you how I turned my products into self-healing software. It's pretty slick! [https://x.com/sentry/status/2090822071823561063](… Join [@sergical](https://x.com/sergical) and [@kentcdodds](https://x.com/kentcdodds) next week to learn how Kent set up [@Cursor_ai](http…
Kent C. Dodds 🐨

Kent C. Dodds shared a Dropbox-based auto-expiring dump system: a Public/delete-me folder with 1-day, 7-days, and 31-days retention folders, described in a Grok chat named "Dropbox delete-me sweep" where the AI's response called it a "self-expiring Dropbox dump system" with the paths /Public/delete-me/{1-day,7-days,31-days} and project @kentcdodds/dropbox-delete-me. He framed doing "stuff like this" as "too easy" under his #KodyCodes AI-coding workflow . Firsthand post from a prominent developer/educator; the images show the Finder layout and the Grok conversation, so the agent's exact role in building the system (vs. annotating it) isn't stated in the text.

[#KodyCodes](https://x.com/hashtag/KodyCodes) 🐨 Doing stuff like this is just too easy. ![macOS Finder in column view showing the Dropbox…
Peter Steinberger 🦞

Reported by @mark_k and reshared by @steipete: Linus Torvalds fixed a Linux kernel GPU bug with substantial AI help. The bug caused part of Intel Xe GPU compression metadata storage to be incorrectly exposed as usable VRAM, resulting in corrupted page tables and black screens; the eventual fix was a one-liner changing round_up() to round_down(). Finding it was the hard part: 24 debugging patches and 18 kernel boots, with AI doing much of the grunt work by repeatedly adding debug code and analyzing results as Torvalds narrowed down the problem . The AI repeatedly told him the problem was "impossible and unsolvable" and suggested giving up; Torvalds kept pushing until they found the bug, then let the AI write the commit message . @steipete shared it with the caption "dropping new skill brb" .

This is a great real-world example of AI-assisted coding: Linus Torvalds just fixed a nasty Linux kernel GPU bug with substantial help fr… dropping new skill brb [![Video](https://pbs.twimg.com/tweet_video_thumb/HQSId_cbAAAC77P.jpg)](https://video.twimg.com/tweet_video/HQSId_…
geoff

Geoffrey Huntley (@GeoffreyHuntley) describes AI as 'a time compression device, a fuzzer for ideas' that enables a 'be wrong quickly, be wrong cheaply' approach to product development, and says his output over the last two years exceeds what he'd have achieved in an entire human-lifetime wall clock . He reports shifting from days of upfront deliberation on interfaces/design details to letting details 'fall out/are discovered through iteration' . His main caveat is validation: he built an almost 1:1 reimplementation of a well-known devtools product that he suspects is ready to market, but the 'load bearing responsibility to customers' is verifying it works and having a toolchain to rapidly respond to and fix defects in a codebase created in a week with 'near zero understanding' of its intricacies . He frames this as a 'software factory' and the new norm for product building, with the enabling tooling 'lacking yet somewhat already exists in the right places,' pointing to AntithesisHQ's verification work as relevant .

AI is a time compression device, a fuzzer for ideas that enables a “Be wrong quickly, be wrong cheaply” way of work/thinking about produc…
Kent C. Dodds 🐨

Kent C. Dodds announced his newest product, Kody Exchange (kody.exchange): a tool to connect your AI agent directly to someone else's agent so they can "hash it out," replacing copy-pasting between AI agents . It's marketed as safe, secure, and efficient, free to try with no account required , and is listed on Product Hunt, where Dodds asked for upvotes . Firsthand announcement from the creator (a well-known developer educator); no workflow or configuration details provided.

Introducing my newest 🐨 product: Kody Exchange! Stop copy-pasting between your AI agent and someone else's. Connect your agents directly … [http://kody.exchange](http://kody.exchange) 👈 It's on product hunt! [https://www.producthunt.com/products/kody-exchange](https://www.producthunt.com/products/kody-exchange) Please upv…