Hours of research in one daily brief–on your terms.

🔥 TOP SIGNAL

Today's clearest alpha: serious coding-agent setups are moving from one-shot generation to verification loops. Peter Steinberger's new OpenClaw self-QA workflow has an orchestrator assign a task, verify the result, and spawn a repair subagent on failure; LangChain describes the same general move as harness improvement from traces, and Andrew Yates says Dropbox has been running a "Ralph loop" Dark Factory since October while Geoffrey Huntley says companies are now spending engineer-salary-level budgets to automate software verification @steipete +3.

🛠️ TOOLS & MODELS

• OpenClaw — GPT 5.4 dev-channel upgrade. steipete says the claw harness now has GPT 5.4 upgrades; test with openclaw update --channel dev. Early user feedback moved from near-frustration to "way better" / "GOD MODE" @steipete +2
• Claude Max / Claude Code — harness gating is now concrete. In testing, adding the exact system-prompt string A personal assistant running inside OpenClaw. triggered a 400 saying third-party apps draw from extra usage, not plan limits. Simon Willison says exact-string prompt filtering is a step too far; separately, Theo says Claude Code now refuses the system-fix tasks he mainly kept his subscription for, while Codex still does the work @steipete +6
• T3Code fork — task-specific handoff. Emanuele DPT's experimental open-source feature routes UI-heavy threads to Claude and logic-heavy threads to Codex. Push to main is planned, and Theo says these increasingly elaborate forks are exactly the mindset he wants encouraged in T3Code itself @emanueledpt +1
• Salesforce's model mix — real scale, bounded claims. Marc Benioff says Salesforce's 15,000 engineers use coding models from Anthropic, OpenAI Codex, Cursor, and others, plus agents that engineers supervise. His productivity number is more than 30%, not 100%, because models are still not autonomous Matthew Berman

💡 WORKFLOWS & TRICKS

• Self-QA your harness

  1. Add a synthetic message channel to your own agent.
  2. Let an orchestrator define a concrete task.
  3. Verify the result automatically.
  4. If verification fails, spin up a subagent to analyze and fix.
  5. steipete says he built this OpenClaw loop in about six hours and found it better than old-school end-to-end tests @steipete +1

• Route by task type, not brand loyalty

  • Send UI-heavy work to Claude.
  • Send logic-heavy work to Codex.
  • Keep the handoff explicit so the thread can continue in the model that fits the task @emanueledpt

• Use AI where answers are checkable; keep architecture human-owned

  1. Use AI to crush tedious implementation work — Lalit Maganti used Claude Code to get past 400+ SQLite grammar rules and into concrete prototypes fast simonwillison
  2. Be skeptical when the task has no objectively checkable answer — Maganti says AI led him into dead ends and encouraged deferring key design decisions simonwillison
  3. If the prototype proves the idea but the architecture is muddy, throw it away and rebuild with more human-in-the-loop design decisions simonwillison

• Let traces improve the system at multiple layers

  1. Run the agent on real tasks and evaluate outcomes.
  2. Store traces.
  3. Use a coding agent to propose harness code changes from those traces.
  4. Update context separately via persistent memory — agent-level files like SOUL.md, tenant-level memory, offline "dreaming," or hot-path updates langchain

• Plan for supervised agents, not full autonomy

  • Salesforce's benchmark is the right planning assumption for now: engineers supervise coding agents, and even at 15,000-engineer scale the gain Benioff reports is more than 30%, not 100% Matthew Berman

👤 PEOPLE TO WATCH

• Peter Steinberger — shipping OpenClaw internals in public: self-QA loops, dev-channel GPT 5.4 harness changes, and concrete "make GPT better" tweaks rooted in prior Codex work @steipete +2
• Lalit Maganti — one of the best firsthand build logs in the batch: fast AI-assisted parser implementation, then a disciplined reset once architecture quality slipped. Start with syntaqlite and the full postsimonwillison
• Simon Willison — worth following because he tests vendor behavior directly. Today he highlighted the exact-string OpenClaw trigger and argued prompt-based billing filters go too far @simonw +3
• Theo + Emanuele DPT — useful signal on model routing in the wild: an open-source T3Code fork that hands UI work to Claude and logic to Codex, with Theo explicitly wanting that extension mindset inside the main tool @emanueledpt +1

🎬 WATCH & LISTEN

• 10:25-11:40 — Marc Benioff on the real ceiling of coding agents today. Best calibration clip in the pack: Salesforce says engineers across a 15,000-person org are using coding models and agents, but the human role becomes supervisory rather than disappearing. The number to keep in your head is more than 30% productivity, not autonomy Matthew Berman

📊 PROJECTS & REPOS

• syntaqlite — high-fidelity SQLite parser, formatter, and verifier. The build story is the signal: eight years of wanting, then three months with Claude Code to get it built simonwillison
• Deep Agents — LangChain's open-source, model-agnostic base harness. They say traces plus LangSmith CLI and Skills were used to improve it on terminal bench, and it supports user-scoped memory plus background consolidation langchain
• T3Code Claude/Codex handoff fork — experimental open-source feature, push to main planned. The practical signal is the routing rule itself: different models for UI vs. logic work @emanueledpt
• OpenClaw dev channel — not a new repo, but a live harness update worth testing if you use it: GPT 5.4 upgrades are available via openclaw update --channel dev@steipete

Editorial take: the edge is shifting out of raw model IQ and into the wrapper — verification loops, trace-driven harness updates, and blunt task routing between models @steipete +2.

Top Stories

Why it matters: This cycle’s biggest signals were about autonomous research, vertical expansion into biotech, the economics of agent usage, wider local-model distribution, and early labor-market measurements.

ASI-Evolve claims end-to-end autonomous AI research

Shanghai Jiao Tong University researchers released ASI-Evolve, an open-sourced system described as running the full AI research loop itself: reading papers, forming hypotheses, designing and running experiments, analyzing results, and iterating without human intervention @heynavtoor. In neural architecture search, it ran 1,773 rounds, generated 1,350 candidates, and produced 105 models that beat the best human-designed baseline; the top model exceeded DeltaNet by +0.97 points@heynavtoor. The same framework reportedly improved data curation by +3.96 average benchmark points and +18 on MMLU, and produced RL algorithms that beat GRPO by up to +12.5 on competition math @heynavtoor.

A biomedicine test also showed +6.94 points in drug-target prediction on unseen drugs @heynavtoor. One critic argued the work is not the first effort of its kind and said frontier labs still rely on data intuitions that may not be offloaded to a scaffold @teortaxesTex.

Impact: The paper presents this as a single framework improving architecture, data, and algorithms rather than optimizing only one part of the stack @heynavtoor.

Anthropic acquires Coefficient Bio for biotech workflows

Anthropic acquired Coefficient Bio for about $400M. The sub-10-person startup builds AI to plan drug R&D, manage clinical regulatory strategy, and identify new drug opportunities @kimmonismus. The team joins Anthropic’s healthcare and life sciences group, which already works with Sanofi, Novo Nordisk, AbbVie, and others @kimmonismus.

Posts around the deal frame it as execution on Dario Amodei’s "virtual biologist" idea, with Coefficient Bio covering drug discovery, clinical trials, and regulatory submissions end to end @kimmonismus.

Impact: The deal pushes Anthropic further from being only a general-model vendor and deeper into healthcare-specific workflows @kimmonismus.

Claude access rules now reflect harness economics

A notice said Claude subscriptions will no longer cover usage on third-party tools like OpenClaw, though users can still buy extra usage bundles or use a Claude API key @bcherny. A later analysis argued some harnesses send repeated low-value requests with long contexts—often over 100K tokens—making costs tens of times higher than a subscription price @_LuoFuli. Another post framed Anthropic’s position as allowing products that complement Claude Code but not direct competitors @paradite_, a characterization one critic rejected @Teknium.

Impact: The dispute is no longer just about model quality. It is about who gets subsidized compute, who has to pay API rates, and how efficiently agent frameworks use context and caching @_LuoFuli.

Gemma 4 is turning into a distribution story

Gemma 4 is now integrated into Android Studio Agent mode for local feature development, refactoring, and bug fixing @osanseviero +1. Separate posts highlighted 1,500 free daily requests to Gemma 4 31B in Google AI Studio @WinterArc2125, and one user described Gemma running locally on a Pixel phone with no connectivity @matvelloso. Gemma 4 was also cited as the #1 trending model on Hugging Face@_philschmid +1.

Impact: Gemma 4 is showing up across IDEs, hosted inference, and offline edge use, which is a stronger adoption signal than benchmarks alone @osanseviero +2.

Goldman Sachs sees a net labor-market drag from AI substitution

Goldman Sachs estimated that, over the past year, AI substitution reduced monthly payroll growth by roughly 25,000 and raised unemployment by 0.16 percentage points, while augmentation added about 9,000 jobs and lowered unemployment by 0.06 points@BrianSozzi. Netting the two implies a 16,000 monthly drag on payroll growth and a 0.1 point boost to unemployment, with the negative effects concentrated among less experienced workers @BrianSozzi.

Impact: The note argues that today’s net labor effect is already negative and is falling disproportionately on entry-level workers @BrianSozzi.

Research & Innovation

Why it matters: The strongest technical work this cycle focused on cheaper long-context inference, better credit assignment for reasoning, and more formal ways to generate theory with LLMs.

Long-context methods keep chipping away at attention cost

• HISA replaces a flat sparse-attention token scan with a two-stage block-then-token pipeline, eliminating the indexing bottleneck at 64K context without extra training @HuggingPapers +1.
• Screening Is Enough / Multiscreen replaces softmax-style global competition with threshold-based screening, matching Transformer-like validation loss with 40% fewer parameters and reducing inference latency by up to 3.2x at 100K context @TheAITimeline +1.
• Commentary around this work framed sparse attention as a form of maximum inner product search, while noting that approaches with better theoretical complexity still have to work on GPUs and at datacenter scale to matter in practice @part_harry_ +1.

New training methods target deeper reasoning and smaller working contexts

• FIPO uses discounted future-KL signals in policy updates, pushing average chain-of-thought length past 10,000 tokens and reaching 56.0% AIME 2024 Pass@1 on Qwen2.5-32B@TheAITimeline.
• SKILL0 tries to internalize agentic skills into model weights instead of retrieving them at runtime, reporting gains of over 9% on ALFWorld and 6% on Search-QA while cutting context usage to under 0.5K tokens per step@TheAITimeline.
• Principia introduces benchmarks and training recipes for deriving mathematical objects, with gains from on-policy judge training and verifiers that also transfer to standard numerical and multiple-choice math benchmarks @TheAITimeline.

LLMs are starting to participate in theoretical science workflows

steepest-descent-lean formalizes convergence bounds and hyperparameter scaling laws in Lean using Codex @leloykun +1. The work reproduces prior-style results under weaker assumptions, including support for Nesterov momentum and decoupled weight decay@leloykun +2, and recovers a fixed-token-budget scaling law of BS ≍ T²⁄³@CevherLIONS. Its stated workflow is simple: formalize a peer-reviewed proof, ask an LLM to weaken assumptions and re-derive theorems, then keep only the changes that preserve or better match empirical results @leloykun +1. The repo is here: steepest-descent-lean@leloykun.

Products & Launches

Why it matters: Useful product progress this cycle was less about one big model launch and more about better infrastructure around coding agents, memory, routing, and interface layers.

GitNexus adds a code graph for agent workflows

GitNexus indexes a codebase into a graph using Tree-sitter, mapping calls, imports, inheritance, execution flows, and blast radius before code changes @heygurisingh. The pitch is that agents get the repo’s dependency structure precomputed at index time, so smaller models can answer architecture questions without repeated exploration @heygurisingh. Setup is a single command: npx gitnexus analyze@heygurisingh. The project was cited as already reaching 9.4K GitHub stars and 1.2K forks@heygurisingh.

New building blocks are landing for agent memory and control planes

• Memvid offers a single-file memory layer for agents with instant retrieval and portable, versioned long-term memory without a database @NerdyRodent.
• Plano is an open-source AI-native proxy and data plane for agentic apps, with built-in orchestration, safety, observability, and smart LLM routing @dl_weekly.

Hermes Agent expands its interfaces

Hermes Agent added support for OAuth-authenticated MCP servers@Teknium, can expose an OpenAI-compatible endpoint for use with OpenWebUI as a chat interface @Teknium, and now ships a Manim skill for generating programmatic math and technical animations via /manim-video @NousResearch +1. One demo combined the Manim skill with Math Code to produce an explanatory video for Jordan’s Lemma@prompterminal.

DESIGN.md turns visual style into plain text for coding agents

The awesome-design-md repo packages design-system descriptions from 31 real websites into markdown files that agents can read directly, covering colors, typography, spacing, buttons, shadows, and responsive rules @ihtesham2005. The project was presented as a way to avoid repetitive default AI UI aesthetics, and it has now been integrated with Hermes Agent @ihtesham2005 +1.

Industry Moves

Why it matters: The business story this cycle was about sustainable economics, talent concentration, hardware experimentation, and the changing labor and data supply chains behind AI systems.

New pricing models are emerging for agent-heavy workloads

Alongside Anthropic’s tighter subscription rules, MiMo launched a Token Plan that supports third-party harnesses through token quotas and frames the model as long-term, stable delivery rather than open-ended subscription usage @_LuoFuli. The surrounding commentary argued the market is moving toward a combination of more token-efficient agent harnesses and more efficient models, not simply cheaper tokens @_LuoFuli +1.

PrimeIntellect added open-source training talent

Open-source researcher Elie Bakouch said he is joining PrimeIntellect to work on pre/mid training, citing the team’s open-frontier mission and the leverage of a small focused group @eliebakouch. Peers called the hire an "unbelievable get" and a "phenomenal choice"@code_star +1.

Neuromorphic computing patent activity is accelerating

A PatSnap-cited note said neuromorphic computing has moved from academic prototype to commercial product, with 596 patents filed through early 2026 and a 401% surge in activity during 2025 @kimmonismus +1.

A once-important data-labeling channel in China is weakening

Data-labelling workshops in rural Guizhou that were once part of China’s poverty alleviation effort and helped build AI systems are now struggling as state support and industry demand have fallen @vince_chow1 +1. One commentator suggested similar programs could still be repurposed toward graduate unemployment, but that was presented as an open question rather than a current policy @teortaxesTex.

Policy & Regulation

Why it matters: The policy signal this cycle was less about sweeping AI laws and more about concrete requirements on how companies govern AI internally and how jurisdictions handle AI infrastructure growth.

Beijing now requires AI ethics committees

New Beijing rules require all Chinese companies engaging in AI activities to establish internal AI ethics committees, effective immediately @vince_chow1. The final version removed earlier wording that made such committees conditional on circumstances @vince_chow1, and the move follows a 2023 ethics review system that had been criticized as too narrow and too perfunctory for AI-specific issues @vince_chow1. One commentator said the plain reading could be especially hard on smaller startups and questioned how it will be enforced @teortaxesTex.

Maine is moving to pause large data-center projects

Maine is on track to become the first U.S. state to pause construction of large data centers—projects over 20 megawatts—until November 2027 while it studies environmental and energy impacts @kimmonismus. Commentary around the move acknowledged concerns about rising electricity costs while arguing that infrastructure limits should not become a blanket brake on AI development @kimmonismus. The linked report is from the Wall Street Journal: Maine data center ban@kimmonismus.

Quick Takes

Why it matters: These smaller items are useful signals for where local deployment, inference optimization, tooling behavior, and public understanding are moving next.*

• A local grounded reasoning demo paired Gemma 4 with Falcon Perception, using Gemma to decide what to inspect and Falcon to return pixel-accurate coordinates; one example checked whether a soccer player was offside, fully local on M3 hardware @dahou_yasser.
• TorchSpec said its kimi-k2.5-eagle3 draft model hit 40K downloads on Hugging Face in two weeks, and vLLM said it adopted the open-source EAGLE3 draft model for low-latency inference on Kimi 2.5@lightseekorg +1.
• A weekend project showed a fully local coding agent using Qwen3.5 30B A3B, llama.cpp/lemonade, ngrok, and OpenHands; the builder said performance was better than expected @gneubig.
• Claude Code now reportedly throws an error when asked to analyze its own source code @theo. Separately, one user said the tool now refuses some system-fixing workflows they previously relied on, while Codex still accepts them @theo +2.
• François Chollet highlighted a tutorial for fine-tuning Gemma on TPU v5 using Kinetic + Keras + JAX, with a quick-start repo here: kinetic-finetuning-on-cloud-tpu@fchollet +1.
• Ryan Greenblatt argued that statements like "AGI is here" or "we’re far from AGI" are not meaningful unless the speaker defines the term being used @RyanPGreenblatt.
• The documentary The AI Doc is now showing in hundreds of theaters, and one commentator said non-technical viewers valued its plain explanation of how LLMs work @slashdot +1.

Today's signal

The clearest pattern today is a split between AI literacy and better judgment. Garry Tan and Bill Gates point readers toward resources that help explain current model capability and uncertainty, while Amol Avasarala and Amjad Masad recommend reading that sharpens mindset, reflection, and decision-making. @garrytan +3

Most compelling recommendation

Newest @steipete / @lexfridman interview

• Content type: Interview @garrytan
• Author/creator: @steipete and @lexfridman @garrytan
• Link/URL: Not provided in the source material
• Who recommended it: Garry Tan @garrytan
• Key takeaway: Tan says it is "probably the best way to catch up to what is really going on" and calls it "a perfect encapsulation of the extreme edge of what is possible now in codegen." @garrytan
• Why it matters: This is the strongest recommendation in today's set because it combines a clear use case—getting up to speed quickly—with a concrete thesis about where the frontier is headed: "just in time smart personal software is here, just not evenly distributed." @garrytan

AI mechanics and limits

How ChatGPT Works

• Content type: Book Ari Melber, Journalist & Attorn…
• Author/creator: Steve Wolfram Ari Melber, Journalist & Attorn…
• Link/URL: Not provided in the source material
• Who recommended it: Bill Gates Ari Melber, Journalist & Attorn…
• Key takeaway: Gates recommends it as a useful resource on language model mechanics, while stressing Wolfram's point that the way these systems represent knowledge is still not fully understood. Ari Melber, Journalist & Attorn…
• Why it matters: The recommendation does more than point to an explainer; it also frames the current limit of expert understanding. Ari Melber, Journalist & Attorn…

Books on mindset and decision quality

Amol Avasarala's recommendations form a coherent mini-list: two books on reframing internal experience, and one on making product decisions more explicitly probabilistic. Lenny's Podcast

The Joy of Living

• Content type: Book Lenny's Podcast
• Author/creator: Yongi Mingya Ringpoche Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: It helps readers think about life experience differently and offers tactics for changing how they think about things. Lenny's Podcast
• Why it matters: Avasarala says he has recommended it repeatedly and that people have "really, really enjoyed it." Lenny's Podcast

Awareness

• Content type: Book Lenny's Podcast
• Author/creator: Anthony DeMello Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: He describes it as offering similar value from a different angle. Lenny's Podcast
• Why it matters: He groups it with The Joy of Living as one of the books he consistently recommends. Lenny's Podcast

Thinking in Bets

• Content type: Book Lenny's Podcast
• Author/creator: Annie Duke Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: It is tactically useful in product because it pushes teams to convert vague timing claims into explicit probability estimates. Lenny's Podcast
• Why it matters: Avasarala gives a concrete operating example: asking for a percentage likelihood instead of accepting "I don't know, it'll get done in time." Lenny's Podcast

Lower-context but still useful

Article on entrepreneurial mindset

• Content type: Article @amasad
• Author/creator: Not provided in the source material
• Link/URL:http://x.com/i/article/2040473188568649728@EntrClub_KAU
• Who recommended it: Amjad Masad @amasad
• Key takeaway: Masad's endorsement is brief but explicit: he called it a "great article" on entrepreneurial mindset. @amasad
• Why it matters: There is less context than the other picks, but this one is immediately accessible through a direct article link. @EntrClub_KAU

Big Ideas

1) AI-native design is not the same as chat-first design

Andrew Chen’s test is simple: stop pitching products as “X but with AI,” and instead ask how the experience would be designed if AI existed from day one @andrewchen.

One thread says some SaaS products are already collapsing dense homepages into a single prompt field, which shifts defensibility from UI complexity to backend strengths like API surface, data model, and integrations Aakash Gupta. That same note points to Snowflake, Databricks, and Stripe as examples of companies that already treated the UI as a thin layer over a deeper engine Aakash Gupta.

A second thread adds an important constraint: many B2B SaaS users still do not want chat as the entry point. They want curated data and tools surfaced for them, and the builder’s job is curation @brettdash_ +1.

Why it matters: PMs should rethink entry points for AI products, but not assume a prompt bar is always the answer.

How to apply:

• Start with the first-value moment: should users see something useful immediately, or ask for it? @brettdash_
• If you simplify the UI, audit what sits behind it: API quality, data model, and integrations become more important Aakash Gupta
• Use AI-native design as the standard, but avoid lazy “existing product + AI” framing @andrewchen

2) In AI products, activation is the highest-leverage growth problem

In the Anthropic interview, activation is framed as critical because day-zero/day-one experience is often the highest-leverage input into long-term retention Lenny's Podcast. The challenge is harder in AI because model capabilities improve so quickly that users often fail to discover what the product can actually do; the interview calls this “capability overhang” Lenny's Podcast.

Anthropic’s response is to ask users who they are and what they care about, then use that information to recommend the right product or feature Lenny's Podcast. The broader claim is that good friction can improve conversion when it personalizes the path to value Lenny's Podcast. Lenny’s summary of the episode labels activation the single highest-leverage growth problem in AI @lennysan.

Why it matters: In AI products, better models do not automatically create better user outcomes. Discovery of value is now a product problem.

How to apply:

• Treat onboarding as routing, not just account creation Lenny's Podcast
• Ask a few high-signal questions early if they help match users to the right feature or workflow Lenny's Podcast
• Judge onboarding by downstream activation and retention, not just time-to-first-screen Lenny's Podcast

3) AI-heavy product orgs may need more PM capacity, not less

Anthropic’s view is that engineers are currently getting the biggest leverage gains from AI tools like Claude Code, with engineering productivity described as roughly 2-3x higher Lenny's Podcast. The consequence is that PMs and designers can end up managing the equivalent of a much larger engineering team, putting those functions under strain Lenny's Podcast.

Their response is not to remove PMs. It is to hire more of them, while also hiring product-minded engineers who can act as mini-PMs on smaller projects Lenny's Podcast +1.

Why it matters: The AI-era org question is not just “how many engineers can one PM support?” It is also “how much product direction and coordination is required when build capacity expands faster than planning capacity?”

How to apply:

• Recalculate PM:engineering ratios if AI tools materially change engineering throughput Lenny's Podcast
• Hire for product-minded engineers who can own small, bounded workstreams Lenny's Podcast
• Move PM focus upward toward direction-setting and cross-functional alignment when execution speed increases Lenny's Podcast

4) In exponential AI products, growth teams are biasing toward bigger swings

Anthropic says AI-first products should spend much more time on larger bets than a traditional growth team would, with roughly 50-70% of effort going to bigger swings instead of mostly small-to-medium optimizations Lenny's Podcast. The reasoning is that if product value is expected to increase dramatically as model capabilities improve, the upside of finding the next major use case can outweigh many small wins Lenny's Podcast. Small optimizations still matter and compound, but they are treated as secondary Lenny's Podcast.

Why it matters: Prioritization rules change when the product’s value curve is changing quickly.

How to apply:

• Keep a portfolio of small experiments, but reserve real capacity for larger product swings Lenny's Podcast
• Use this bias only where product value is truly AI-driven, not as a blanket rule for every software business Lenny's Podcast
• Revisit prioritization often as model capabilities change what is possible Lenny's Podcast

Tactical Playbook

1) Design onboarding with good friction

Anthropic, Masterclass, Mercury, and Calm are all cited as cases where extra steps, quizzes, or broken-out screens improved conversion when they helped users understand why the product was for them Lenny's Podcast.

How to do it:

1. Ask a small number of questions that reveal user intent or identity Lenny's Podcast
2. Use those answers to recommend the right feature, content, or product path Lenny's Podcast
3. Split cognitively heavy forms into smaller steps when needed Lenny's Podcast
4. Remove friction that adds no value, but keep friction that improves relevance and comprehension Lenny's Podcast
5. Validate with conversion and funnel-completion data rather than intuition alone Lenny's Podcast

Why it matters: Faster is not always better. More guided can outperform more minimal when users need help finding value Lenny's Podcast.

2) Match process rigor to project size

Anthropic uses a clear execution rule: if a project is about two engineering weeks or less, the engineer can effectively act as the PM, with the PM advising as needed Lenny's Podcast. Small changes may only need Slack messages and quick back-and-forth, while larger work gets a formal kickoff and, when useful, an AI-generated PRD built from prior examples Lenny's Podcast.

How to do it:

1. Define a size threshold for lightweight vs. heavy process Lenny's Podcast
2. For small work, rely on fast conversation and prototyping instead of default documentation Lenny's Podcast
3. For larger or riskier work, run a cross-functional kickoff with legal, safeguards, and other key stakeholders Lenny's Podcast
4. Use AI to draft PRDs from previous documents when documentation is needed Lenny's Podcast
5. Keep PMs accountable for larger bets and engineers accountable for bounded execution work Lenny's Podcast

Why it matters: Faster building only helps if the process does not bottleneck small work or under-structure high-risk work.

3) Operationalize AI experimentation with a four-stage loop

Anthropic’s CASH initiative breaks experimentation into four parts: identifying opportunities, building, testing against quality and brand bars, and analyzing results after launch Lenny's Podcast. The team scores model performance at each stage and started with narrow use cases like copy changes and minor UI tweaks Lenny's Podcast. Human review is still in the loop, especially for brand-sensitive outputs Lenny's Podcast.

How to do it:

1. Separate the workflow into opportunity identification, build, test, and analysis Lenny's Podcast
2. Measure AI performance at each stage instead of treating “AI experimentation” as one block Lenny's Podcast
3. Start with high-volume, low-scope work such as copy or small UI changes Lenny's Podcast
4. Keep human approval where brand or stakeholder risk is high Lenny's Podcast
5. Track whether time spent is falling and results are improving week over week Lenny's Podcast

Why it matters: AI is already useful in parts of the experimentation loop, but not equally across all parts.

4) Replace siloed growth reviews with one scorecard

A startup founder proposed a PLG Growth Scorecard because growth reviews were fragmented across Mixpanel, Stripe, HubSpot, and spreadsheets, leaving traffic, activation, and MRR disconnected from one another r/startups. The scorecard covers seven self-serve stages: Awareness, Acquisition, Activation, Conversion, Engagement, Retention, and Expansion r/startups.

How to do it:

1. Map your funnel across all seven stages r/startups
2. Assign each metric to a named owner across Marketing, Product, Sales, RevOps, or CS r/startups
3. Add goal and trend tracking for every stage r/startups
4. Choose a North Star metric; the example defaults to Activation Rate r/startups
5. Use the full view to diagnose where the funnel actually leaks r/startups

Why it matters: PMs can make better trade-offs when they can see the full self-serve system, not just the product slice.

Case Studies & Lessons

1) Anthropic: hypergrowth creates “success disasters”

Lenny’s post says Anthropic grew from $1B to $19B ARR in a year and added $6B in ARR in February alone @lennysan. In the interview, Amol Avasare says about 70% of his time goes to what Anthropic calls “success disasters”: urgent scaling problems across acquisition, activation, and monetization created by rapid growth Lenny's Podcast. The remaining 30% goes to more proactive work such as product prioritization, pricing, and new-product funnels Lenny's Podcast.

The team is roughly 40 people, organized with cross-cutting horizontals like growth platform and monetization, plus audience-focused pods for B2B, Claude Code, knowledge workers, and API users Lenny's Podcast.

Key takeaway: At sufficient scale, growth stops looking like a clean experimentation backlog and starts looking like systems management. Org design has to support both firefighting and focused audience work Lenny's Podcast.

2) Mercury: a quarter spent on quality produced a significant onboarding uplift

While at Mercury, Avasare says the team spent an entire quarter fixing onboarding quality for a complex regulated flow and explicitly set aside the usual growth-metric mindset for that period Lenny's Podcast. The result was a significant uplift in onboarding start-to-completion Lenny's Podcast. His broader lesson from that experience is that quality drives growth Lenny's Podcast.

Key takeaway: When a critical flow is broken or confusing, quality work can outperform another quarter of metric chasing Lenny's Podcast.

3) CASH: AI is already useful for narrow, high-volume growth work

Anthropic’s internal CASH effort is still early, but it is already producing results on small-scale experiments such as copy changes and minor UI tweaks Lenny's Podcast. Avasare describes the current win rate as closer to a junior PM than a senior PM, while noting that progress has been rapid and human approval remains in place today Lenny's Podcast.

Key takeaway: The near-term opportunity is not full PM automation. It is targeted automation of repetitive experiment loops where volume is high and risk is manageable Lenny's Podcast.

Career Corner

1) In AI product work, PM advantage comes from tool fluency, adaptability, and interdisciplinary depth

Avasare’s career advice is to stay on top of the tools, understand what each new model release changes, and apply that learning to your own work Lenny's Podcast. He also argues that PMs should lean into their strongest interdisciplinary edge, whether that is design, finance, sales, or something else, because mixed-skill operators become unusually valuable when roles blur Lenny's Podcast. His warning is that 50-70% of old playbooks may no longer apply in AI-heavy environments Lenny's Podcast.

How to apply:

• Build a habit of testing new tools and releases directly Lenny's Podcast
• Double down on the cross-functional skill that makes you unusually useful Lenny's Podcast
• Assume some prior PM habits will need to be rewritten, not merely updated Lenny's Podcast

2) Cold outreach still works when it is specific and tested

Avasare says he got his Anthropic role by cold emailing Mike Krieger, arguing the company needed a growth team Lenny's Podcast. His tactics: use a tested subject line and message, reach out where others are not overwhelming the recipient, keep the pitch short, and follow up multiple times if it matters Lenny's Podcast.

How to apply:

• Lead with a crisp point of view on the company’s need Lenny's Podcast
• Keep the message short: who you are, why you fit, why you should talk Lenny's Podcast
• Follow up persistently when the opportunity matters Lenny's Podcast

3) An adjacent operator role can be a bridge into PM

In one r/ProductManagement thread, a Data Analyst opportunity was described as owning tools, managing data pipelines, fixing bugs, shipping enhancements, and potentially building new capabilities over time r/ProductManagement. A commenter’s advice was to take that role, learn PM while building new capabilities, gradually evolve the work toward full PM scope, then negotiate the title change internally with manager support r/ProductManagement.

How to apply:

• Favor adjacent roles with real ownership over tools or workflows r/ProductManagement
• Start practicing PM as soon as you are shaping new capabilities r/ProductManagement
• Use internal mobility and manager sponsorship to formalize the transition r/ProductManagement

4) When leadership feedback is vague, treat the executive like a user and force clarity

In another r/ProductManagement thread about VP-level expectations, commenters suggested treating the CEO or manager like a user: figure out what they say they want, then uncover the underlying need r/ProductManagement. The practical advice was to define the yardstick for success, run experiments to show course correction, and socialize a draft plan quickly r/ProductManagement +1. Some commenters also recommended getting external coaching from experienced leaders r/ProductManagement +1.

The same thread also raised a warning: vague expectations, unclear KPIs, and treating ambiguity as a failure rather than part of the role can indicate level mismatch or broader trouble r/ProductManagement +1.

How to apply:

• Turn fuzzy feedback into explicit success metrics and review checkpoints r/ProductManagement
• Socialize a draft plan early rather than waiting for perfect clarity r/ProductManagement
• If expectations remain subjective and unstable, treat that as data about fit, not just performance r/ProductManagement +1

Tools & Resources

1) PLG Growth Scorecard

What it is: A unified dashboard across Awareness, Acquisition, Activation, Conversion, Engagement, Retention, and Expansion, with named owners, goals, trends, and a configurable North Star metric r/startups.

Why explore it: It replaces the common “five-dashboard scramble” where traffic, product, and revenue reviews do not line up r/startups.

Try it: Start with Activation Rate if you need one leading indicator, then add cross-stage leak detection r/startups.

2) The CASH experiment loop

What it is: Anthropic’s framework for AI-assisted growth experimentation: identify opportunities, build, test against brand/quality, and analyze outcomes Lenny's Podcast.

Why explore it: It gives PMs a practical way to break AI experimentation into measurable stages instead of treating it as one black box Lenny's Podcast.

Try it: Pilot it on copy changes or small UI tweaks, and keep a human approval step for brand-sensitive output Lenny's Podcast.

3) A lightweight kickoff + AI-generated PRD pattern

What it is: A process pattern where small work happens in Slack and prototypes, while larger work gets a proper kickoff plus a lightweight AI-generated PRD built from prior documents Lenny's Podcast.

Why explore it: It keeps teams from over-documenting small changes while still adding structure where risk is higher Lenny's Podcast.

Try it: Define one size threshold in engineering weeks and one kickoff template for cross-functional work Lenny's Podcast.

4) Loom AI for product demo cleanup

What it is: A tool recommendation from r/startups for automatically trimming pauses and generating transcripts and timestamps for product demos r/startups +1.

Why explore it: Demo editing can take longer than recording; this reduces cleanup time r/startups +1.

Try it: Use it for internal walkthroughs, stakeholder demos, and early customer-facing product tours r/startups.

5) Prototype before you pitch

What it is: Andrew Chen argues that we should hear fewer investor pitches based on a “drawing on a napkin” because, if you can draw it, you can often prompt it into existence now @andrewchen.

Why explore it: The bar for pre-product storytelling is moving toward something interactive or tangible @andrewchen.

Try it: Before a concept review or fundraising conversation, turn the sketch into a thin prototype first @andrewchen.

Builder platforms and deployment

X is repositioning its API for AI agents

The X API was presented as a major update for AI agents and builders, with pay-per-use pricing, native XMCP Server + Xurl support for agents, official Python and TypeScript XDKs, and a free API Playground for simulated testing @XFreeze. X also said purchases can return up to 20% in xAI API credits and pointed developers to docs.x.com@XFreeze.

Why it matters: This is a real packaging change, not just a feature tweak: X is trying to make its real-time data and action surface easier to use as agent infrastructure @XFreeze.

Kreuzberg pushed document intelligence deeper into code workflows

Kreuzberg v4.7.0 introduced tree-sitter-based code intelligence for 248 formats, including AST-level extraction of functions, classes, imports, symbols, and docstrings, with scope-aware chunking for repo analysis, PR review, and codebase indexing r/LocalLLM. The release also reported markdown-quality gains across 23 formats, added a TOON wire format that cuts prompt tokens by 30-50%, and shipped integration as a document backend for OpenWebUI r/LocalLLM.

Why it matters: The project is explicitly positioning itself as infrastructure for agents, with better extraction quality and smaller prompt payloads aimed at making code and document analysis more reliable and cheaper r/LocalLLM.

Project: GitHubr/LocalLLM

Gemma 4 kept picking up local deployment paths

NVIDIA said it is accelerating Gemma 4 for local agentic AI across hardware "from RTX to Spark" r/LocalLLM, and Hugging Face CEO Clement Delangue said Gemma 4 had reached the top spot on Hugging Face @ClementDelangue. Separately, an open-source FPGA project reported roughly 450 tokens per second on an AMD Kria KV260 using a custom 36-core heterogeneous pipeline and a smaller distilled INT4/KAN runtime model, though the team said the quantized weights are still a work in progress r/LocalLLM +1.

Why it matters: The notable signal here is ecosystem traction: vendor support and community experimentation are creating more concrete local and edge paths around Gemma 4 r/LocalLLM +1.

Resources: NVIDIA blogr/LocalLLM · FPGA repor/LocalLLM

Research and evaluation

A pure-Triton MoE kernel posted inference-time wins

A fused MoE dispatch kernel written in pure Triton reported faster forward-pass performance than Stanford's CUDA-optimized Megablocks on Mixtral-8x7B at inference batch sizes, with gains of 131% at 32 tokens and 124% at 128 tokens on A100 r/MachineLearning. The writeup attributes this to fused gate+up projection that removes about 470MB of intermediates and cuts memory traffic by 35%, plus block-scheduled grouped GEMM that handles variable-sized expert batches without padding; tests also passed on AMD MI300X without code changes r/MachineLearning.

Why it matters: This is the kind of low-level serving work that can materially improve MoE deployment efficiency at the inference-relevant batch sizes many teams care about r/MachineLearning.

Code: GitHubr/MachineLearning · Writeup: subhadipmitra.comr/MachineLearning

Reference-free auditing may make hidden behaviors easier to detect

A new AuditBench result used Ridge regression from early-layer to late-layer activations and treated the residuals as candidates for planted behavior, avoiding the need for a clean reference model r/MachineLearning. Reported AUROCs were 0.889 for hardcode_test_cases, 0.844 for animal_welfare, 0.833 for anti_ai_regulation, and 0.800 for secret_loyalty, with 3 of 4 matching or exceeding reference-based methods r/MachineLearning.

Why it matters: The study was small, but it suggests targeted behaviors may be auditable even when a base model is unavailable, which is a practical constraint in many real evaluation settings r/MachineLearning.

Code: GitHubr/MachineLearning · Writeup: Substackr/MachineLearning

AI-native school models are moving from pilots to full operating systems

The biggest signal this week is that AI is starting to define whole learning models, not just classroom tasks. Across Alpha School and Once, AI is being used to restructure time, staffing, and tutoring rather than simply add a chatbot to existing lessons FORGED IN AMERICA PODCAST +1.

Alpha leaders described a mastery-based model where students spend about two hours each morning on AI-driven academics in math, science, and reading, while guides focus on motivation at roughly 1:15, or 1:5 in K-2 FORGED IN AMERICA PODCAST. The system assesses what a student knows, identifies gaps, and generates lessons at the right level; Joe Liemandt said the lesson engine uses the curriculum plus a student’s knowledge graph and interest graph, with cognitive load theory planned for 2026 FORGED IN AMERICA PODCAST +1. Alpha also draws a hard line between guided lesson generation and open-ended academic chatbots, which its leaders argue mostly encourage cheating rather than learning The Knowledge Project Podcast. Operationally, the product goes as far as surfacing a “waste meter” when students skip explanations or use time inefficiently The Knowledge Project Podcast.

In interviews, Alpha leaders reported top 1% standardized-test performance across grades and subjects, an average senior SAT of 1550, and movement from bottom-half entrants to above the 90th percentile within two years The Knowledge Project Podcast +1. Those are school-reported outcomes, and a news segment noted that some educators remain skeptical because AI-based school models are still seen as unproven FORGED IN AMERICA PODCAST.

Expansion is moving on multiple fronts. Liemandt said Alpha would have 25 campuses this year and make Time Back broadly accessible in 2026, while Mackenzie Price said Alpha expected about 50 campuses in 2026 and noted a $1 billion capital commitment from Liemandt The Knowledge Project Podcast +1. Variants are already appearing in specialized formats: Texas Sports Academy says voucher-eligible families can access Alpha academics through its program, and Bennett School pairs two hours of AI-powered learning with elite baseball development @jliemandt +1. Texas Sports Academy has also cited individual gains from 6th- to 11th-grade reading and from the 42nd to the 82nd percentile @malekaimischke.

A narrower, more human-centered implementation comes from Once, which uses AI software to help support staff deliver one-on-one early reading tutoring to children ages 3 to 7 The Future of Education. Its origin story is practical: pandemic-era pilots suggested that 15 minutes of daily tutoring from non-experts could help kindergarten-age children learn to read, and the company is now trying to scale that approach through software inside schools The Future of Education.

The strongest new tools guide process rather than replace it

The most useful product pattern this week was not broader generation. It was more scaffolding.

Microsoft’s Search Progress asks students to evaluate source reputation and consequence while they research, then gives teachers visibility into searches, links opened, and sources saved Microsoft Education. Built with the Digital Inquiry Group, it is explicitly framed as a way to make research thinking visible at a moment when Microsoft argues students’ baseline media-literacy skills are weak and PISA is preparing a 2029 assessment on media and AI literacy Microsoft Education.

Microsoft’s Study and Learn Agent applies the same idea to tutoring. In preview, it shifts Copilot from answer engine to coach: instead of solving a problem outright, it asks what the student has tried, gives just enough explanation to move them forward, and can generate flashcards, quizzes, and study plans grounded in uploaded notes or files Microsoft Education. The limitations are clear too: it is still in preview, requires Copilot Chat to be enabled, and is currently for students 13+ Microsoft Education.

On the teacher workflow side, Microsoft’s free Teach Module is expanding from drafting into modification: aligning activities to recognized standards in 40+ countries and U.S. states, differentiating instructions, adjusting reading level while preserving key terms, and adding real-world examples Microsoft Education. One current constraint is localization: presenters said grade levels are U.S.-based for now and only becoming more localized over the coming months Microsoft Education.

Ellis pushes this scaffolding pattern into educator support. It uses a retrieval-augmented system built on trusted sources such as CAST, Understood, NCLD, Digital Promise, and the Reading League to generate classroom strategies and action plans from a teacher’s scenario Cult of Pedagogy. Its boundaries matter as much as its features: it stores scenarios for follow-up, strips or replaces student names, and stops the conversation when self-harm or suicidal ideation appears, directing educators back to school protocols and crisis supports Cult of Pedagogy.

For self-directed learners, NotebookLM added topic summaries and next-study suggestions after quizzes and flashcards, plus a regenerate option for more practice on selected topics @NotebookLM. At the more advanced end, Andrej Karpathy described using LLMs to compile source materials into a markdown wiki in Obsidian, query it for complex questions, and feed outputs back into the knowledge base — powerful for research, but still, in his words, closer to a “hacky collection of scripts” than a mainstream learning product @karpathy.

Governance is shifting from bans to assignment-level rules and disclosure

Policy is also getting more concrete.

Pineville ISD shifted from “acceptable use” to “responsible use,” arguing that platform-specific rules become obsolete too quickly as AI gets embedded into existing tools techlearning. Its most practical move is an assignment-level AI scale that runs from no AI use to AI-focused projects, with teachers choosing the level per task techlearning. Microsoft is building the same concept into product workflow: Assignments will let teachers mark expected AI use as none, partial, or full, and attach an explicit prompt when full AI use is allowed Microsoft Education.

In higher education, Lance Eaton and Carol Damm’s new transparency framework argues institutions should document their own GenAI use if they expect students to disclose theirs, and that improving export and import features across AI tools could make that record-keeping more realistic AI + Education = Simplified.

The urgency is real. One EdSurge essay cited a May 2025 study finding that 84% of high school students used generative AI for schoolwork, and pointed to reporting on pervasive, undisclosed AI use to grade and give feedback on student writing in some New Orleans schools edsurge. At the institutional level, Google and IDC warned that uneven adoption inside universities is creating a new digital divide: some students get AI-enabled learning and AI safety practice, while others get neither because faculty, departments, and institutions lack a shared strategy Google for Education.

Some institutions are now responding at curriculum level. Purdue is moving toward an AI skills graduation requirement, Ohio State wants every freshman through an AI literacy course, and Microsoft noted that PISA’s 2029 assessment will cover media and AI literacy Google for Education +1.

Governance also has to cover new harms, not just plagiarism. Laura Knight described a recent UK school deepfake incident involving sexualized images of teachers and warned that AI “friend” chatbots can pull vulnerable children toward attachment and monetized intimacy The Edtech Podcast. Her recommendation is less screen-time rhetoric and more scenario-based professional development, peer support, coaching, and digital self-regulation The Edtech Podcast +1.

Research is sharpening the line between useful support and unsafe substitution

Research this week reinforced a simple rule: guided assistance can help, but automation is weak where judgment, relationships, or fairness matter.

Where AI is helping

• In a UK math RCT with 165 students, both human and AI tutors beat written hints; the AI performed slightly better on novel problems and strong Socratic questioning, but human tutors were better at reading emotion and adjusting pace AI in Education Podcast.
• A Wharton and National Taiwan University study of 770 high-school Python learners found proactive adaptive problem selection outperformed reactive chatbots and produced gains equal to 6-9 extra months of learning AI in Education Podcast.
• India’s Shiksha Copilot reduced lesson-plan creation from 45-90 minutes to 15, but the study still emphasized teacher-AI collaboration and found English outputs stronger than local-language ones AI in Education Podcast.

Where caution is warranted

• More AI-driven revision is not automatically better. In a University of Queensland study, hybrid feedback produced more revisions, but all feedback types ended with similar quality, confidence, and grades AI in Education Podcast.
• A Stanford analysis of four LLMs giving feedback on 600 eighth-grade essays found the same writing received different feedback when models were told the student was low ability, high ability, Asian, male, or female; the practical recommendation was to minimize demographic data in prompts AI in Education Podcast.
• Thirteen AI detectors tested on 280,000 student works produced an average 41% false-positive rate on short texts, making them unsafe for high-stakes use AI in Education Podcast.
• Hidden prompt injections still manipulated older and smaller judge models in a new Wharton report, even if most frontier models resisted; Gemini 3 was the only tested frontier model reported as susceptible @emollick +1.
• Chatbots were not a substitute for human contact: in a two-week RCT with 300 first-year students, only daily conversations with another human reduced loneliness; chatbot chats performed no better than journaling AI in Education Podcast.

That is why Justin Reich argues schools should stop looking for universal AI “best practice” and instead run local experiments, compare student work over time, and decide where AI belongs in core versus peripheral curriculum The Learning Future.

What This Means

• For school operators: AI is starting to change schedule design, staffing, and specialization. If you are evaluating new models, pair the claims with local experiments and work-sample review rather than copying operator narratives at face value FORGED IN AMERICA PODCAST +2.
• For teachers and instructional designers: the practical wins are scaffolds and modifications — source evaluation, guided study, differentiated instructions, reading-level adjustment, and lesson planning Microsoft Education +2.
• For higher ed and L&D teams: the middle path is getting clearer. Ethan Mollick describes AI tutors outside class and more exercises, simulations, grading, and reflection inside class, while institutions like Ohio State and Purdue are moving AI literacy into the curriculum itself Solutions with Henry Blodget +1.
• For self-directed learners: source-grounded study is getting better, from NotebookLM’s quiz guidance to LLM-built personal knowledge bases, but the best workflows still depend on curated source sets and active note-building @NotebookLM +1.
• For school leaders and compliance teams: assignment-level AI expectations and disclosure are likely more durable than blanket bans, especially when detector tools still misfire on short student work techlearning +2.
• For buyers and investors: the strongest product signals this week were source grounding, teacher control, privacy boundaries, and human fallback — not broader claims of autonomy Cult of Pedagogy +1.

Watch This Space

• AI-native school expansion. Alpha says Time Back will open more broadly in 2026, and Liemandt says specialized academies are expanding across new schools, sports, and cities The Knowledge Project Podcast +1.
• AI literacy becoming a formal requirement. Purdue is moving to an AI skills graduation requirement, Ohio State wants every freshman through AI literacy, and PISA will assess media and AI literacy in 2029 Google for Education +1.
• Personal study stacks and memory-aware workflows. NotebookLM’s quiz upgrade, author-created llms.txt reading experiences, Karpathy’s LLM wikis, and new work on memory-aware agents all point toward more cumulative, source-bound self-study workflows @NotebookLM +4.
• Student-built learning software. A high school student-built 3D chemistry app prompted Liemandt to predict that students will soon learn from apps built by other students @adxtyahq +1.
• AI-specific safeguarding. Deepfake sexualized imagery and synthetic-intimacy chatbots are likely to push schools toward more explicit AI safety education, not just generic screen-time rules The Edtech Podcast.

🔥 TOP SIGNAL

Today's clearest alpha: serious coding-agent setups are moving from one-shot generation to verification loops. Peter Steinberger's new OpenClaw self-QA workflow has an orchestrator assign a task, verify the result, and spawn a repair subagent on failure; LangChain describes the same general move as harness improvement from traces, and Andrew Yates says Dropbox has been running a "Ralph loop" Dark Factory since October while Geoffrey Huntley says companies are now spending engineer-salary-level budgets to automate software verification @steipete +3.

🛠️ TOOLS & MODELS

• OpenClaw — GPT 5.4 dev-channel upgrade. steipete says the claw harness now has GPT 5.4 upgrades; test with openclaw update --channel dev. Early user feedback moved from near-frustration to "way better" / "GOD MODE" @steipete +2
• Claude Max / Claude Code — harness gating is now concrete. In testing, adding the exact system-prompt string A personal assistant running inside OpenClaw. triggered a 400 saying third-party apps draw from extra usage, not plan limits. Simon Willison says exact-string prompt filtering is a step too far; separately, Theo says Claude Code now refuses the system-fix tasks he mainly kept his subscription for, while Codex still does the work @steipete +6
• T3Code fork — task-specific handoff. Emanuele DPT's experimental open-source feature routes UI-heavy threads to Claude and logic-heavy threads to Codex. Push to main is planned, and Theo says these increasingly elaborate forks are exactly the mindset he wants encouraged in T3Code itself @emanueledpt +1
• Salesforce's model mix — real scale, bounded claims. Marc Benioff says Salesforce's 15,000 engineers use coding models from Anthropic, OpenAI Codex, Cursor, and others, plus agents that engineers supervise. His productivity number is more than 30%, not 100%, because models are still not autonomous Matthew Berman

💡 WORKFLOWS & TRICKS

• Self-QA your harness

  1. Add a synthetic message channel to your own agent.
  2. Let an orchestrator define a concrete task.
  3. Verify the result automatically.
  4. If verification fails, spin up a subagent to analyze and fix.
  5. steipete says he built this OpenClaw loop in about six hours and found it better than old-school end-to-end tests @steipete +1

• Route by task type, not brand loyalty

  • Send UI-heavy work to Claude.
  • Send logic-heavy work to Codex.
  • Keep the handoff explicit so the thread can continue in the model that fits the task @emanueledpt

• Use AI where answers are checkable; keep architecture human-owned

  1. Use AI to crush tedious implementation work — Lalit Maganti used Claude Code to get past 400+ SQLite grammar rules and into concrete prototypes fast simonwillison
  2. Be skeptical when the task has no objectively checkable answer — Maganti says AI led him into dead ends and encouraged deferring key design decisions simonwillison
  3. If the prototype proves the idea but the architecture is muddy, throw it away and rebuild with more human-in-the-loop design decisions simonwillison

• Let traces improve the system at multiple layers

  1. Run the agent on real tasks and evaluate outcomes.
  2. Store traces.
  3. Use a coding agent to propose harness code changes from those traces.
  4. Update context separately via persistent memory — agent-level files like SOUL.md, tenant-level memory, offline "dreaming," or hot-path updates langchain

• Plan for supervised agents, not full autonomy

  • Salesforce's benchmark is the right planning assumption for now: engineers supervise coding agents, and even at 15,000-engineer scale the gain Benioff reports is more than 30%, not 100% Matthew Berman

👤 PEOPLE TO WATCH

• Peter Steinberger — shipping OpenClaw internals in public: self-QA loops, dev-channel GPT 5.4 harness changes, and concrete "make GPT better" tweaks rooted in prior Codex work @steipete +2
• Lalit Maganti — one of the best firsthand build logs in the batch: fast AI-assisted parser implementation, then a disciplined reset once architecture quality slipped. Start with syntaqlite and the full postsimonwillison
• Simon Willison — worth following because he tests vendor behavior directly. Today he highlighted the exact-string OpenClaw trigger and argued prompt-based billing filters go too far @simonw +3
• Theo + Emanuele DPT — useful signal on model routing in the wild: an open-source T3Code fork that hands UI work to Claude and logic to Codex, with Theo explicitly wanting that extension mindset inside the main tool @emanueledpt +1

🎬 WATCH & LISTEN

• 10:25-11:40 — Marc Benioff on the real ceiling of coding agents today. Best calibration clip in the pack: Salesforce says engineers across a 15,000-person org are using coding models and agents, but the human role becomes supervisory rather than disappearing. The number to keep in your head is more than 30% productivity, not autonomy Matthew Berman

📊 PROJECTS & REPOS

• syntaqlite — high-fidelity SQLite parser, formatter, and verifier. The build story is the signal: eight years of wanting, then three months with Claude Code to get it built simonwillison
• Deep Agents — LangChain's open-source, model-agnostic base harness. They say traces plus LangSmith CLI and Skills were used to improve it on terminal bench, and it supports user-scoped memory plus background consolidation langchain
• T3Code Claude/Codex handoff fork — experimental open-source feature, push to main planned. The practical signal is the routing rule itself: different models for UI vs. logic work @emanueledpt
• OpenClaw dev channel — not a new repo, but a live harness update worth testing if you use it: GPT 5.4 upgrades are available via openclaw update --channel dev@steipete

Editorial take: the edge is shifting out of raw model IQ and into the wrapper — verification loops, trace-driven harness updates, and blunt task routing between models @steipete +2.

Top Stories

Why it matters: This cycle’s biggest signals were about autonomous research, vertical expansion into biotech, the economics of agent usage, wider local-model distribution, and early labor-market measurements.

ASI-Evolve claims end-to-end autonomous AI research

Shanghai Jiao Tong University researchers released ASI-Evolve, an open-sourced system described as running the full AI research loop itself: reading papers, forming hypotheses, designing and running experiments, analyzing results, and iterating without human intervention @heynavtoor. In neural architecture search, it ran 1,773 rounds, generated 1,350 candidates, and produced 105 models that beat the best human-designed baseline; the top model exceeded DeltaNet by +0.97 points@heynavtoor. The same framework reportedly improved data curation by +3.96 average benchmark points and +18 on MMLU, and produced RL algorithms that beat GRPO by up to +12.5 on competition math @heynavtoor.

A biomedicine test also showed +6.94 points in drug-target prediction on unseen drugs @heynavtoor. One critic argued the work is not the first effort of its kind and said frontier labs still rely on data intuitions that may not be offloaded to a scaffold @teortaxesTex.

Impact: The paper presents this as a single framework improving architecture, data, and algorithms rather than optimizing only one part of the stack @heynavtoor.

Anthropic acquires Coefficient Bio for biotech workflows

Anthropic acquired Coefficient Bio for about $400M. The sub-10-person startup builds AI to plan drug R&D, manage clinical regulatory strategy, and identify new drug opportunities @kimmonismus. The team joins Anthropic’s healthcare and life sciences group, which already works with Sanofi, Novo Nordisk, AbbVie, and others @kimmonismus.

Posts around the deal frame it as execution on Dario Amodei’s "virtual biologist" idea, with Coefficient Bio covering drug discovery, clinical trials, and regulatory submissions end to end @kimmonismus.

Impact: The deal pushes Anthropic further from being only a general-model vendor and deeper into healthcare-specific workflows @kimmonismus.

Claude access rules now reflect harness economics

A notice said Claude subscriptions will no longer cover usage on third-party tools like OpenClaw, though users can still buy extra usage bundles or use a Claude API key @bcherny. A later analysis argued some harnesses send repeated low-value requests with long contexts—often over 100K tokens—making costs tens of times higher than a subscription price @_LuoFuli. Another post framed Anthropic’s position as allowing products that complement Claude Code but not direct competitors @paradite_, a characterization one critic rejected @Teknium.

Impact: The dispute is no longer just about model quality. It is about who gets subsidized compute, who has to pay API rates, and how efficiently agent frameworks use context and caching @_LuoFuli.

Gemma 4 is turning into a distribution story

Gemma 4 is now integrated into Android Studio Agent mode for local feature development, refactoring, and bug fixing @osanseviero +1. Separate posts highlighted 1,500 free daily requests to Gemma 4 31B in Google AI Studio @WinterArc2125, and one user described Gemma running locally on a Pixel phone with no connectivity @matvelloso. Gemma 4 was also cited as the #1 trending model on Hugging Face@_philschmid +1.

Impact: Gemma 4 is showing up across IDEs, hosted inference, and offline edge use, which is a stronger adoption signal than benchmarks alone @osanseviero +2.

Goldman Sachs sees a net labor-market drag from AI substitution

Goldman Sachs estimated that, over the past year, AI substitution reduced monthly payroll growth by roughly 25,000 and raised unemployment by 0.16 percentage points, while augmentation added about 9,000 jobs and lowered unemployment by 0.06 points@BrianSozzi. Netting the two implies a 16,000 monthly drag on payroll growth and a 0.1 point boost to unemployment, with the negative effects concentrated among less experienced workers @BrianSozzi.

Impact: The note argues that today’s net labor effect is already negative and is falling disproportionately on entry-level workers @BrianSozzi.

Research & Innovation

Why it matters: The strongest technical work this cycle focused on cheaper long-context inference, better credit assignment for reasoning, and more formal ways to generate theory with LLMs.

Long-context methods keep chipping away at attention cost

• HISA replaces a flat sparse-attention token scan with a two-stage block-then-token pipeline, eliminating the indexing bottleneck at 64K context without extra training @HuggingPapers +1.
• Screening Is Enough / Multiscreen replaces softmax-style global competition with threshold-based screening, matching Transformer-like validation loss with 40% fewer parameters and reducing inference latency by up to 3.2x at 100K context @TheAITimeline +1.
• Commentary around this work framed sparse attention as a form of maximum inner product search, while noting that approaches with better theoretical complexity still have to work on GPUs and at datacenter scale to matter in practice @part_harry_ +1.

New training methods target deeper reasoning and smaller working contexts

• FIPO uses discounted future-KL signals in policy updates, pushing average chain-of-thought length past 10,000 tokens and reaching 56.0% AIME 2024 Pass@1 on Qwen2.5-32B@TheAITimeline.
• SKILL0 tries to internalize agentic skills into model weights instead of retrieving them at runtime, reporting gains of over 9% on ALFWorld and 6% on Search-QA while cutting context usage to under 0.5K tokens per step@TheAITimeline.
• Principia introduces benchmarks and training recipes for deriving mathematical objects, with gains from on-policy judge training and verifiers that also transfer to standard numerical and multiple-choice math benchmarks @TheAITimeline.

LLMs are starting to participate in theoretical science workflows

steepest-descent-lean formalizes convergence bounds and hyperparameter scaling laws in Lean using Codex @leloykun +1. The work reproduces prior-style results under weaker assumptions, including support for Nesterov momentum and decoupled weight decay@leloykun +2, and recovers a fixed-token-budget scaling law of BS ≍ T²⁄³@CevherLIONS. Its stated workflow is simple: formalize a peer-reviewed proof, ask an LLM to weaken assumptions and re-derive theorems, then keep only the changes that preserve or better match empirical results @leloykun +1. The repo is here: steepest-descent-lean@leloykun.

Products & Launches

Why it matters: Useful product progress this cycle was less about one big model launch and more about better infrastructure around coding agents, memory, routing, and interface layers.

GitNexus adds a code graph for agent workflows

GitNexus indexes a codebase into a graph using Tree-sitter, mapping calls, imports, inheritance, execution flows, and blast radius before code changes @heygurisingh. The pitch is that agents get the repo’s dependency structure precomputed at index time, so smaller models can answer architecture questions without repeated exploration @heygurisingh. Setup is a single command: npx gitnexus analyze@heygurisingh. The project was cited as already reaching 9.4K GitHub stars and 1.2K forks@heygurisingh.

New building blocks are landing for agent memory and control planes

• Memvid offers a single-file memory layer for agents with instant retrieval and portable, versioned long-term memory without a database @NerdyRodent.
• Plano is an open-source AI-native proxy and data plane for agentic apps, with built-in orchestration, safety, observability, and smart LLM routing @dl_weekly.

Hermes Agent expands its interfaces

Hermes Agent added support for OAuth-authenticated MCP servers@Teknium, can expose an OpenAI-compatible endpoint for use with OpenWebUI as a chat interface @Teknium, and now ships a Manim skill for generating programmatic math and technical animations via /manim-video @NousResearch +1. One demo combined the Manim skill with Math Code to produce an explanatory video for Jordan’s Lemma@prompterminal.

DESIGN.md turns visual style into plain text for coding agents

The awesome-design-md repo packages design-system descriptions from 31 real websites into markdown files that agents can read directly, covering colors, typography, spacing, buttons, shadows, and responsive rules @ihtesham2005. The project was presented as a way to avoid repetitive default AI UI aesthetics, and it has now been integrated with Hermes Agent @ihtesham2005 +1.

Industry Moves

Why it matters: The business story this cycle was about sustainable economics, talent concentration, hardware experimentation, and the changing labor and data supply chains behind AI systems.

New pricing models are emerging for agent-heavy workloads

Alongside Anthropic’s tighter subscription rules, MiMo launched a Token Plan that supports third-party harnesses through token quotas and frames the model as long-term, stable delivery rather than open-ended subscription usage @_LuoFuli. The surrounding commentary argued the market is moving toward a combination of more token-efficient agent harnesses and more efficient models, not simply cheaper tokens @_LuoFuli +1.

PrimeIntellect added open-source training talent

Open-source researcher Elie Bakouch said he is joining PrimeIntellect to work on pre/mid training, citing the team’s open-frontier mission and the leverage of a small focused group @eliebakouch. Peers called the hire an "unbelievable get" and a "phenomenal choice"@code_star +1.

Neuromorphic computing patent activity is accelerating

A PatSnap-cited note said neuromorphic computing has moved from academic prototype to commercial product, with 596 patents filed through early 2026 and a 401% surge in activity during 2025 @kimmonismus +1.

A once-important data-labeling channel in China is weakening

Data-labelling workshops in rural Guizhou that were once part of China’s poverty alleviation effort and helped build AI systems are now struggling as state support and industry demand have fallen @vince_chow1 +1. One commentator suggested similar programs could still be repurposed toward graduate unemployment, but that was presented as an open question rather than a current policy @teortaxesTex.

Policy & Regulation

Why it matters: The policy signal this cycle was less about sweeping AI laws and more about concrete requirements on how companies govern AI internally and how jurisdictions handle AI infrastructure growth.

Beijing now requires AI ethics committees

New Beijing rules require all Chinese companies engaging in AI activities to establish internal AI ethics committees, effective immediately @vince_chow1. The final version removed earlier wording that made such committees conditional on circumstances @vince_chow1, and the move follows a 2023 ethics review system that had been criticized as too narrow and too perfunctory for AI-specific issues @vince_chow1. One commentator said the plain reading could be especially hard on smaller startups and questioned how it will be enforced @teortaxesTex.

Maine is moving to pause large data-center projects

Maine is on track to become the first U.S. state to pause construction of large data centers—projects over 20 megawatts—until November 2027 while it studies environmental and energy impacts @kimmonismus. Commentary around the move acknowledged concerns about rising electricity costs while arguing that infrastructure limits should not become a blanket brake on AI development @kimmonismus. The linked report is from the Wall Street Journal: Maine data center ban@kimmonismus.

Quick Takes

Why it matters: These smaller items are useful signals for where local deployment, inference optimization, tooling behavior, and public understanding are moving next.*

• A local grounded reasoning demo paired Gemma 4 with Falcon Perception, using Gemma to decide what to inspect and Falcon to return pixel-accurate coordinates; one example checked whether a soccer player was offside, fully local on M3 hardware @dahou_yasser.
• TorchSpec said its kimi-k2.5-eagle3 draft model hit 40K downloads on Hugging Face in two weeks, and vLLM said it adopted the open-source EAGLE3 draft model for low-latency inference on Kimi 2.5@lightseekorg +1.
• A weekend project showed a fully local coding agent using Qwen3.5 30B A3B, llama.cpp/lemonade, ngrok, and OpenHands; the builder said performance was better than expected @gneubig.
• Claude Code now reportedly throws an error when asked to analyze its own source code @theo. Separately, one user said the tool now refuses some system-fixing workflows they previously relied on, while Codex still accepts them @theo +2.
• François Chollet highlighted a tutorial for fine-tuning Gemma on TPU v5 using Kinetic + Keras + JAX, with a quick-start repo here: kinetic-finetuning-on-cloud-tpu@fchollet +1.
• Ryan Greenblatt argued that statements like "AGI is here" or "we’re far from AGI" are not meaningful unless the speaker defines the term being used @RyanPGreenblatt.
• The documentary The AI Doc is now showing in hundreds of theaters, and one commentator said non-technical viewers valued its plain explanation of how LLMs work @slashdot +1.

Today's signal

The clearest pattern today is a split between AI literacy and better judgment. Garry Tan and Bill Gates point readers toward resources that help explain current model capability and uncertainty, while Amol Avasarala and Amjad Masad recommend reading that sharpens mindset, reflection, and decision-making. @garrytan +3

Most compelling recommendation

Newest @steipete / @lexfridman interview

• Content type: Interview @garrytan
• Author/creator: @steipete and @lexfridman @garrytan
• Link/URL: Not provided in the source material
• Who recommended it: Garry Tan @garrytan
• Key takeaway: Tan says it is "probably the best way to catch up to what is really going on" and calls it "a perfect encapsulation of the extreme edge of what is possible now in codegen." @garrytan
• Why it matters: This is the strongest recommendation in today's set because it combines a clear use case—getting up to speed quickly—with a concrete thesis about where the frontier is headed: "just in time smart personal software is here, just not evenly distributed." @garrytan

AI mechanics and limits

How ChatGPT Works

• Content type: Book Ari Melber, Journalist & Attorn…
• Author/creator: Steve Wolfram Ari Melber, Journalist & Attorn…
• Link/URL: Not provided in the source material
• Who recommended it: Bill Gates Ari Melber, Journalist & Attorn…
• Key takeaway: Gates recommends it as a useful resource on language model mechanics, while stressing Wolfram's point that the way these systems represent knowledge is still not fully understood. Ari Melber, Journalist & Attorn…
• Why it matters: The recommendation does more than point to an explainer; it also frames the current limit of expert understanding. Ari Melber, Journalist & Attorn…

Books on mindset and decision quality

Amol Avasarala's recommendations form a coherent mini-list: two books on reframing internal experience, and one on making product decisions more explicitly probabilistic. Lenny's Podcast

The Joy of Living

• Content type: Book Lenny's Podcast
• Author/creator: Yongi Mingya Ringpoche Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: It helps readers think about life experience differently and offers tactics for changing how they think about things. Lenny's Podcast
• Why it matters: Avasarala says he has recommended it repeatedly and that people have "really, really enjoyed it." Lenny's Podcast

Awareness

• Content type: Book Lenny's Podcast
• Author/creator: Anthony DeMello Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: He describes it as offering similar value from a different angle. Lenny's Podcast
• Why it matters: He groups it with The Joy of Living as one of the books he consistently recommends. Lenny's Podcast

Thinking in Bets

• Content type: Book Lenny's Podcast
• Author/creator: Annie Duke Lenny's Podcast
• Link/URL: Not provided in the source material
• Who recommended it: Amol Avasarala Lenny's Podcast
• Key takeaway: It is tactically useful in product because it pushes teams to convert vague timing claims into explicit probability estimates. Lenny's Podcast
• Why it matters: Avasarala gives a concrete operating example: asking for a percentage likelihood instead of accepting "I don't know, it'll get done in time." Lenny's Podcast

Lower-context but still useful

Article on entrepreneurial mindset

• Content type: Article @amasad
• Author/creator: Not provided in the source material
• Link/URL:http://x.com/i/article/2040473188568649728@EntrClub_KAU
• Who recommended it: Amjad Masad @amasad
• Key takeaway: Masad's endorsement is brief but explicit: he called it a "great article" on entrepreneurial mindset. @amasad
• Why it matters: There is less context than the other picks, but this one is immediately accessible through a direct article link. @EntrClub_KAU

Big Ideas

1) AI-native design is not the same as chat-first design

Andrew Chen’s test is simple: stop pitching products as “X but with AI,” and instead ask how the experience would be designed if AI existed from day one @andrewchen.

One thread says some SaaS products are already collapsing dense homepages into a single prompt field, which shifts defensibility from UI complexity to backend strengths like API surface, data model, and integrations Aakash Gupta. That same note points to Snowflake, Databricks, and Stripe as examples of companies that already treated the UI as a thin layer over a deeper engine Aakash Gupta.

A second thread adds an important constraint: many B2B SaaS users still do not want chat as the entry point. They want curated data and tools surfaced for them, and the builder’s job is curation @brettdash_ +1.

Why it matters: PMs should rethink entry points for AI products, but not assume a prompt bar is always the answer.

How to apply:

• Start with the first-value moment: should users see something useful immediately, or ask for it? @brettdash_
• If you simplify the UI, audit what sits behind it: API quality, data model, and integrations become more important Aakash Gupta
• Use AI-native design as the standard, but avoid lazy “existing product + AI” framing @andrewchen

2) In AI products, activation is the highest-leverage growth problem

In the Anthropic interview, activation is framed as critical because day-zero/day-one experience is often the highest-leverage input into long-term retention Lenny's Podcast. The challenge is harder in AI because model capabilities improve so quickly that users often fail to discover what the product can actually do; the interview calls this “capability overhang” Lenny's Podcast.

Anthropic’s response is to ask users who they are and what they care about, then use that information to recommend the right product or feature Lenny's Podcast. The broader claim is that good friction can improve conversion when it personalizes the path to value Lenny's Podcast. Lenny’s summary of the episode labels activation the single highest-leverage growth problem in AI @lennysan.

Why it matters: In AI products, better models do not automatically create better user outcomes. Discovery of value is now a product problem.

How to apply:

• Treat onboarding as routing, not just account creation Lenny's Podcast
• Ask a few high-signal questions early if they help match users to the right feature or workflow Lenny's Podcast
• Judge onboarding by downstream activation and retention, not just time-to-first-screen Lenny's Podcast

3) AI-heavy product orgs may need more PM capacity, not less

Anthropic’s view is that engineers are currently getting the biggest leverage gains from AI tools like Claude Code, with engineering productivity described as roughly 2-3x higher Lenny's Podcast. The consequence is that PMs and designers can end up managing the equivalent of a much larger engineering team, putting those functions under strain Lenny's Podcast.

Their response is not to remove PMs. It is to hire more of them, while also hiring product-minded engineers who can act as mini-PMs on smaller projects Lenny's Podcast +1.

Why it matters: The AI-era org question is not just “how many engineers can one PM support?” It is also “how much product direction and coordination is required when build capacity expands faster than planning capacity?”

How to apply:

• Recalculate PM:engineering ratios if AI tools materially change engineering throughput Lenny's Podcast
• Hire for product-minded engineers who can own small, bounded workstreams Lenny's Podcast
• Move PM focus upward toward direction-setting and cross-functional alignment when execution speed increases Lenny's Podcast

4) In exponential AI products, growth teams are biasing toward bigger swings

Anthropic says AI-first products should spend much more time on larger bets than a traditional growth team would, with roughly 50-70% of effort going to bigger swings instead of mostly small-to-medium optimizations Lenny's Podcast. The reasoning is that if product value is expected to increase dramatically as model capabilities improve, the upside of finding the next major use case can outweigh many small wins Lenny's Podcast. Small optimizations still matter and compound, but they are treated as secondary Lenny's Podcast.

Why it matters: Prioritization rules change when the product’s value curve is changing quickly.

How to apply:

• Keep a portfolio of small experiments, but reserve real capacity for larger product swings Lenny's Podcast
• Use this bias only where product value is truly AI-driven, not as a blanket rule for every software business Lenny's Podcast
• Revisit prioritization often as model capabilities change what is possible Lenny's Podcast

Tactical Playbook

1) Design onboarding with good friction

Anthropic, Masterclass, Mercury, and Calm are all cited as cases where extra steps, quizzes, or broken-out screens improved conversion when they helped users understand why the product was for them Lenny's Podcast.

How to do it:

1. Ask a small number of questions that reveal user intent or identity Lenny's Podcast
2. Use those answers to recommend the right feature, content, or product path Lenny's Podcast
3. Split cognitively heavy forms into smaller steps when needed Lenny's Podcast
4. Remove friction that adds no value, but keep friction that improves relevance and comprehension Lenny's Podcast
5. Validate with conversion and funnel-completion data rather than intuition alone Lenny's Podcast

Why it matters: Faster is not always better. More guided can outperform more minimal when users need help finding value Lenny's Podcast.

2) Match process rigor to project size

Anthropic uses a clear execution rule: if a project is about two engineering weeks or less, the engineer can effectively act as the PM, with the PM advising as needed Lenny's Podcast. Small changes may only need Slack messages and quick back-and-forth, while larger work gets a formal kickoff and, when useful, an AI-generated PRD built from prior examples Lenny's Podcast.

How to do it:

1. Define a size threshold for lightweight vs. heavy process Lenny's Podcast
2. For small work, rely on fast conversation and prototyping instead of default documentation Lenny's Podcast
3. For larger or riskier work, run a cross-functional kickoff with legal, safeguards, and other key stakeholders Lenny's Podcast
4. Use AI to draft PRDs from previous documents when documentation is needed Lenny's Podcast
5. Keep PMs accountable for larger bets and engineers accountable for bounded execution work Lenny's Podcast

Why it matters: Faster building only helps if the process does not bottleneck small work or under-structure high-risk work.

3) Operationalize AI experimentation with a four-stage loop

Anthropic’s CASH initiative breaks experimentation into four parts: identifying opportunities, building, testing against quality and brand bars, and analyzing results after launch Lenny's Podcast. The team scores model performance at each stage and started with narrow use cases like copy changes and minor UI tweaks Lenny's Podcast. Human review is still in the loop, especially for brand-sensitive outputs Lenny's Podcast.

How to do it:

1. Separate the workflow into opportunity identification, build, test, and analysis Lenny's Podcast
2. Measure AI performance at each stage instead of treating “AI experimentation” as one block Lenny's Podcast
3. Start with high-volume, low-scope work such as copy or small UI changes Lenny's Podcast
4. Keep human approval where brand or stakeholder risk is high Lenny's Podcast
5. Track whether time spent is falling and results are improving week over week Lenny's Podcast

Why it matters: AI is already useful in parts of the experimentation loop, but not equally across all parts.

4) Replace siloed growth reviews with one scorecard

A startup founder proposed a PLG Growth Scorecard because growth reviews were fragmented across Mixpanel, Stripe, HubSpot, and spreadsheets, leaving traffic, activation, and MRR disconnected from one another r/startups. The scorecard covers seven self-serve stages: Awareness, Acquisition, Activation, Conversion, Engagement, Retention, and Expansion r/startups.

How to do it:

1. Map your funnel across all seven stages r/startups
2. Assign each metric to a named owner across Marketing, Product, Sales, RevOps, or CS r/startups
3. Add goal and trend tracking for every stage r/startups
4. Choose a North Star metric; the example defaults to Activation Rate r/startups
5. Use the full view to diagnose where the funnel actually leaks r/startups

Why it matters: PMs can make better trade-offs when they can see the full self-serve system, not just the product slice.

Case Studies & Lessons

1) Anthropic: hypergrowth creates “success disasters”

Lenny’s post says Anthropic grew from $1B to $19B ARR in a year and added $6B in ARR in February alone @lennysan. In the interview, Amol Avasare says about 70% of his time goes to what Anthropic calls “success disasters”: urgent scaling problems across acquisition, activation, and monetization created by rapid growth Lenny's Podcast. The remaining 30% goes to more proactive work such as product prioritization, pricing, and new-product funnels Lenny's Podcast.

The team is roughly 40 people, organized with cross-cutting horizontals like growth platform and monetization, plus audience-focused pods for B2B, Claude Code, knowledge workers, and API users Lenny's Podcast.

Key takeaway: At sufficient scale, growth stops looking like a clean experimentation backlog and starts looking like systems management. Org design has to support both firefighting and focused audience work Lenny's Podcast.

2) Mercury: a quarter spent on quality produced a significant onboarding uplift

While at Mercury, Avasare says the team spent an entire quarter fixing onboarding quality for a complex regulated flow and explicitly set aside the usual growth-metric mindset for that period Lenny's Podcast. The result was a significant uplift in onboarding start-to-completion Lenny's Podcast. His broader lesson from that experience is that quality drives growth Lenny's Podcast.

Key takeaway: When a critical flow is broken or confusing, quality work can outperform another quarter of metric chasing Lenny's Podcast.

3) CASH: AI is already useful for narrow, high-volume growth work

Anthropic’s internal CASH effort is still early, but it is already producing results on small-scale experiments such as copy changes and minor UI tweaks Lenny's Podcast. Avasare describes the current win rate as closer to a junior PM than a senior PM, while noting that progress has been rapid and human approval remains in place today Lenny's Podcast.

Key takeaway: The near-term opportunity is not full PM automation. It is targeted automation of repetitive experiment loops where volume is high and risk is manageable Lenny's Podcast.

Career Corner

1) In AI product work, PM advantage comes from tool fluency, adaptability, and interdisciplinary depth

Avasare’s career advice is to stay on top of the tools, understand what each new model release changes, and apply that learning to your own work Lenny's Podcast. He also argues that PMs should lean into their strongest interdisciplinary edge, whether that is design, finance, sales, or something else, because mixed-skill operators become unusually valuable when roles blur Lenny's Podcast. His warning is that 50-70% of old playbooks may no longer apply in AI-heavy environments Lenny's Podcast.

How to apply:

• Build a habit of testing new tools and releases directly Lenny's Podcast
• Double down on the cross-functional skill that makes you unusually useful Lenny's Podcast
• Assume some prior PM habits will need to be rewritten, not merely updated Lenny's Podcast

2) Cold outreach still works when it is specific and tested

Avasare says he got his Anthropic role by cold emailing Mike Krieger, arguing the company needed a growth team Lenny's Podcast. His tactics: use a tested subject line and message, reach out where others are not overwhelming the recipient, keep the pitch short, and follow up multiple times if it matters Lenny's Podcast.

How to apply:

• Lead with a crisp point of view on the company’s need Lenny's Podcast
• Keep the message short: who you are, why you fit, why you should talk Lenny's Podcast
• Follow up persistently when the opportunity matters Lenny's Podcast

3) An adjacent operator role can be a bridge into PM

In one r/ProductManagement thread, a Data Analyst opportunity was described as owning tools, managing data pipelines, fixing bugs, shipping enhancements, and potentially building new capabilities over time r/ProductManagement. A commenter’s advice was to take that role, learn PM while building new capabilities, gradually evolve the work toward full PM scope, then negotiate the title change internally with manager support r/ProductManagement.

How to apply:

• Favor adjacent roles with real ownership over tools or workflows r/ProductManagement
• Start practicing PM as soon as you are shaping new capabilities r/ProductManagement
• Use internal mobility and manager sponsorship to formalize the transition r/ProductManagement

4) When leadership feedback is vague, treat the executive like a user and force clarity

In another r/ProductManagement thread about VP-level expectations, commenters suggested treating the CEO or manager like a user: figure out what they say they want, then uncover the underlying need r/ProductManagement. The practical advice was to define the yardstick for success, run experiments to show course correction, and socialize a draft plan quickly r/ProductManagement +1. Some commenters also recommended getting external coaching from experienced leaders r/ProductManagement +1.

The same thread also raised a warning: vague expectations, unclear KPIs, and treating ambiguity as a failure rather than part of the role can indicate level mismatch or broader trouble r/ProductManagement +1.

How to apply:

• Turn fuzzy feedback into explicit success metrics and review checkpoints r/ProductManagement
• Socialize a draft plan early rather than waiting for perfect clarity r/ProductManagement
• If expectations remain subjective and unstable, treat that as data about fit, not just performance r/ProductManagement +1

Tools & Resources

1) PLG Growth Scorecard

What it is: A unified dashboard across Awareness, Acquisition, Activation, Conversion, Engagement, Retention, and Expansion, with named owners, goals, trends, and a configurable North Star metric r/startups.

Why explore it: It replaces the common “five-dashboard scramble” where traffic, product, and revenue reviews do not line up r/startups.

Try it: Start with Activation Rate if you need one leading indicator, then add cross-stage leak detection r/startups.

2) The CASH experiment loop

What it is: Anthropic’s framework for AI-assisted growth experimentation: identify opportunities, build, test against brand/quality, and analyze outcomes Lenny's Podcast.

Why explore it: It gives PMs a practical way to break AI experimentation into measurable stages instead of treating it as one black box Lenny's Podcast.

Try it: Pilot it on copy changes or small UI tweaks, and keep a human approval step for brand-sensitive output Lenny's Podcast.

3) A lightweight kickoff + AI-generated PRD pattern

What it is: A process pattern where small work happens in Slack and prototypes, while larger work gets a proper kickoff plus a lightweight AI-generated PRD built from prior documents Lenny's Podcast.

Why explore it: It keeps teams from over-documenting small changes while still adding structure where risk is higher Lenny's Podcast.

Try it: Define one size threshold in engineering weeks and one kickoff template for cross-functional work Lenny's Podcast.

4) Loom AI for product demo cleanup

What it is: A tool recommendation from r/startups for automatically trimming pauses and generating transcripts and timestamps for product demos r/startups +1.

Why explore it: Demo editing can take longer than recording; this reduces cleanup time r/startups +1.

Try it: Use it for internal walkthroughs, stakeholder demos, and early customer-facing product tours r/startups.

5) Prototype before you pitch

What it is: Andrew Chen argues that we should hear fewer investor pitches based on a “drawing on a napkin” because, if you can draw it, you can often prompt it into existence now @andrewchen.

Why explore it: The bar for pre-product storytelling is moving toward something interactive or tangible @andrewchen.

Try it: Before a concept review or fundraising conversation, turn the sketch into a thin prototype first @andrewchen.

Builder platforms and deployment

X is repositioning its API for AI agents

The X API was presented as a major update for AI agents and builders, with pay-per-use pricing, native XMCP Server + Xurl support for agents, official Python and TypeScript XDKs, and a free API Playground for simulated testing @XFreeze. X also said purchases can return up to 20% in xAI API credits and pointed developers to docs.x.com@XFreeze.

Why it matters: This is a real packaging change, not just a feature tweak: X is trying to make its real-time data and action surface easier to use as agent infrastructure @XFreeze.

Kreuzberg pushed document intelligence deeper into code workflows

Kreuzberg v4.7.0 introduced tree-sitter-based code intelligence for 248 formats, including AST-level extraction of functions, classes, imports, symbols, and docstrings, with scope-aware chunking for repo analysis, PR review, and codebase indexing r/LocalLLM. The release also reported markdown-quality gains across 23 formats, added a TOON wire format that cuts prompt tokens by 30-50%, and shipped integration as a document backend for OpenWebUI r/LocalLLM.

Why it matters: The project is explicitly positioning itself as infrastructure for agents, with better extraction quality and smaller prompt payloads aimed at making code and document analysis more reliable and cheaper r/LocalLLM.

Project: GitHubr/LocalLLM

Gemma 4 kept picking up local deployment paths

NVIDIA said it is accelerating Gemma 4 for local agentic AI across hardware "from RTX to Spark" r/LocalLLM, and Hugging Face CEO Clement Delangue said Gemma 4 had reached the top spot on Hugging Face @ClementDelangue. Separately, an open-source FPGA project reported roughly 450 tokens per second on an AMD Kria KV260 using a custom 36-core heterogeneous pipeline and a smaller distilled INT4/KAN runtime model, though the team said the quantized weights are still a work in progress r/LocalLLM +1.

Why it matters: The notable signal here is ecosystem traction: vendor support and community experimentation are creating more concrete local and edge paths around Gemma 4 r/LocalLLM +1.

Resources: NVIDIA blogr/LocalLLM · FPGA repor/LocalLLM

Research and evaluation

A pure-Triton MoE kernel posted inference-time wins

A fused MoE dispatch kernel written in pure Triton reported faster forward-pass performance than Stanford's CUDA-optimized Megablocks on Mixtral-8x7B at inference batch sizes, with gains of 131% at 32 tokens and 124% at 128 tokens on A100 r/MachineLearning. The writeup attributes this to fused gate+up projection that removes about 470MB of intermediates and cuts memory traffic by 35%, plus block-scheduled grouped GEMM that handles variable-sized expert batches without padding; tests also passed on AMD MI300X without code changes r/MachineLearning.

Why it matters: This is the kind of low-level serving work that can materially improve MoE deployment efficiency at the inference-relevant batch sizes many teams care about r/MachineLearning.

Code: GitHubr/MachineLearning · Writeup: subhadipmitra.comr/MachineLearning

Reference-free auditing may make hidden behaviors easier to detect

A new AuditBench result used Ridge regression from early-layer to late-layer activations and treated the residuals as candidates for planted behavior, avoiding the need for a clean reference model r/MachineLearning. Reported AUROCs were 0.889 for hardcode_test_cases, 0.844 for animal_welfare, 0.833 for anti_ai_regulation, and 0.800 for secret_loyalty, with 3 of 4 matching or exceeding reference-based methods r/MachineLearning.

Why it matters: The study was small, but it suggests targeted behaviors may be auditable even when a base model is unavailable, which is a practical constraint in many real evaluation settings r/MachineLearning.

Code: GitHubr/MachineLearning · Writeup: Substackr/MachineLearning

AI-native school models are moving from pilots to full operating systems

The biggest signal this week is that AI is starting to define whole learning models, not just classroom tasks. Across Alpha School and Once, AI is being used to restructure time, staffing, and tutoring rather than simply add a chatbot to existing lessons FORGED IN AMERICA PODCAST +1.

Alpha leaders described a mastery-based model where students spend about two hours each morning on AI-driven academics in math, science, and reading, while guides focus on motivation at roughly 1:15, or 1:5 in K-2 FORGED IN AMERICA PODCAST. The system assesses what a student knows, identifies gaps, and generates lessons at the right level; Joe Liemandt said the lesson engine uses the curriculum plus a student’s knowledge graph and interest graph, with cognitive load theory planned for 2026 FORGED IN AMERICA PODCAST +1. Alpha also draws a hard line between guided lesson generation and open-ended academic chatbots, which its leaders argue mostly encourage cheating rather than learning The Knowledge Project Podcast. Operationally, the product goes as far as surfacing a “waste meter” when students skip explanations or use time inefficiently The Knowledge Project Podcast.

In interviews, Alpha leaders reported top 1% standardized-test performance across grades and subjects, an average senior SAT of 1550, and movement from bottom-half entrants to above the 90th percentile within two years The Knowledge Project Podcast +1. Those are school-reported outcomes, and a news segment noted that some educators remain skeptical because AI-based school models are still seen as unproven FORGED IN AMERICA PODCAST.

Expansion is moving on multiple fronts. Liemandt said Alpha would have 25 campuses this year and make Time Back broadly accessible in 2026, while Mackenzie Price said Alpha expected about 50 campuses in 2026 and noted a $1 billion capital commitment from Liemandt The Knowledge Project Podcast +1. Variants are already appearing in specialized formats: Texas Sports Academy says voucher-eligible families can access Alpha academics through its program, and Bennett School pairs two hours of AI-powered learning with elite baseball development @jliemandt +1. Texas Sports Academy has also cited individual gains from 6th- to 11th-grade reading and from the 42nd to the 82nd percentile @malekaimischke.

A narrower, more human-centered implementation comes from Once, which uses AI software to help support staff deliver one-on-one early reading tutoring to children ages 3 to 7 The Future of Education. Its origin story is practical: pandemic-era pilots suggested that 15 minutes of daily tutoring from non-experts could help kindergarten-age children learn to read, and the company is now trying to scale that approach through software inside schools The Future of Education.

The strongest new tools guide process rather than replace it

The most useful product pattern this week was not broader generation. It was more scaffolding.

Microsoft’s Search Progress asks students to evaluate source reputation and consequence while they research, then gives teachers visibility into searches, links opened, and sources saved Microsoft Education. Built with the Digital Inquiry Group, it is explicitly framed as a way to make research thinking visible at a moment when Microsoft argues students’ baseline media-literacy skills are weak and PISA is preparing a 2029 assessment on media and AI literacy Microsoft Education.

Microsoft’s Study and Learn Agent applies the same idea to tutoring. In preview, it shifts Copilot from answer engine to coach: instead of solving a problem outright, it asks what the student has tried, gives just enough explanation to move them forward, and can generate flashcards, quizzes, and study plans grounded in uploaded notes or files Microsoft Education. The limitations are clear too: it is still in preview, requires Copilot Chat to be enabled, and is currently for students 13+ Microsoft Education.

On the teacher workflow side, Microsoft’s free Teach Module is expanding from drafting into modification: aligning activities to recognized standards in 40+ countries and U.S. states, differentiating instructions, adjusting reading level while preserving key terms, and adding real-world examples Microsoft Education. One current constraint is localization: presenters said grade levels are U.S.-based for now and only becoming more localized over the coming months Microsoft Education.

Ellis pushes this scaffolding pattern into educator support. It uses a retrieval-augmented system built on trusted sources such as CAST, Understood, NCLD, Digital Promise, and the Reading League to generate classroom strategies and action plans from a teacher’s scenario Cult of Pedagogy. Its boundaries matter as much as its features: it stores scenarios for follow-up, strips or replaces student names, and stops the conversation when self-harm or suicidal ideation appears, directing educators back to school protocols and crisis supports Cult of Pedagogy.

For self-directed learners, NotebookLM added topic summaries and next-study suggestions after quizzes and flashcards, plus a regenerate option for more practice on selected topics @NotebookLM. At the more advanced end, Andrej Karpathy described using LLMs to compile source materials into a markdown wiki in Obsidian, query it for complex questions, and feed outputs back into the knowledge base — powerful for research, but still, in his words, closer to a “hacky collection of scripts” than a mainstream learning product @karpathy.

Governance is shifting from bans to assignment-level rules and disclosure

Policy is also getting more concrete.

Pineville ISD shifted from “acceptable use” to “responsible use,” arguing that platform-specific rules become obsolete too quickly as AI gets embedded into existing tools techlearning. Its most practical move is an assignment-level AI scale that runs from no AI use to AI-focused projects, with teachers choosing the level per task techlearning. Microsoft is building the same concept into product workflow: Assignments will let teachers mark expected AI use as none, partial, or full, and attach an explicit prompt when full AI use is allowed Microsoft Education.

In higher education, Lance Eaton and Carol Damm’s new transparency framework argues institutions should document their own GenAI use if they expect students to disclose theirs, and that improving export and import features across AI tools could make that record-keeping more realistic AI + Education = Simplified.

The urgency is real. One EdSurge essay cited a May 2025 study finding that 84% of high school students used generative AI for schoolwork, and pointed to reporting on pervasive, undisclosed AI use to grade and give feedback on student writing in some New Orleans schools edsurge. At the institutional level, Google and IDC warned that uneven adoption inside universities is creating a new digital divide: some students get AI-enabled learning and AI safety practice, while others get neither because faculty, departments, and institutions lack a shared strategy Google for Education.

Some institutions are now responding at curriculum level. Purdue is moving toward an AI skills graduation requirement, Ohio State wants every freshman through an AI literacy course, and Microsoft noted that PISA’s 2029 assessment will cover media and AI literacy Google for Education +1.

Governance also has to cover new harms, not just plagiarism. Laura Knight described a recent UK school deepfake incident involving sexualized images of teachers and warned that AI “friend” chatbots can pull vulnerable children toward attachment and monetized intimacy The Edtech Podcast. Her recommendation is less screen-time rhetoric and more scenario-based professional development, peer support, coaching, and digital self-regulation The Edtech Podcast +1.

Research is sharpening the line between useful support and unsafe substitution

Research this week reinforced a simple rule: guided assistance can help, but automation is weak where judgment, relationships, or fairness matter.

Where AI is helping

• In a UK math RCT with 165 students, both human and AI tutors beat written hints; the AI performed slightly better on novel problems and strong Socratic questioning, but human tutors were better at reading emotion and adjusting pace AI in Education Podcast.
• A Wharton and National Taiwan University study of 770 high-school Python learners found proactive adaptive problem selection outperformed reactive chatbots and produced gains equal to 6-9 extra months of learning AI in Education Podcast.
• India’s Shiksha Copilot reduced lesson-plan creation from 45-90 minutes to 15, but the study still emphasized teacher-AI collaboration and found English outputs stronger than local-language ones AI in Education Podcast.

Where caution is warranted

• More AI-driven revision is not automatically better. In a University of Queensland study, hybrid feedback produced more revisions, but all feedback types ended with similar quality, confidence, and grades AI in Education Podcast.
• A Stanford analysis of four LLMs giving feedback on 600 eighth-grade essays found the same writing received different feedback when models were told the student was low ability, high ability, Asian, male, or female; the practical recommendation was to minimize demographic data in prompts AI in Education Podcast.
• Thirteen AI detectors tested on 280,000 student works produced an average 41% false-positive rate on short texts, making them unsafe for high-stakes use AI in Education Podcast.
• Hidden prompt injections still manipulated older and smaller judge models in a new Wharton report, even if most frontier models resisted; Gemini 3 was the only tested frontier model reported as susceptible @emollick +1.
• Chatbots were not a substitute for human contact: in a two-week RCT with 300 first-year students, only daily conversations with another human reduced loneliness; chatbot chats performed no better than journaling AI in Education Podcast.

That is why Justin Reich argues schools should stop looking for universal AI “best practice” and instead run local experiments, compare student work over time, and decide where AI belongs in core versus peripheral curriculum The Learning Future.

What This Means

• For school operators: AI is starting to change schedule design, staffing, and specialization. If you are evaluating new models, pair the claims with local experiments and work-sample review rather than copying operator narratives at face value FORGED IN AMERICA PODCAST +2.
• For teachers and instructional designers: the practical wins are scaffolds and modifications — source evaluation, guided study, differentiated instructions, reading-level adjustment, and lesson planning Microsoft Education +2.
• For higher ed and L&D teams: the middle path is getting clearer. Ethan Mollick describes AI tutors outside class and more exercises, simulations, grading, and reflection inside class, while institutions like Ohio State and Purdue are moving AI literacy into the curriculum itself Solutions with Henry Blodget +1.
• For self-directed learners: source-grounded study is getting better, from NotebookLM’s quiz guidance to LLM-built personal knowledge bases, but the best workflows still depend on curated source sets and active note-building @NotebookLM +1.
• For school leaders and compliance teams: assignment-level AI expectations and disclosure are likely more durable than blanket bans, especially when detector tools still misfire on short student work techlearning +2.
• For buyers and investors: the strongest product signals this week were source grounding, teacher control, privacy boundaries, and human fallback — not broader claims of autonomy Cult of Pedagogy +1.

Watch This Space

• AI-native school expansion. Alpha says Time Back will open more broadly in 2026, and Liemandt says specialized academies are expanding across new schools, sports, and cities The Knowledge Project Podcast +1.
• AI literacy becoming a formal requirement. Purdue is moving to an AI skills graduation requirement, Ohio State wants every freshman through AI literacy, and PISA will assess media and AI literacy in 2029 Google for Education +1.
• Personal study stacks and memory-aware workflows. NotebookLM’s quiz upgrade, author-created llms.txt reading experiences, Karpathy’s LLM wikis, and new work on memory-aware agents all point toward more cumulative, source-bound self-study workflows @NotebookLM +4.
• Student-built learning software. A high school student-built 3D chemistry app prompted Liemandt to predict that students will soon learn from apps built by other students @adxtyahq +1.
• AI-specific safeguarding. Deepfake sexualized imagery and synthetic-intimacy chatbots are likely to push schools toward more explicit AI safety education, not just generic screen-time rules The Edtech Podcast.