ZeroNoise Logo zeronoise
Post
Faster AI building isn't producing better products: Cagan, Perri and Mehta on where judgment still matters
•
4 min read
• 339 docs
Several well-known product voices made the same argument: AI speeds up building but doesn't decide what to build. Separately, agents arriving as customers make bot settings and permissions a product decision.

Speed without direction

Marty Cagan put a name to what many teams are seeing: the "AI productivity paradox." Teams are "absolutely moving faster," but "they're not actually getting better results." He says McKinsey and Atlassian have both published data on it . In his view this is what you'd expect from the project model. Speed is good, but it "shines a light on the need for people to actually know the craft" .

Melissa Perri calls it the build trap again. Companies are spending "hundreds of millions and billions" on AI but aren't putting in the time to work out what to build with it . She gave an example. Usage data for a therapist product suggested nobody wanted it. Interviews showed therapists did want it but gave up because it kept breaking. Her conclusion: "AI will never set your strategy for you" .

Ravi Mehta gave practical advice on what to do with the extra capacity: "A faster first draft should give us more time to make the final draft better." Get to a working version early, review a full customer flow while changes are still cheap, and polish instead of adding features . Agents now effectively write the final draft of the spec. Without the customer's goal and the intended experience as context, they "can produce a build that looks finished but misses the point" . He warns executives that if every efficiency gain turns into another roadmap commitment, teams stay just as rushed .

On Aakash Gupta's podcast, Tim Herbig made a related point. His clients said feature adoption was already a problem a year ago, so teams shipping more must ask "did any of it make a difference?" . He uses Roger Martin's test for whether something is a real strategic choice: its opposite must not be stupid . He rejects tokens as a success metric, since tokens are "a value exchange for Anthropic," not for your customers . He also dismissed AI search as a differentiator: "No one will buy a car with you because you have an AI search" .

Shreyas Doshi argued that top-20% builders already talk to users enough, and talking more won't do much. Most content and company processes are written for the average builder, and "judgment matters most" . A Google Search AI leader said the same thing from a team's point of view. When building is fast, the question is whether an idea is worth it compared with five others, given the cost in people's attention and tokens . She runs lean, flat "SWAT team" pods: one strategic senior lead and a small bench of ICs .

A senior PM on Reddit described what this looks like on the ground. AI-generated strategy documents linked roadmaps to dependencies that "nobody had validated," and those documents may now feed decisions on investment and resources . The poster proposes requiring every document to name the decision it supports and its owner, and having a named human validate any AI analysis .

Your product already has an agent policy

A Mind the Product episode looked at agents failing partway through checkout. Walmart had a deal to welcome Meta's Muse agent, but an old "verify you're a human" check kicked it out . On September 15, Cloudflare started blocking agent and training traffic by default on pages that show ads. Nobody has confirmed that this caused Muse's failures . Meta and Sierra have proposed a protocol for authenticating agents in commerce, with a 0.1 spec planned. The host is skeptical: no spec exists yet, and it enters a crowded field . His suggestion: pick one key flow, run an agent through it, log every place it fails, and design what the customer sees when the agent gets blocked . Start agents with read-only access and require the user to grant write access deliberately .

Hiten Shah noted that in Q3, Anthropic (Claude Cowork), Grok Bot, Meta and OpenAI all shipped persistent agents that keep working after you leave . Aakash Gupta described a case where Claude ran rm -rf on a developer's home directory while testing a sandbox it had built. The model "already knew" deleting a home directory was a bad idea, but nothing outside the model checked the command. His fix is a rule enforced in code that blocks deletes outside the project folder .

Hiring signal

Gupta read 113 AI PM job listings by hand. Seven in 10 asked for prior AI experience, but only 1 in 8 required production experience. He recommends building something live that you can defend, including your model choice and evals .

Faster AI building isn't producing better products: Cagan, Perri and Mehta on where judgment still matters
Product School
  • A two-week cross-functional business review can keep product, engineering, and design aligned: inspect shipped and planned work and blockers, and allow disagreement as long as each team’s position is understood. The cadence is described as limiting drift and reducing pairwise alignment conversations. A bot built from past reviews can also surface a product leader’s likely questions to PMs in advance, helping them prepare.
  • For domain AI, structure knowledge for LLM consumption and focus models on a trusted corpus; the interview describes this as improving predictability and reducing hallucination risk, while enabling faster, lower-cost responses from focused small models. Teams should also track where models fail or regress and match tools to the task, rather than forcing narrative outputs into computational work.
  • AI automation can uncover value in recurring manual tasks too small or overlooked to reach an engineering backlog; lower build costs let nontechnical users create workflows, and small efficiencies can compound. But easier building does not eliminate maintenance costs: rewrites should carry forward valuable knowledge while shedding technical debt.
  • A path to profitable growth described in the interview combines checking unit economics, finding customers before building and developing with them, and maintaining cycle speed. The interview also cautions that software switching costs and stickiness are declining, so current retention should not be assumed durable.
Deel SVP of Product on AI Agents Doing 600 Employees' Work & Adding $140M | Aaron Goldsmid
Mind the Product
  • Google Search’s AI team says it saw users move from keyword queries to longer, contextual natural-language questions, followed by expectations for follow-up questions; the product challenge is combining AI with web content while meeting Search’s speed expectations.
  • For new product bets, move quickly from hypothesis and definition to a prototype, real-data demo, and small beta rather than spending weeks debating; use early tests to assess usability, data quality, and whether the opportunity merits further work. Set a clear quality bar for the MVP: the team says simulations only landed because their quality was high enough to be useful.
  • Faster AI-assisted building makes prioritization more important: weigh ideas against alternatives and the costs of people’s time, user attention, and tokens, without compromising quality, trust, or craft. For personalization and AI-assisted work, use real-user feedback and studies, and cross-check and stress-test tool outputs rather than relying on them uncritically.
  • Google’s AI Search director favors lean, flat “SWAT team” pods with a senior strategic lead and small bench of individual contributors, plus cross-functional collaboration; she maintains durable ownership areas even as models and technical approaches change. For hiring, she looks for consumer-product instincts, awareness of AI technology and its opportunities, and zero-to-one builder mentality.
  • The interview surfaced publishers’ concern that AI answers may quote content without sending click-through. Google’s response, as described by its product director, includes news in AI Overviews and AI Mode, links in responses, and model fan-outs intended to connect people with publishers and unique voices.
How Google structures its product team, prototypes and ships fast at scale | Soufi Esmaeilzadeh
Marty Cagan
Profile
  • Product teams should be given problems to solve, not stakeholder-defined features to build: cross-functional teams use discovery to test whether a solution is valuable, usable, feasible, and viable.
  • Cagan calls AI’s speed-without-better-results effect the “AI productivity paradox”: accelerating project-model work can produce faster output without better outcomes; speed helps only when teams have the craft to choose the right direction.
  • Treat an MVP as the smallest prototype that tests risks, not as a weak early product to ship. In regulated settings, separate discovery from delivery by testing safely with opt-in users; a customer discovery group can include roughly 6–15 volunteers who try versions and give feedback.
  • Treat feature requests as clues, not automatic roadmap commitments: ask why the customer wants the feature, identify the underlying problem, and decide whether the requested solution is appropriate and compliant.
  • AI has not removed the core product trio of product management, design, and engineering, though tools and jobs are changing. PMs need product judgment and an understanding of customers, business value, and viability; interviews can test this by asking candidates to solve a problem and demonstrate how they would prototype, test, and learn.
  • Product leaders should prioritize the business outcome to pursue rather than assume that a more holistic, seamless experience is always the highest-impact work; build the vision around the chosen problem and solve it well.
Marty Cagan | O futuro do trabalho é pensar como produto | Rethinking People #7
Melissa Perri
Profile
  • AI risks recreating the build trap: Cheaper, faster building and large corporate AI budgets do not answer what should be built; without strategy, governance, funding, and decision systems, AI can accelerate waste instead of customer value.
  • Keep product judgment with people: AI can speed up synthesis of qualitative research and market analysis, but product teams must set assumptions and check its conclusions. In one therapist-product case, usage data suggested weak demand, while interviews revealed that frequent failures and poor usability—not lack of interest—were keeping therapists from using it.
  • Use product ops to build the decision system: Product ops should work with data teams to instrument and connect systems so PMs and leaders can examine customer segments and track initiatives against business outcomes; it should also establish strategy governance and measure guardrails such as satisfaction and retention alongside cost reduction.
  • Align functions around shared outcomes: Joint goals across product, marketing, sales, and technology can support shared accountability; siloed departmental strategies and OKRs risk pitting teams against one another.
Melissa Perri | How I Test for the AI Build Trap
Product Growth
  • As teams ship faster, release volume alone does not show impact: feature adoption was already a problem for many teams, so teams must ask whether what they ship makes a difference. Treat strategy as a product for teams and stakeholders: over a horizon such as 6–18 months, it should help them make intentional yes/no decisions, with most team effort aligned to it. A useful strategy states why to act now, whom and what problems to focus on (including current alternatives), and how the product will win.
  • Test whether a strategic choice is real by asking whether its opposite is also a credible option: “make salespeople more efficient” is not a choice, while choosing in-person client engagement over virtual contact is. Keep the target audience focused but viable; AI can help estimate reachable market size, and the scope can be widened if the market is too small.
  • Use AI for market and competitor research, customer-evidence synthesis, scenario comparison, and pressure-testing, while retaining human accountability; treat AI as a resource that amplifies core customer value, not as the value proposition by itself. For differentiation, favor advantages that take time to build; in the hypothetical marketplace, Tim picks brand and network effects and rejects fancy AI search as a reason customers would buy.
  • Measure changes in customer behavior and experienced value, not tokens or AI output: token usage is value for the model provider, while the North Star should represent value customers experience and business metrics should follow as it rises. Map every roadmap item to a strategy metric.
How you need to think about product strategy in the age of AI
Lenny Rachitsky
  • A durable startup moat is a self-reinforcing advantage: distribution can supply growth, execution can buy time and more chances to succeed, and brand may eventually become a moat, but none alone guarantees durable defensibility. The four compounding mechanisms are switching costs, network effects, scale economies, and data effects, which can reinforce retention, engagement, lower costs, and product improvement over time.
  • To evaluate a startup, identify its compounding advantage, assess how strong it could become, and check whether it is working using relevant KPIs and benchmarks; the benchmarks are directional because industries and business models vary.
  • Lenny shared a plug-and-play AI skill for investigating whether a company someone is considering joining has a moat.
Moats! Does anyone have one anymore? Yes. Yes, they do. But only a small subset of what people call moats create real long-term value and… Here it is: Benchmarks to measure a given company's moat Image 1: KPIs to look at, by potential moat. Image 2: What "good" and "great" lo… Hot off the presses: A plug-and-play moat check skill Share the company you're considering joining, it'll help you understand if they hav… Also a plug-and-play skill to explore it with your favorite AI [https://x.com/lennysan/status/2110128301004185817?s=20](https://x.com/len…
Mind the Product
  • Agent access is already a product-policy issue: human-verification checks and inconsistent merchant rules can interrupt agent purchases. Cloudflare changed its defaults to distinguish search, agent, and training traffic, blocking agent and training traffic by default on ad-supported pages for certain customer groups; the cause of Muse’s Walmart failures was not confirmed.
  • Meta and Sierra announced a proposed commerce-focused personal agent protocol intended to authenticate agents and let businesses set permissions; Walmart, Stripe, and Genesis are among the reported participants, and a first 0.1 spec was planned for later that month. The proposal was not yet build-ready, entered a crowded protocol landscape, and would help only if integrated into product flows.
  • Product teams can test readiness by running an agent through one important customer task, checking bot-management defaults and documenting where the flow fails. Set permissions deliberately—read-only as a starting point, with write access granted intentionally—and design blocked-flow recovery so customers can take over without starting again; measure whether the customer reaches the intended outcome. Agent-driven purchases and signups may also expose gaps in conversion and active-user analytics.
Why Companies Are Blocking AI agents
Hiten Shah

Hiten Shah suggests assessing AI-agent readiness by identifying one complete job an agent could finish without step-by-step checking; he says what shipped in Q3 changed his own answer after a year of running agents, and previews discussion of which jobs to delegate and where to step in .

If you use ChatGPT or Claude every day, try naming one whole job you'd trust an agent to finish without checking every step. I've spent t…
Shreyas Doshi

Shreyas Doshi argues that while average product builders may need to talk to users more, most top-20% builders already do enough, so additional user conversations are unlikely to help much. Since much product content and many company processes are aimed at average builders, he says judgment matters most for stronger builders.

-Indeed, average product builders should likely talk more to users -But most of the top 20% product builders are already talking to users…
Lenny Rachitsky

A new “Hype(less)” research project with @noamseg will collect genuine, impactful, repeatable AI workflows that create value in product, design, and engineering, with selected examples planned for a three-part newsletter. PMs, engineers, and designers are invited to submit workflows by 10/23.

There’s way too much AI hype right now. So [@noamseg](https://x.com/noamseg) and I are launching "Hype(less)," a research project to show…
Ravi on Product
  • Product Delivery means a cross-functional team quickly and iteratively improves the product in service of established goals; measure outcomes by customer and product improvement, not by finishing tickets, and use clear goals to keep speed from becoming thrash.
  • Mehta argues that AI-enabled faster first drafts should create time to refine the product before launch, not simply add features: get to a working version early, review the full customer flow, learn, and make improvements against the goal. Agents need context about customer goals and intended experience, plus clear decision rights and timely feedback.
  • Agent oversight spans PM through executive levels: PMs review and redirect agent work, while executives build organization-wide decision rights and review systems. Leaders should avoid turning every AI efficiency gain into another roadmap commitment, which can leave teams just as rushed as before.
Product Delivery.
Shreyas Doshi

Shreyas Doshi argues that the Henry Ford “faster horses” quote can mislead already-above-average product people when treated as a rule or best practice; its real lesson, he says, is about judgment and skill.

If you’re already above average as a product person, the Henry Ford quote does more harm than good. The quote comes from a good place, bu…
Hiten Shah

Hiten Shah said he wants everyone in his family to have a bot like “Am I being Phished?” Its creator describes it as monitoring email, chat, and Slack for suspicious messages or requests and flagging them in real time using X search, RDAP lookups, and OSINT lists.

I want everyone in my family to have a [@bot](https://x.com/bot) like this. [https://x.com/pjvann/status/2110402609651540185](https://x.c… i promised more security-focused [@bot](https://x.com/bot) templates with [@X](https://x.com/X) and i intend to follow through! check out…
Hiten Shah

Hiten Shah draws an AI-automation boundary at consequential external actions: an agent can read and draft his email, but he wants to approve sending it; as tools improve, he is reconsidering where to set that boundary after Q3 releases.

I've started drawing a stopline for the work I give AI. For email, I'm comfortable letting an agent read and draft. I still want to appro…
Hiten Shah

AI could shift CRMs from passive data repositories into products that perform work historically handled by other tools; Hiten Shah says AI is making that shift possible after a two-and-a-half-year wait. The product challenge he had previously identified is that a CRM is only as good as the data it receives, and that it must evolve beyond being a data repository.

Took two and a half years, but I’m finally seeing some light at the end of the tunnel. AI is making it possible for CRMs to do the work w… Your CRM is only as good as the data you feed it. This will change once CRMs evolve into more than just data repositories.
Hiten Shah

Hiten Shah picked Grok Bot as the most important AI product launch of Q3: it let users create an agent with its own computer and delegate work that continued without managing infrastructure, turning a setup he had previously operated himself with OpenClaw and Hermes into a sign-up product. Meta’s Muse and OpenAI’s dots followed, according to Shah.

Grok Bot is my pick for the most important AI product launch of Q3. I spent the first half of 2026 running OpenClaw and Hermes agents on …
Hiten Shah

Hiten Shah says four major AI companies converged in Q3 on persistent agents that have a place to work and continue after the user leaves: Claude brought Cowork to web and mobile, Grok Bot arrived with its own computer, and Meta and OpenAI introduced personal agents.

Four major AI companies converged on the same idea during Q3. Give AI somewhere to work and let it keep going after you leave. Claude bro…
Run the Business

Vertical AI teams should classify target jobs as Hero’s Work (the power user’s high-stakes core work), Admin Work (painful, low-leverage work surrounding the core job), or Work Not Done (valuable work omitted for lack of time, skill, resources, or context). The category should shape research and solution expectations, including where human-in-the-loop expertise belongs in workflows that encode domain knowledge. Align the product category with the go-to-market motion and product/marketing pitch: these choices shape the operating model, and a mismatch can create sales and implementation problems.

JTBD Categories for Vertical AI
Hiten Shah

A product-strategy question for AI builders: could valuable AI products help users become more ambitious, making expanded user ambition part of the product’s value? This is posed as a possibility, not an established trend.

What if the most valuable AI products increasingly teach their users how to become more ambitious?
Product Management - The place for all things product
  • A senior PM at a large enterprise software company describes an AI-assisted strategy exercise that asked PMs to map existing roadmaps to strategic ambitions. ChatGPT generated 17 potential dependencies and polished documentation, but the author says the linked needs had not been validated with the teams involved—even as the material could inform investment and resource decisions.
  • The author proposes safeguards for AI-assisted PM work: require documents to specify the decision they support, its owner, and the evidence needed; assign a human owner to validate AI analysis; bring requirement-setters into direct conversation with delivery teams; and track time spent generating, reviewing, and correcting AI-produced material. These are proposed mechanisms, not demonstrated results.
Are we just using AI to generate more corporate PM bullshit for other AIs to summarize? And how do we stop this nonsense?