ZeroNoise Logo zeronoise
Post
Ravi Mehta: PM-to-engineer ratios measure the organization, not the PM
•
4 min read
• 169 docs
Ravi Mehta argues that cutting PMs doesn't remove the product work. A widely shared r/ProductManagement thread shows what happens when nobody does that work. Also covered: Vistaly's AI rebuild of its opportunity solution tree tool, and new data on what AI subscriptions are worth at API prices.

Fewer PMs doesn't mean less product work

Ravi Mehta argues that a PM-to-engineer ratio "does not measure the PM's talent, bandwidth, or importance. It measures the organization around the PM" . The same 1:30 ratio can mean a founder with a clear strategy and designers close to customers. It can also mean "an exhausted ticket writer" building whatever sales or the loudest customer asks for . When companies treat PMs as overhead and cut them, the job shrinks to execution. Then nobody talks to customers, owns the vision, connects features to outcomes, or protects the quality bar .

His view is that AI "shifts the bottleneck from building products to judging what deserves to ship." So PMs should spend more time deciding direction and probably less time building . He offers a diagnostic built on his 12 product competencies. For each one, ask who is accountable, who contributes, what evidence shows the work is happening, and what would close the gap . The goal is not a target ratio: "You can eliminate the PM role… But the work remains" .

Aakash Gupta's examples of the "full-stack builder" model point the other way. LinkedIn replaced its APM program with an Associate Product Builder program. Rippling's CPO moved planning decks to markdown in a git repo. Some Freshworks teams went from 1 PM per 20 engineers to 1:1 .

Practitioners describe the cost when nobody picks up that work. A widely shared r/ProductManagement thread describes "slop bombs" from adjacent teams. Leadership is pleased by the higher output and asks, "Why do you need to spend time on discovery" . One commenter blames workload more than the tools: PMs are "asked to do multiple PMs worth of work" with no room to think . Another says people stopped reading docs because they can't trust them. A one-pager where every claim has a source or is marked as a guess still gets read . Lenny Rachitsky shared a related line from Marty Cagan: "I did not appreciate the lengths that people would go to in order to avoid thinking" .

Vistaly's AI rebuild of opportunity solution trees

On Just Now Possible, Teresa Torres and Vistaly's founders walk through V2. It is a ground-up rewrite: users upload interviews, get a snapshot of each, and an agentic workflow drafts and updates the opportunity solution tree . Nearly all of V1's functionality was rebuilt in two and a half months, after three years of building V1, and V1 signups were shut off to protect the rewrite . Lessons for AI PMs:

  • Errors compound. If an interview snapshot is wrong, every layer above it inherits the error .
  • Prompt changes run out. Balancing two opposing error modes took a repair loop in the orchestration, not a better prompt. A cheap code check (a node with too many children) screens cases before the costlier LLM judge, and the eval became a production guardrail .
  • Answer first, then correct. Users want the answer and the ability to fix it, not step-by-step collaboration. The hardest problem is helping them understand what changed .
  • Model upgrades aren't drop-in. Prompts are specific to each model and version .

On a similar note, a practitioner told someone switching into AI PM to spend three weeks on evaluation rather than vocabulary. Their advice: decide how you'd judge an agent's output as acceptable, wrong, or needing a human .

Building product sense

Deb Liu argues that product sense is learned through repeated feedback, "a comment on a document or feedback on a slide" . Her warning is that AI makes it easy to skip that loop and never learn from mistakes . Her advice: draft the spec yourself, ask "What is one thing I could have done differently?", and get your reps .

Model and subscription costs

The Product Compass tested models on 105 real bugs. Opus 5.5 nearly matched Fable 5.1 (41.7 vs 43) at two-thirds of the cost . GPT-6.1 Sol was slightly stronger and over 10x cheaper than GPT-5.6 Sol on complex tasks, mostly because it needed fewer turns . Separately, the author used up part of several plans' weekly allowances and priced each model call at public API list prices. The chart puts SuperGrok at 190x its price, Claude Max 20x at 45.3x, and ChatGPT's $100 and $200 plans at 10.25x .

Lenny called a DevDay announcement the "sleeper hit" : ChatGPT subscribers can now use their included usage in more than 16 partner products, including Devin and Notion, by signing in with ChatGPT .

Quick hits

  • GitHub for AI PM candidates. Gupta says AI PM hiring managers check a linked GitHub. His rule: build one small thing a week .
  • "Average Intelligence." Elena Verna: having an average marketer, engineer, analyst, and designer on hand is "better than some of the teams I've had" .
  • Reusable research. Hiten Shah demos a product on Oct 2 that carries findings across tasks, so a competitor's packaging change found in a pricing review doesn't have to be re-explained for a launch .
Ravi Mehta: PM-to-engineer ratios measure the organization, not the PM
Teresa Torres
Profile
  • Vistaly rebuilt V2 around AI rather than layering AI onto V1, turned off V1 signups to focus on the new product, and reached early alpha users in 2.5 months. V2 turns three interviews into individual snapshots and an initial opportunity solution tree (OST), then synthesizes later interviews into tree updates. V2 also replaced V1’s overwhelming view of all OSTs with separate opportunity spaces; Teresa describes a company-wide KPI tree with a separate OST for each outcome as a more manageable model.
  • Vistaly found that guided AI chat reviewing insights one at a time felt slow, so it shifted toward automatically extracting insights and linking them to the tree. Teresa’s observation was that many teams skip rigorous synthesis because it is difficult; in that context, AI doing the synthesis can improve on shallow synthesis, though the team is still exploring how to support collaboration and corrections.
  • Tree quality depends on multiple analysis layers, from identifying key moments and opportunities in each interview to consolidating them across interviews. Vistaly encountered leading questions, non-interview transcripts, and apparently synthetic transcripts, prompting concern that weak evidence could produce trees that look authoritative; Teresa raised the possibility of flagging weak signals and coaching users toward better interviews.
  • Teresa’s tree-generation evaluation found that prompt changes alone could not balance adding useful subgroups with framing their parent opportunities well. A targeted repair loop for nodes with too many children let the team address subgrouping separately from parent framing.
  • As trees grow, users need to understand what changed rather than reread the entire tree, but large updates can be difficult to review as a dense set of changes. Vistaly was still working out how to give users a useful overview while allowing them to correct changes, and identified rollback/versioning as important when agents edit shared trees.
Opportunity Solution Trees Built by AI: Inside Vistaly's Rebuild
The Product Compass
  • In a two-repository test of 105 bugs that frontier models had missed, Opus 5.5 scored 41.7 versus Fable 5.1’s 43 for $58.53 versus $87.18; the newsletter also reports GPT-6.1 Sol as slightly stronger and over 10× cheaper than GPT-5.6 Sol on complex tasks, with fewer turns contributing to the cost difference. Its cache reads were 4× cheaper under a 95% discount the author said might be temporary.
  • Sonnet 5.5 max scored 51.3/105, but used 1,497 turns over 287 minutes versus GPT-6 Astra’s 270 turns over 90 minutes; the author cautions that this run was too slow and expensive for agentic coding and its gains may not carry over to standard tasks.
  • Pricing model calls from a slice of several plans’ weekly allowances at public API list prices, the newsletter reports API-value multiples of 190× for SuperGrok, 114× for Muse Code High Usage (Contributor), 45.3× for Claude Max 20×, and 10.25× for ChatGPT’s $100/$200 plans. These are sample-based figures; the exact Claude Max 20× allowance is unknown, and its multiplier applies to a five-hour window. The author notes that Meta’s Contributor option involves sharing data with Meta.
Stop Overpaying for Your AI Subscription: GPT-6.1 Sol, Sonnet 5.5, Opus 5.5
Teresa Torres
  • Vistaly’s V2 is a ground-up rebuild of its continuous-discovery canvas: users upload interviews, get an individual snapshot for each, then use an agentic workflow to draft and update an opportunity solution tree. The team rebuilt nearly all V1 functionality in two and a half months after a three-year build, and stopped V1 signups to protect the rewrite.
  • AI reliability depends on the whole analysis chain: an incorrect interview snapshot propagates into the tree. Vistaly tested four evals across 16 variants to address a tradeoff between missing subgroupings and badly framed parent opportunities; it used a code assertion as a cheap prefilter before an LLM judge, then fixed the seesaw with an orchestration-level agentic repair loop rather than prompt changes, turning the eval into a production guardrail.
  • Vistaly’s UX approach is answer-first correction, not step-by-step AI collaboration. It taught the agent to log semantic moves such as merge, move, and reframe because a final tree diff can have multiple valid interpretations; helping users understand what changed remains the hardest problem.
  • Data-residency requirements pushed Vistaly to Bedrock, including EU-hosted inference for European customers; model upgrades are not drop-in because prompts vary by model and version, and Bedrock imposes independent token limits.
What happens when you hand your opportunity solution tree to an AI? Vistaly rebuilt its entire product to find out—and the agents were th…
Shreyas Doshi

Shreyas Doshi shared a free private playlist of 23 candid career Q&A videos, including guidance topics relevant to PMs: promotion to Director, choosing between IC and people-management paths, setting vision and roadmaps without deep domain knowledge, building credibility and visibility, and why startup PMs may have short tenures.

Announcing a brand new private resource: this is a playlist of 23 super candid videos of mine, with answers to your real career questions… If it is useful to know, this private playlist provides deep, super-candid answers for the following 23 questions, with 1 video for each …
Product Management - The place for all things product

A software engineer with about two years of mainly frontend experience landed a PM internship at a well-known B2B SaaS startup without focused PM preparation. They worry about full-time conversion because former interns reportedly did not transition when headcount was unavailable, and say they need to build core PM skills from scratch. They applied directly, drew on startup experience for a basic understanding of PM, and kept interviewing while learning what was going wrong, but still struggle with APM interviews.

Leaving full time role for PM internship Applied directly. I come from a startup so I have a fair understanding of what PM does here (that helped). Also, I didn’t prepare specifi…
Lenny Rachitsky

Marty Cagan says fundamentally good product work is about thinking, and he was struck by how far people go to avoid it. The full talk is linked here.

Marty Cagan: "Fundamentally good product work is about thinking. I did not appreciate the lengths that people would go to in order to avo… Watch the full talk here [https://www.youtube.com/watch?v=fF3lkTCM5-c](https://www.youtube.com/watch?v=fF3lkTCM5-c)
Ravi on Product
  • A PM-to-engineer ratio does not measure a PM’s talent or importance; it reflects how product work is distributed. A high ratio can coexist with a strong culture where other functions share product work, or with a weak one where PMs are reduced to execution and nobody owns customer insight, vision, business outcomes, or quality.
  • AI can accelerate coding, research synthesis, prototyping, and specification writing, shifting the bottleneck from building to judging what merits shipping. As building gets faster, customer understanding, strategy, quality, and judgment become more important—not less.
  • PM roles can be eliminated or responsibilities distributed, but the work remains. Treat the 12 competencies as work a product organization must do: identify who is accountable, who contributes, what evidence shows it is happening, and where gaps need to be closed; the goal is not a target PM-to-engineer ratio.
Product management is not optional
Masters of Scale
  • As media choices expanded, KCRW shifted its focus from making media to building a community, asking what would keep people connected and make them care enough to support it.
  • KCRW resists assuming public radio should be boring and pairs journalism with cultural and entertaining material; Ferro argues fact-based media must be made as interesting and exciting as competing offerings.
  • Apply a candid quality bar: say when an offering is boring, make hard decisions, and move on from what is not working to try something new.
Don't be boring: KCRW's Jennifer Ferro on building a brand people love
Lenny Rachitsky

Elena Verna characterizes current AI as “Average Intelligence,” rather than AGI: having average-level marketing, engineering, analytics, and design help readily available is still highly powerful, and she says it can be better than some teams she has worked with.

.@ElenaVerna: "AI = Average Intelligence. I'm sure we'll get to AGI someday, but for now, it's still super powerful to have at your finge…
Perspectives

Product sense develops through repeated exposure to quality and feedback, not a fixed checklist; feedback on documents and slides helped the author build judgment. To strengthen that judgment, PMs should draft specs and presentations themselves, ask for small, frequent, honest feedback, and keep shipping to build experience. As AI makes it easier to outsource work, skipping the feedback loop can leave mistakes uncorrected and hinder learning.

Chicken Sexing: How to Build Expertise One Tap at a Time
Lenny Rachitsky

Lenny Rachitsky called ChatGPT subscription access across partner products a “sleeper hit” from DevDay. Subscribers can use their included usage in more than 16 partner products, including Devin, OpenCode, and Notion, by signing in with ChatGPT.

The sleeper hit from DevDay [https://x.com/thsottiaux/status/2105006253986738615](https://x.com/thsottiaux/status/2105006253986738615) You can now use your ChatGPT subscription directly in over 16 partners products. No little rules, you can just use all your included usag…
Hiten Shah

The product concept is to preserve useful work when the question changes: a competitor packaging change found during a pricing review should carry into launch planning without needing to be explained again. The post says the product would be demonstrated tomorrow at 10 AM PT.

The work shouldn't reset just because the question changed. A pricing review might find that a competitor changed its packaging. When you…
Product Management

A PM managing two designers and 10 engineers said one designer on future initiatives gave updates only in 1:1s and seemed to be progressing slowly. Replies advised asking directly for progress on a regular cadence and probing timeline concerns; one commenter stressed that delivery outcomes remain the PM’s responsibility and suggested escalating if the designer is unresponsive or still not meeting expectations. A weekly show-and-tell where the designer brings deliverables was suggested as a concrete checkpoint.

PM/designer ratio Not designers… because god I haven’t had one in months now… but direct reports in general… have you just simply asked them? Maybe ask for… > Why would it be my responsibility to ask for an update when we agreed on a deliverable? Because the results are your responsibility. It… Schedule a weekly check-in meeting with them at the start of your day, and have them bring their deliverables . . . in other words this i…
  • Docset differentiates itself from conventional VPNs with a managed mesh network: its founder says it spans 196 domains outside the public internet and lets users register domains, lease addresses, and set policy; it supports encrypted peer-to-peer calling, video, and chat . The founder says transfers run directly between phones without a server in the middle, with 20 GB given as an example .
  • Its onboarding hides cryptographic complexity behind a familiar friend-invite flow: users solve a puzzle to prove they are human, receive a token, and share a certificate; trusting a friend unlocks direct phone-to-phone features .
Why One Internet Pioneer Thinks the Original Model Broke
Product Management
  • An early-stage B2B SaaS team approaching its fourth or fifth customer had three backend engineers, one frontend engineer, and shared quality work across developers, product/ops testing, and founder validation, with automated tests used where possible; the founder’s concern was whether growing workflow complexity and edge-case costs would outstrip that model.
  • One proposed signal for hiring QA was an increase in corrections after validation as workflows and customers grow, particularly problems at the edges between workflows. The commenter recommended writing acceptance criteria before development, with developers testing their work and QA validating against the criteria and looking across the system.
  • Counterpoint: a commenter argued against adding dedicated QA by default, warning that it can create handoffs and weaken shared ownership; they described a 60-engineer, ten-team organization with no QAs and quality owned by product teams. Another commenter recommended investing early in test automation, including end-to-end tests, while keeping quality, scalability, and performance with the builders.
When to start hiring QA engineer in a B2B SaaS company? What should be the skill tree for our team? A signal you can watch from now is how many features come back with corrections after you or your Product and Ops Associate test them, an… You don't need a dedicated QA engineer. In a modern development workflow your engineers and product people all need to take responsibilit… 100% agree. OP, invest early and heavily in test automation. Don’t forget e2e tests. If you are building a web app look into Playwright o…
Hiten Shah

Hiten Shah open-sourced 16 competitive-intelligence skills for AI, covering market briefings, positioning, pricing, launches, battlecards, deal prep, and win/loss; each skill teaches a different method . He teased a product built around the skills that would let those methods draw on market knowledge, but did not yet describe the product .

I just open-sourced 16 competitive intelligence skills. They cover market briefings, positioning, pricing, launches, battlecards, deal pr…
Product Management
  • PMs in the discussion report that AI-driven speed expectations alongside reduced staffing and heavier workloads can produce poorly validated PRDs and features, leaving teams to decipher proposals and start discovery under pressure. One commenter argues the core problem is being asked to do multiple PMs’ work without time to think, rather than AI itself.
  • Suggested quality controls include requiring discovery or validation before supporting use cases, scoring AI-generated PRDs or other assets and requiring human review before approval, and making one-pagers distinguish sourced claims from guesses.
  • A complementary way to use AI is to organize customer evidence and connect roadmap recommendations to measurable revenue impact—such as churn reasons or lost sales—so teams can prioritize engineering time rather than simply increase feature throughput.
New age of product management is depressing Reading between the lines, I assume you’re not in Product? The unfortunate reality is that many orgs have reduced headcount and put their… I think the worst thing is that in my company, we have pushed so hard for greater velocity, that we’re now effectively a feature house wh… I've kinda just stopped responding to slop grenade documents (and/or supporting use cases that haven't had some level of discovery/valida… Consider your org might not be strategically approaching AI. If you’re seeing a lot of garbage/slop then you probably don’t have the righ… Same. I come from a culture where decisions got made on written docs, and experienced eyes can spot slop fast. I think people stopped rea… I don't think of it that way... I see the augment... Using AI to attribute and count evidence, so your roadmap recommendations are backed…
Product Management - The place for all things product

For a three-week AI product management upskilling plan, prioritize evaluating outputs over learning vocabulary: choose an agent task and define what counts as acceptable, wrong, or requiring human review. A practitioner in deep-domain B2B says this evaluation question takes most of their time, with the jargon following from it.

From MBB to AI Product manager, tell me best way to upskill myself in the next 3 weeks Three weeks is better spent on evaluation than on vocabulary. Take one task your agents do and work out how you would judge an output acc…
Hiten Shah

Hiten Shah open-sourced 16 competitive-intelligence skills and said he would show a product built around them, with the aim of reusing market knowledge as the work changes instead of relearning the market each time.

I open-sourced 16 competitive intelligence skills yesterday. Here's some of the work they cover. Tomorrow I’m showing the product around …