We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Top pick: Satya Nadella, "Models as Insider Risks in the Super Intelligence Era"
Microsoft's CEO published this essay on X. It argues that because we can't trace model behavior the way we trace code, we "need to separate the supply of intelligence from the authority over it" . The essay proposes treating closed and open-weight models as insider risks, "Not because they are necessarily malicious," but because any capable actor can make mistakes or be compromised . It lists principles including model diversity, tamper-proof logging, independent controls and audits, and containment. It closes with: "The most trustworthy Super Intelligence system will not be the one with the model we trust most. It will be the one that enables us to trust the model the least" .
Four people endorsed it, each for a different reason:
- Chamath Palihapitiya called it "very important observations." His takeaway: as models commoditize, "intent, verification and evidence" will decide how fast AI spreads through enterprises. He thinks a new system of record may emerge to map changes back to SOPs, policies and laws .
- Aaron Levie called it a "Good post" for thinking about enterprise safety. In his words, AI will need its own "zero trust" era like the one security went through, which is "a huge opportunity right now for those building such systems" .
- David Sacks wrote "Satya is right." He uses the essay to contrast engineering controls with Anthropic-style "alignment," arguing that models should be treated as "insider risks, not moral patients" .
- Elon Musk: "Interesting piece from CEO of Microsoft" .
Tobi Lütke: Patrick Collison's thread on agents in the economy
The last brief covered Matt Mullenweg's reply to this thread. This time Lütke called it a "Great read from Patrick, as always." He singled out one line, "Personal agents will, I think, act as a kind of structural subsidy for product quality," and added "Yes, and well put" . Collison's argument is that if agents research every purchase, improving the product becomes a more effective strategy than winning on distribution . Thread
Patrick Collison: Grossman's Life and Fate over The Brothers Karamazov
In a long post, Collison admits he "did not love" Dostoyevsky's Karamazov . He offers Vasily Grossman's Life and Fate as "maybe a useful counterpoint," because it "shows actual people confronting great wickedness" while the Karamazovs are "never tested" . In his reading, Grossman rejects any providential resolution and argues "humanistically, that we should be kind just because" .
Aaron Levie: Prime Intellect's agent-swarm post
Levie shared Prime Intellect's post with "If you want to know where all the tokens will get consumed in the future, here it is." His reasoning is that agents can parallelize work in ways human teams can't, "This is why we're going to need 1,000X more compute" .
Shorter mentions
- Sarah Guo promoted the new No Priors episode (her own podcast) with Reflection AI cofounder Misha Laskin. It covers China, safety, open-model business models, distillation and shipping frontier AI. Her pull quote: "Competitive tension is just good" . YouTube
- Elon Musk endorsed a16z's chart post, which argues "There are no low electricity, rich countries" . He added that electricity production is "the best metric for the true strength of any large-scale economy imo" .
- Jason Lemkin promoted SaaStr's own piece with Atlassian's Head of AI, with the takeaway "Juniors beat mids now" .
- Balaji Srinivasan, speaking with Vitalik at the Network State Conference, said he likes Gilbert Strang's linear algebra for people starting out. He then asked Vitalik which references he recommends for going "back to basics on cryptography, number theory." Vitalik answered that talking to an AI bot has been an effective way to learn . Watch
Balaji praised the quote attributed in the transcript to “Calvin Kulage”—“the business of America’s business”—but argued that the United States is now in a decline phase rather than the earlier ascent phase when it became a superpower. (video)
Balaji suggested revisiting The Social Network (2010), saying its striking omission of politics stands out; he used that contrast to illustrate how important social media later became to political power. Conference video.
Balaji names Gilbert Strang’s linear algebra as a reference he likes for people starting out in linear algebra, then asks Vitalik which references he learned from or finds useful (video).
Chamath Palihapitiya endorsed Satya Nadella’s article “Models as Insider Risks in the Super Intelligence Era”, calling its observations “very important.” Chamath highlighted that intent, verification, and evidence will gate enterprise adoption as models and harnesses commoditize; he also emphasized separating execution from governance, measurement, and sign-off, potentially through a system of record mapping changes to SOPs, policies, and laws.
Patrick Collison gives Grossman’s Life and Fate a qualified endorsement as “maybe a useful counterpoint” to Dostoyevsky’s The Brothers Karamazov: it depicts people confronting actual atrocities, and argues for ordinary human kindness without a providential resolution. Collison contrasts this with Karamazov’s characters, whose suffering he sees as largely untested and spiritual. Post
Chamath affirmed a Fireside Alpha video excerpt with “True,” endorsing its argument that decompiled, open-source Adobe products and headless, agent-connected services make software IP irrelevant; he called this the week’s most important AI development.
David Sacks endorsed Satya Nadella’s article, “Models as Insider Risks in the Super Intelligence Era”, agreeing that AI safety should come from engineering controls rather than granting models moral agency and independent authority. He highlights separating intelligence from authority and surrounding models with deterministic controls, observability, privilege limits, logging, and containment; he argues the safest system is one that lets people trust the model least.
Paul Graham presents a skeletonized Audemars Piguet 14232 as “a great way to understand how movements work,” explaining the barrel and mainspring as the “muscle” and the balance wheel as the “brain” that keeps time. Post
Chamath praised @sarithaforny's debate against Letitia James as a “strong debut” and “impressive,” adding that she “mopped the floor with her”; he linked to her post.
David Sacks resurfaced his own X essay, “WHY ZELENSKY CANNOT MAKE PEACE”, while reiterating that Zelensky is incapable of making peace and Ukrainian elections are overdue. The essay argues that Zelensky’s political survival, postwar scrutiny, fear of ultranationalists, belief in victory, and concern about how history will judge him deter him from accepting a deal; it urges Western supporters to press for a diplomatic off-ramp.
Investor Matt Ocko praised Bloomberg’s reporting by Natasha Mascarenhas (@nmasc_) and @RebeccaTorrenc5 as “Great reporting,” linking to the article on Andreessen Horowitz backing Jev’s maker at a $7.5B valuation. Jason Lemkin quote-posted Ocko’s post and commented that Jev had risen from $200M to $7.5B in less than a month, citing its adoption and saying he added it to the forthcoming SaaStr Connect app on release day.
Sarah Guo promoted a new No Priors episode with Reflection AI cofounder Misha Laskin, covering China, safety, AI market structure, open-model business models, reasoning efficiency, distillation, and what it takes to ship frontier AI; she highlighted the takeaway, “Competitive tension is just good.” Listen on YouTube or wherever you get podcasts.
Tobi Lutke (@tobi) recommends Patrick (@patrickc)’s post mulling over agents in the economy, calling it a “Great read” and agreeing that personal agents could act as “a kind of structural subsidy for product quality.” Read Patrick’s post.
Elon Musk called a piece from Microsoft CEO Satya Nadella “interesting”; the linked Nadella post points to his article, “Models as Insider Risks in the Super Intelligence Era.” Musk gave no further reason or takeaway.
Garry Tan recommends his own gbrain-evals GitHub repository as a useful resource for retrieval/latency-data work; it has 40+ categories that can be auto-researched and auto-improved. He says clear evaluations of retrieval, latency, and compute cost are useful.
Jason Lemkin highlighted the article “Atlassian's Head of AI: We Bolted AI Onto 20+ Apps, Almost Didn't Ship Chat, and Flipped Our Hiring Toward Juniors,” linking to it on SaaStr . His takeaway was “Juniors beat mids now” .
Jason Lemkin points readers to SaaStr’s AI agents page for more on its agents and invites them to get a free AI Sales Agents guide .
Elon Musk endorsed the linked a16z post featuring an “Energy capacity = economic capacity” chart, saying electricity production is “the best metric for the true strength of any large-scale economy”; the post argues there are no low-electricity rich countries.
Aaron Levie points readers to Prime Intellect’s post as an illustration of where future token consumption will come from, saying agent swarms could affect enterprise domains and parallelize large or initially unknown search spaces beyond what human teams can manage. The post, which includes a video, reports that Prime Agent used more than 2,000 agents over two weeks to rewrite itself in Rust; it says the agent now reaches usable input about 13 times faster and uses 83% less startup memory.
Jason Lemkin (@jasonlk) promoted a free guide to AI Sales Agents (link); the guide’s creator and a reason for recommending it were not stated. His post also linked to more information on “all our AI agents.”
Models as Insider Risks in the Super Intelligence Era
Models as Insider Risks in the Super Intelligence Era
As traditional software systems were being deployed across the economy over the last few decades, we had the tools and capability to trace behaviors to a specific code path.
That same kind of mechanistic understanding eludes us in today’s Super Intelligence systems, even as the frontier models powering these systems are now more capable than traditional software systems. We can’t attribute model behaviors and outputs to specific inputs of training data or configurations of model weights. And yet we are deploying these complex agentic systems and models, with access to our most sensitive data and giving them the ability to take mission-critical actions on our behalf!
That’s why it’s time to step back and assess the trust architecture for this new era. We simply can’t outsource responsibility for what intelligence does on our behalf. A model provider’s assurances do not relieve us of that responsibility.
We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions. We must build contained systems whose behavior we can observe, limits we can test, and actions we can always contain.
In other words, we need to separate the supply of intelligence from the authority over it.
Setting aside the hard problem of alignment, we need to start with an engineering approach to containment and governance. We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient.
Treating frontier closed and open weight models like insider risks is a way to build such a system. Not because they are necessarily malicious, but because any sufficiently capable actor with access to important systems can make mistakes or be compromised, and the architecture of containment and control must account for that.
The good news is we have learned a lot about how to handle powerful actors inside the enterprise. This isn’t new! We’ve established best practices and refined them over decades (establish identity, limit privileges, log activity, create containment boundaries, etc.)
And we are now beginning to apply these same principles to SI inside the enterprise. It starts with model CoT transparency as a non-negotiable. “Neuralese” cannot be a justification for model reasoning to be opaque. But CoT transparency alone is not sufficient or dependable, because we don’t yet know how to make model outputs themselves consistently faithful or transparent!
You can and you should use models to adversarially test and verify each other. However, you can then end up with an opaque model inside an opaque orchestration layer, watched by another opaque model. Essentially nested black boxes.
It’s why the controls that govern what a model can access and what actions it can take must sit outside the model. This builds on an information security principle dating back to the 1970s that a program must not be able to bypass or tamper with the mechanisms that enforce its permissions.
Today this means separating the model from the harness that orchestrates its work, as well as the action space that defines what it can do. It also means externalizing controls and safeguards.
We should therefore design these systems around principles of observability:
Model diversity: No one model should become the sole dependency for an important outcome or be responsible for verifying its own work.
Observe everything: Every meaningful model action must leave tamper-proof human readable evidence. If it can’t be observed, it can’t be trusted! We need to be able to reproduce how an outcome was achieved without relying on the model to attest to it.
Verifiability: We need to continuously test the entire system, including failures, attacks, edge cases, system changes, etc. not just successful tasks.
Independent controls: Orgs should be able to independently determine what a model can access and what actions it can take.
Independent auditability: Validation must be independent of the intelligence being validated. No single model should control both a system’s behavior and the evidence required to determine whether that behavior is aligned with the original intent.
Containment: We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on.
Incident disclosure: When these systems do fail or are compromised, we need timely disclosure to those affected and mechanisms to share what went wrong, which controls failed, and how to prevent it from happening again and share learnings industrywide. This should include implementation details that change the behavior of agents at runtime.
The most trustworthy Super Intelligence system will not be the one with the model we trust most. It will be the one that enables us to trust the model the least.
Chamath Palihapitiya endorsed Satya Nadella’s article “Models as Insider Risks in the Super Intelligence Era”, calling its observations “very important.” Chamath highlighted that intent, verification, and evidence will gate enterprise adoption as models and harnesses commoditize; he also emphasized separating execution from governance, measurement, and sign-off, potentially through a system of record mapping changes to SOPs, policies, and laws.
David Sacks endorsed Satya Nadella’s article, “Models as Insider Risks in the Super Intelligence Era”, agreeing that AI safety should come from engineering controls rather than granting models moral agency and independent authority. He highlights separating intelligence from authority and surrounding models with deterministic controls, observability, privilege limits, logging, and containment; he argues the safest system is one that lets people trust the model least.
Elon Musk called a piece from Microsoft CEO Satya Nadella “interesting”; the linked Nadella post points to his article, “Models as Insider Risks in the Super Intelligence Era.” Musk gave no further reason or takeaway.
Aaron Levie called Satya Nadella’s post a “good post” for thinking through long-term enterprise safety approaches; the post links to Nadella’s article “Models as Insider Risks in the Super Intelligence Era”. Levie’s stated rationale is that agents will take on far more organizational task execution and work with valuable data, while their decisions may be difficult to reverse-engineer; he highlights the need to secure, govern, control, and audit their work, address liability and accountability, and contain the blast radius of malicious or accidental agents.