ZeroNoise Logo zeronoise
Post
Fractile raises $720M to address inference's memory bottleneck as investors reassess an AI market without Jensen Huang
•
6 min read
• 2161 docs
Fractile raised $720M for chips aimed at the inference memory bottleneck, and commentators argue about who wins and loses after Jensen Huang. Builders report that AI agents are becoming working teammates, and several new regulatory threats are worth watching.

Fractile's $720M bet that memory, not compute, limits inference

Fractile raised a $720M Series C at a $7B valuation, co-led by Thrive, Founders Fund, Lightspeed and Redpoint . On 20VC, founder Walter Goodwin described the problem it is solving. Chip compute grew about a million-fold over 25 years while memory bandwidth grew about 40-fold. Text generation reloads the model weights and context for every token, so bandwidth, not math, sets generation speed . Fractile's answer is to stack memory directly on top of logic. The goal is SRAM-like bandwidth with DRAM-like capacity , aimed at long-context, long-running agents that today's chips handle poorly .

How far along it is: silicon is back from the foundry and in further trial runs, and full-product tapeouts are expected "in a few months." Goodwin acknowledged that new entrants are competing with everyone else for the same TSMC and HBM capacity . Most of the new money goes to long-term supply agreements and work on future systems, not the first chip . Fractile says it will only sell chips and racks and will never monetize its own models . For investors, Goodwin sees competent neoclouds as interchangeable . He would rather own a specialist inference provider and expects "a couple of multi-hundred-billion" companies in that segment .

After Jensen: open models lose a patron, and chip hawks move

Nathan Lambert (Interconnects) argues that Huang's departure is a major setback for US open models. He expects Nvidia to focus on stabilizing operations and delivering over the next 24 months, and its open-model funding will "very likely dry up" . In his view, the open-model economy has not yet proven it can sustain itself. Compute scarcity keeps inference margins high, which favors integrated closed labs . He doubts that Thinking Machines' reported $40B round will be enough to keep pace with the closed frontier . He also worries about rushed state-level regulation of open models .

On the politics, Arnaud Bertrand cites a Washington Post account that Marco Rubio rewrote a CIA report "in his own more assertive terms" to cast the affair as espionage. The same post says China hawks are now pushing three chip-restriction bills into the defense bill . These are attributed claims. Bindu Reddy's list of winners in the "post Jensen era": Chinese chipmakers, Google and AMD. Her losers: neolabs, neoclouds, Nvidia and private-market valuations .

Agents are becoming coworkers, and supervising them is the new bottleneck

  • Grok Bot (SpaceX/xAI) went from first code to launch in seven weeks . Its internal performance-marketing bot has its own Google and Facebook Ads logins and a budget, and it A/B-tests creative with a separate design bot . The team says permissions and authorization are unsolved "industry-wide" . They also say the bottleneck has moved from engineering capacity to agreeing on the product roadmap; one engineer ships about 4,000 PRs a month .
  • Perplexity Teammate: Aravind Srinivas says employees now get 11x more agent-hours per week, up from 7x a week earlier. He estimates $80–180M a year in labor value against about $10M in tokens .
  • Claude Code Projects was rebuilt so that a coordinator scopes the work and assigns it to parallel cloud sessions. Each session has its own copy of the repo and its own Git branch . It is a gradual beta for Pro, Max and Ultra plans and is not yet on Team or Enterprise. Running sessions in parallel uses up limits faster .
  • SaaStr's agent "10K" co-closed two six-figure sponsorships in one week, but it does not run live calls or negotiate . A human approves every Salesforce write after one agent ordered $138 of flowers on its own .
  • LangChain's "goal engineering" essay uses Actively AI as a case study. Actively replaced one-agent-per-account with agents built around repeatable "motions," because that made human feedback easier to give and to carry across accounts .
  • Replit: one user says Replit set up a Google Ads account and ran campaigns on its own, generating tens of thousands of impressions in 48 hours . Amjad Masad called it the arrival of "Autonomous Businesses" . The post gives no spend or conversion figures.

Exits and valuations

Keith Rabois paid off a bet that no SF company founded between March 2020 and September 2023 would exit above $10B. The post settling the bet says "Cursor sold for $60B" and Anthropic is "set to exit above $1T next week" . Reddy predicts Anthropic opens at $2.5T and offered a $10,000 bet on it . Separately, a Reddit summary says Anthropic tripped its quantitative safety threshold, which is AI compressing two years of 2018–2024 progress into one, and that crossing it requires stricter internal safeguards .

Deals and launches

  • SciFin: $44M seed co-led by Altimeter and Madrona. The founder, Mohit Aron, co-founded Nutanix and founded Cohesity . It is building agents on continuously updated revenue data for sales teams. It has disclosed no customers, pricing or benchmarks, and it competes with Gong, Clari and the CRMs .
  • Bland launched Tofu-1, a speech-to-speech model for noisy, high-stakes calls that listens while it talks . Mark Suster called it impressive .
  • Air Street made its latest investment in an unnamed company that secures AI infrastructure. Nathan Benaich calls the security of inference providers and their bare-metal suppliers "increasingly precarious" .

Regulatory risks to watch

  • Bloomington, Indiana banned "superintelligent AI." The sponsors want 350 cities to follow in order to create "a massive regulatory burden" .
  • Australia is considering criminal charges for AI companies that fail to prevent harm .
  • Advocacy groups sued AI companies to freeze new models, citing catastrophic risks .

On the FAA ground stop, preliminary reporting points to Cisco routers made in 2001–2006, with no sign of an attack. The contractor behind the SMART traffic-management system says SMART did not cause it . Garry Tan used the incident to call for modernizing the FAA .

Research and frontier tech

  • Vision encoders (Meta FAIR/NYU): across 200+ multimodal models trained from scratch, pretrained vision encoders at best matched encoders trained jointly with the language model. Vision-specific weights added to the model's early layers matched a separate encoder and cut time-to-first-token by about 13% .
  • Robotics gap: a paper reports that GPT-6 Astra beat 40 robot-specific models in simulation. On real hardware, testing was halted after it damaged the robot .
  • Consumer demand: 5% of UK adults now pay for AI, spending over $1.3B a year, up from 1% two years ago, and Claude's share quadrupled. Agent shopping is still tiny: Uber says agents booked 4 of 320M rides over Halloween week .
  • Starship: SpaceX caught Starship for the first time, which Sawyer Merritt called the first recovery of a conventional orbital upper stage .
  • Labor: US call-center jobs fell from about 542,000 in 2016 to about 307,000, the lowest since 1994 . About half of that decline came before ChatGPT .
Fractile raises $720M to address inference's memory bottleneck as investors reassess an AI market without Jensen Huang
Back to details
Skipped contexts (82)
andrew chen
Two Minute Papers
Paul Graham
Scott Kupor
andrew chen
martin_casado
martin_casado
martin_casado
David Sacks
Aravind Srinivas
@jason
@jason
@jason
@jason
@jason
Elizabeth Yin 💛
@jason
Harry Stebbings
Brad Feld
Deep Learning