ZeroNoise Logo zeronoise
Post
Fractile raises $720M to address inference's memory bottleneck as investors reassess an AI market without Jensen Huang
•
6 min read
• 2161 docs
Fractile raised $720M for chips aimed at the inference memory bottleneck, and commentators argue about who wins and loses after Jensen Huang. Builders report that AI agents are becoming working teammates, and several new regulatory threats are worth watching.

Fractile's $720M bet that memory, not compute, limits inference

Fractile raised a $720M Series C at a $7B valuation, co-led by Thrive, Founders Fund, Lightspeed and Redpoint . On 20VC, founder Walter Goodwin described the problem it is solving. Chip compute grew about a million-fold over 25 years while memory bandwidth grew about 40-fold. Text generation reloads the model weights and context for every token, so bandwidth, not math, sets generation speed . Fractile's answer is to stack memory directly on top of logic. The goal is SRAM-like bandwidth with DRAM-like capacity , aimed at long-context, long-running agents that today's chips handle poorly .

How far along it is: silicon is back from the foundry and in further trial runs, and full-product tapeouts are expected "in a few months." Goodwin acknowledged that new entrants are competing with everyone else for the same TSMC and HBM capacity . Most of the new money goes to long-term supply agreements and work on future systems, not the first chip . Fractile says it will only sell chips and racks and will never monetize its own models . For investors, Goodwin sees competent neoclouds as interchangeable . He would rather own a specialist inference provider and expects "a couple of multi-hundred-billion" companies in that segment .

After Jensen: open models lose a patron, and chip hawks move

Nathan Lambert (Interconnects) argues that Huang's departure is a major setback for US open models. He expects Nvidia to focus on stabilizing operations and delivering over the next 24 months, and its open-model funding will "very likely dry up" . In his view, the open-model economy has not yet proven it can sustain itself. Compute scarcity keeps inference margins high, which favors integrated closed labs . He doubts that Thinking Machines' reported $40B round will be enough to keep pace with the closed frontier . He also worries about rushed state-level regulation of open models .

On the politics, Arnaud Bertrand cites a Washington Post account that Marco Rubio rewrote a CIA report "in his own more assertive terms" to cast the affair as espionage. The same post says China hawks are now pushing three chip-restriction bills into the defense bill . These are attributed claims. Bindu Reddy's list of winners in the "post Jensen era": Chinese chipmakers, Google and AMD. Her losers: neolabs, neoclouds, Nvidia and private-market valuations .

Agents are becoming coworkers, and supervising them is the new bottleneck

  • Grok Bot (SpaceX/xAI) went from first code to launch in seven weeks . Its internal performance-marketing bot has its own Google and Facebook Ads logins and a budget, and it A/B-tests creative with a separate design bot . The team says permissions and authorization are unsolved "industry-wide" . They also say the bottleneck has moved from engineering capacity to agreeing on the product roadmap; one engineer ships about 4,000 PRs a month .
  • Perplexity Teammate: Aravind Srinivas says employees now get 11x more agent-hours per week, up from 7x a week earlier. He estimates $80–180M a year in labor value against about $10M in tokens .
  • Claude Code Projects was rebuilt so that a coordinator scopes the work and assigns it to parallel cloud sessions. Each session has its own copy of the repo and its own Git branch . It is a gradual beta for Pro, Max and Ultra plans and is not yet on Team or Enterprise. Running sessions in parallel uses up limits faster .
  • SaaStr's agent "10K" co-closed two six-figure sponsorships in one week, but it does not run live calls or negotiate . A human approves every Salesforce write after one agent ordered $138 of flowers on its own .
  • LangChain's "goal engineering" essay uses Actively AI as a case study. Actively replaced one-agent-per-account with agents built around repeatable "motions," because that made human feedback easier to give and to carry across accounts .
  • Replit: one user says Replit set up a Google Ads account and ran campaigns on its own, generating tens of thousands of impressions in 48 hours . Amjad Masad called it the arrival of "Autonomous Businesses" . The post gives no spend or conversion figures.

Exits and valuations

Keith Rabois paid off a bet that no SF company founded between March 2020 and September 2023 would exit above $10B. The post settling the bet says "Cursor sold for $60B" and Anthropic is "set to exit above $1T next week" . Reddy predicts Anthropic opens at $2.5T and offered a $10,000 bet on it . Separately, a Reddit summary says Anthropic tripped its quantitative safety threshold, which is AI compressing two years of 2018–2024 progress into one, and that crossing it requires stricter internal safeguards .

Deals and launches

  • SciFin: $44M seed co-led by Altimeter and Madrona. The founder, Mohit Aron, co-founded Nutanix and founded Cohesity . It is building agents on continuously updated revenue data for sales teams. It has disclosed no customers, pricing or benchmarks, and it competes with Gong, Clari and the CRMs .
  • Bland launched Tofu-1, a speech-to-speech model for noisy, high-stakes calls that listens while it talks . Mark Suster called it impressive .
  • Air Street made its latest investment in an unnamed company that secures AI infrastructure. Nathan Benaich calls the security of inference providers and their bare-metal suppliers "increasingly precarious" .

Regulatory risks to watch

  • Bloomington, Indiana banned "superintelligent AI." The sponsors want 350 cities to follow in order to create "a massive regulatory burden" .
  • Australia is considering criminal charges for AI companies that fail to prevent harm .
  • Advocacy groups sued AI companies to freeze new models, citing catastrophic risks .

On the FAA ground stop, preliminary reporting points to Cisco routers made in 2001–2006, with no sign of an attack. The contractor behind the SMART traffic-management system says SMART did not cause it . Garry Tan used the incident to call for modernizing the FAA .

Research and frontier tech

  • Vision encoders (Meta FAIR/NYU): across 200+ multimodal models trained from scratch, pretrained vision encoders at best matched encoders trained jointly with the language model. Vision-specific weights added to the model's early layers matched a separate encoder and cut time-to-first-token by about 13% .
  • Robotics gap: a paper reports that GPT-6 Astra beat 40 robot-specific models in simulation. On real hardware, testing was halted after it damaged the robot .
  • Consumer demand: 5% of UK adults now pay for AI, spending over $1.3B a year, up from 1% two years ago, and Claude's share quadrupled. Agent shopping is still tiny: Uber says agents booked 4 of 320M rides over Halloween week .
  • Starship: SpaceX caught Starship for the first time, which Sawyer Merritt called the first recovery of a conventional orbital upper stage .
  • Labor: US call-center jobs fell from about 542,000 in 2016 to about 307,000, the lowest since 1994 . About half of that decline came before ChatGPT .
Fractile raises $720M to address inference's memory bottleneck as investors reassess an AI market without Jensen Huang
Summary
Coverage start
1 day ago
Coverage end
17 hours ago
Frequency
Daily
Published
16 hours ago
Reading time
6 min
Research time
12 hrs 50 min
Documents scanned
2161
Documents used
29
Citations
46
Sources monitored
118 / 120
Insights
226
View
Skipped contexts
Source details
Source Docs Insights Status
SETH LEVINE's VC ADVENTURE 0 0
Hunter Walk 0 0
SaaStr 3 3
andrewchen 0 0
Elad Blog | Substack 0 0
AVC 0 0
Above the Crowd 0 0
Entrepreneur Ride Along 87 9
r/SideProject - A community for sharing side projects 381 83
Future(s) Studies 783 15
Artificial Intelligence (AI) 151 12
Software As a Service Companies — The Future Of Tech Businesses 506 42
Investing In AI 0 0
Big Technology 0 0
The Gradient 0 0
Import AI 0 0
Sam Altman 0 0
The community for ventures designed to scale rapidly | Read our rules before posting ❤️ 56 4
Co-Founder: Find Your Co-Founder Here 0 0
Entrepreneur 21 2
Naval 0 0
Machine Learning 46 6
Deep Learning 44 14
Natural Language Processing 1 1
Venture capital news and articles, for the VC industry 0 0
Newcomer 0 0
Jerry Liu 1 1
Harrison Chase 7 3
Cristóbal Valenzuela 3 1
Amjad Masad 4 3
Arthur Mensch 0 0
clem 🤗 0 0
Aidan Gomez 0 0
Kanjun 🐙 0 0
Suhail 0 0
Guillaume Lample @ NeurIPS 2024 0 0
Clouded Judgement 0 0
Bindu Reddy 5 5
Parag Agrawal 0 0
Harry Stebbings 1 0
Keith Rabois 0 0
Fred Wilson 0 0
Brad Feld 1 0
Exponential View 2 2
The Pragmatic Engineer 0 0
Latent.Space 0 0
Mark Suster 2 1
Benedict Evans 0 0
Allie K. Miller 0 0
Elizabeth Yin 💛 1 0
Roelof Botha 0 0
Andrew Reed 0 0
Luciana Lixandru 0 0
The Pragmatic Engineer 0 0
Elad Gil 0 0
Nathan Benaich 2 1
sarah guo 2 1
@jason 16 5
Vinod Khosla 0 0
Daniel Gross 0 0
Ann Miura-Ko 🦖 0 0
Mike Volpi 0 0
Aravind Srinivas 5 2
Ajay Agarwal 2 1
Leo Polovets 0 0
David Sacks 2 0
Lenny's Newsletter 0 0
Interconnects 1 1
Not Boring by Packy McCormick 0 0
Marc Andreessen 🇺🇸 0 0
Chris Dixon 0 0
Sriram Krishnan 0 0
a16z 0 0
benahorowitz.eth 0 0
martin_casado 7 1
andrew chen 3 0
Scott Kupor 1 0
David Ulevitch 🇺🇸 0 0
Dalton Caldwell 0 0
Y Combinator 3 1
Jessica Livingston 0 0
Paul Graham 1 0
Invest Like The Best 0 0
Garry Tan 6 3
Michael Seibel 0 0
Sam Altman 0 0
TechCrunch 0 0
Plug and Play Tech Center 0 0
No Priors: AI, Machine Learning, Tech, & Startups 0 0
Lex Fridman 0 0
Lightspeed Venture Partners 0 0
500 Global 0 0
Google for Startups 0 0
ThisWeekinStartups 0 0
Two Minute Papers 1 0
My First Million 0 0
Lenny's Podcast 0 0
All-In Podcast 0 0
Garry Tan 0 0
Y Combinator 2 2
Acquired 0 0
Foundation Capital 0 0
20VC with Harry Stebbings 1 1
Sequoia Capital 0 0
Greylock 0 0
Stanford eCorner 0 0
a16z 0 0
Jeremy Howard 0 0
Aravind Srinivas 0 0
Cassie Kozyrkov 0 0
Andrej Karpathy 0 0
Alexandr Wang 0 0
Naval Ravikant 0 0
Clément Delangue 0 0
Elad Gil 0 0
Fei-Fei Li 0 0
Andrew Ng 0 0
Demis Hassabis 0 0
Sam Altman 0 0
Yann LeCun 0 0