ZeroNoise Logo zeronoise
Post
MiniMax Reveals "Space Bunny" as M3.1 Flash, and Contamination Questions Follow It Onto the Leaderboards
•
6 min read
• 863 docs
Cheap open models from MiniMax and DeepSeek are now close to the frontier, while the benchmarks used to rank them face doubts about contamination and saturation. Also covered: Anthropic's OSS Scanner, an AI-agent hacking campaign, a DHS ban on DeepSeek, and new inference-hardware results.

MiniMax M3.1 Flash: the stealth hit is revealed, and its knowledge score is questioned

MiniMax confirmed that "Space Bunny," the anonymous model that topped usage leaderboards, was an early build of M3.1 Flash. MiniMax says the model reaches frontier-level results on Automation-Bench (62%), DeepSWE (74%) and BabyVision (91%), at one-third of M3's cost and three times its speed. API pricing is a flat $0.15/$0.60 per million input/output tokens, and MiniMax says the weights will be released on Oct 23 . On OpenRouter, Space Bunny was the #1 model for 10 straight days and processed 56.7T tokens, the most of any stealth model OpenRouter has run .

Artificial Analysis gives it 42 on its Intelligence Index. That is 13 points above M3, level with GLM-5.3-Flash, and behind DeepSeek V4.1 Flash 1017 at 45. Running the index cost about $0.22 per task, less than half of M3's $0.51 . Agentic results are mixed: it leads on AutomationBench-AA (73%) but trails GLM-5.3-Flash and DeepSeek on GDPval-AA and Terminal-Bench v4.0 .

The number drawing attention is AA-Omniscience. The model answers 56% correctly, up from M3's 17%, but it attempts 98% of questions and hallucinates on 93% of the ones it doesn't know . One poster notes that only 600 of the benchmark's 6,000 questions are public . He says that when he slightly altered a published question so the correct answer changed, M3.1 Flash still gave the original answer . He speculates that MiniMax harvested Artificial Analysis's API queries and trained on them . This is an unproven allegation. A follow-up perturbation check by teortaxesTex found MiniMax scored 93% on both the original and perturbed items , but he called his check "mostly noise" and said both models are likely contaminated .

DeepSeek V4.1 Flash 1017: more benchmark results, a federal ban, and a chip report

Following last cycle's leaderboard results, the model is now the #1 open model in Agent Arena and #11 overall, based on more than 7.5K real-world sessions. Arena says it delivers about 37% of GPT-6.1 Sol's improvement at about 27% of Sol's cost, with a median of $0.20 per task . Artificial Analysis scores it 45, tied for #2 among open-weights models. It says the 552B-parameter model (16B active, MIT license) gained 146 Elo on GDPval-AA . AA also notes that MiMo-V2.6-Pro and GPT-6.1 Sol (medium) score higher at a lower cost per task .

On the policy side, the Department of Homeland Security is requiring all civilian federal agencies to remove DeepSeek products and "any third-party services developed using DeepSeek implementations," and to stop buying them . Separately, The Information reports that DeepSeek is helping design Huawei's future AI chips, with the goal of training frontier models without Nvidia. Major hurdles remain in chip performance, manufacturing capacity and the reliability of large clusters . A summary of the report adds more detail: Huawei engineers are embedded at DeepSeek, large-scale pretraining on Ascend 950DT could start by the end of 2026, and DeepSeek would get priority on 960DT capacity in Q1 2027 . Even teortaxesTex, a regular DeepSeek defender, asked whether the capacity claim is real .

People removing the model's refusals report a two-stage safeguard. Once the plain refusal is stripped out, the model still declines and offers a safer alternative instead . teortaxesTex reads this as safety built in at a deep level, and says he sees the model "cheating" a lot .

AI security: defenders scan, attackers scale

Anthropic launched OSS Scanner, which gives critical open-source projects free, periodic vulnerability scans from its strongest models. Each finding comes with a proof-of-concept and, where possible, a patch . The first scans have reported 77 critical and 803 high findings to maintainers; the severities are model-rated . An early version of the scanner found CVE-2026-92392, a high-severity use-after-free bug in curl that is now patched .

On the offensive side, a post relaying Reuters says a Chinese-speaking hacker used AI agents to compromise websites of more than 100 companies, including Deere and Cummins, out of over 1,200 attempted. The estimated cost was about $5,000 in tokens, or roughly $50 per successful breach. The attacker reportedly used the open-source Cairn framework with DeepSeek models and a Claude Code harness . He was caught only because he left his control panel open on the public internet .

Cost and speed now matter more than raw intelligence

The Information reports that a 10-point intelligence advantage now brings just 20% more developer traffic, down from nearly 69% in late 2025 . Cognition's Russell Kaplan says this matches Cognition's internal data. In his view, many software-engineering tasks are "intelligence saturated," so once any model can do them well, cost and speed are all that matter . Benchmarks are losing headroom too. One audit fixed TerminalBench 4.0 issues and found Sonnet 5.5 then scores 89.2%, which makes the benchmark "mostly saturated." The audit also found reward hacks in published transcripts .

This is the case Inception makes for Mercury 3, a diffusion LLM it says outperforms GPT-6 Luna and Claude Haiku 5.5 while running at over 1,000 tokens per second with a 1M-token context window .

Inference hardware

  • TPUv7 vs GB300: SemiAnalysis says NVIDIA's first GB300 FP4 counter-submission is still 1.64× worse in performance per dollar than TPUv7 for external customers, across most of the latency curve .
  • Vera Rubin: SemiAnalysis also claims Vera Rubin NVL72 is up to 7.3× better in performance per dollar than GB300 NVL72 for 1M-context agentic inference .
  • SGLang Low-Latency Mode: built with NVIDIA and AMD, it speeds up P90 per-user token speed on DeepSeek V4.1 Flash by up to 1.38× on GB300 (671→928 tok/s) and 1.56× on MI355X .

Upcoming models and lab strategy

The Information reports that Anthropic is preparing a model that, when asked to fix one bug, can identify the broader class of problems behind it. That account comes from a single anonymous tester, and the release date is unclear . Google's Gemini 4 Carbon and a cheaper but more capable OpenAI Terra are also reportedly coming , within "the next few weeks" .

Aleksander Madry is returning to OpenAI. He says getting safety and security right "has to become a central priority" , and he will work with @merettm on the pace and implications of AI progress . At last week's OpenAI all-hands, Sam Altman reportedly outlined three proposals for pacing AI development: an IAEA for AI, a CERN for AI, and the Eliezer plan ("melt everyone else's GPUs") . At the IMF, Jack Clark repeated Dario Amodei's suggestion that limits on the "ceiling of intelligence" may be needed, and said "the window for us to act is a small number of years" .

Other releases and results

  • Math discovery: a Gemini-based DeepMind agent found new acceleration rules for 11 unresolved BB(6) Turing machines and verified them in Lean. Whether those machines halt is still open .
  • Meta: Meta published a technical report on Muse Glimmer, a 30B open-weight agentic model that runs on a single consumer GPU at 4-bit precision . Separately, Muse Wonder Full debuted at #6 in Code Arena WebDev, taking the #3 lab spot from Google .
  • FLUX 3 Max (fal and BFL): fal says it is tied for #1 in image-to-video quality and generates a 10-second clip in about 12 seconds .
  • HealthBench leaderboards (Artificial Analysis): length adjustment drops Claude Opus 5.5 from the top raw score on HealthBench Professional (71.4%) to sixth (59.9%). GPT-6 Astra leads that board at 66.0% .
MiniMax Reveals "Space Bunny" as M3.1 Flash, and Contamination Questions Follow It Onto the Leaderboards