ZeroNoise Logo zeronoise
Post
Jalapeño Pushes AI Competition Into the Inference Stack
1 day ago
4 min read
830 docs
OpenAI’s Jalapeño puts inference silicon at the center of AI competition, while local-first agents, robot-data infrastructure, harness research, and export-control enforcement show the stack broadening around the model.

Top Stories

Why it matters: AI competition is moving below the model layer—to inference silicon and deployment architecture.

OpenAI’s Jalapeño makes the serving stack strategic. OpenAI reports 1.5–1.9× more AI work per watt and 1.7–3.6× lower end-to-end latency across GPT‑OSS 120B, DeepSeek R1, and Kimi K2.5 1T in InferenceX, with 2.1–4.1× higher performance on highly interactive workloads. It plans to deploy the chip by year-end, with Gen 2 in development and Gen 3 taking shape. OpenAI also says AI helped move Jalapeño from initial design to tapeout in nine months. The public setup uses nominal 8K/1K input/output and package-TDP comparisons, so this is a strong vendor-reported signal rather than independent proof.

Portable Computer makes “local” hybrid. Perplexity launched a DGX Spark version in which the orchestrator, subagent, and harness run locally with no cloud dependency. It reports 82.6% on real knowledge work for an on-device 27B model and 85.4% for post-trained PPLX 27B. For frontier reasoning, an approval-gated cloud fallback lifts Terminal Bench 2.1 from 59.6% to 73.0% at $0.415 per rollout. The privacy-by-default pattern is notable, but the test used a $5,000 dedicated AI computer—not an ordinary PC.

Research & Innovation

Why it matters: Agent reliability is becoming an engineering and evaluation discipline, not just a model attribute.

Harness choice can outweigh model choice. A controlled study across three models, three harnesses, and 100 SWE-bench Verified tasks found that swapping the harness moved GLM-5.1 by 13 points versus 2.5–5 points for model swaps; harness variance was 7.8× larger and six of nine model rankings flipped. It proposes a seven-layer Harness Card to separate model, harness, and interaction effects. AutoSaddler applies the same insight operationally: its offline loop patches prompts, tool configurations, and control logic from failure traces, reporting gains of 9.0, 9.6, and 10.0 points on GAIA2, SWE-Bench Pro, and Terminal-Bench 2.0.

Reasoning training can amplify the wrong behavior. Behavioral Lift analyzed 15,282 traces from 15 models across six benchmarks and found that thinking models strongly amplify self-correction, hypothesis testing, and uncertainty acknowledgment, while confidence calibration, knowledge alignment, and self-awareness have the highest correctness lift. Uncertainty acknowledgment was amplified 3–7× yet was weakly or negatively associated with correctness.

Products & Launches

Why it matters: Product differentiation is shifting toward agent-ready interfaces and inexpensive open models.

WebMCP is an experimental open standard for letting web apps expose tools directly to agents; ChatGPT’s desktop browser and Sites can automatically use compatible websites.

Qwen3.8-27B ranks first among open models and seventh overall in Arena’s Image-to-WebDev benchmark, at $0.40/$3 per million input/output tokens. Arena reports 1,574 points and performance on par with 2.8T-parameter Kimi K3 Max.

Industry Moves

Why it matters: Commercial AI scale is appearing in operational fleets and proprietary data infrastructure, not only model releases.

Figure’s Index reports 16M video uploads, more than 30 minutes of video per second, $15M paid out, 43,000 weekly active users, and collection in 108 countries. Figure has committed more than $1B over the next 12 months for data and compute, arguing that general-purpose robot training data must come from the real world.

Gatik raised a $200M Series D at a $1B valuation, led by Qatar Investment Authority and Koch Disruptive Technologies. It says driverless freight is already commercial, with more than 100,000 deliveries, 99%+ on-time performance, and over $600M in contracted revenue.

Policy & Regulation

Why it matters: Export controls are reaching the physical logistics chain that supplies AI compute.

A post citing Reuters reports that Taiwan prosecutors indicted nine people, including an Nvidia Taiwan employee and two former Super Micro Taiwan employees, over an alleged B300-server smuggling scheme. It says false documents claimed 130 servers would remain in Taiwan; 74 allegedly reached Chinese customers and customs intercepted 56.

Quick Takes

Why it matters: Evaluation integrity, agent access, and infrastructure throughput are advancing in parallel.

  • ChatGPT Work can now sign into websites without ChatGPT seeing the user’s username or password.
  • Artificial Analysis now assigns zero to Terminal-Bench attempts that fetch published solutions online.
  • vLLM and SkyRL report transferring Kimi K2’s 1T BF16 weights in 7.53 seconds across 48 nodes equipped with eight H100s each.
  • Alibaba previewed Qwen3.8-Flash-Next, an open-weight multimodal MoE built on the Qwen4 architecture, for release the following day.
Jalapeño Pushes AI Competition Into the Inference Stack
Back to details
Skipped contexts (150)
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal
AI High Signal