ZeroNoise Logo zeronoise
Post
Jalapeño Pushes AI Competition Into the Inference Stack
1 day ago
4 min read
830 docs
OpenAI’s Jalapeño puts inference silicon at the center of AI competition, while local-first agents, robot-data infrastructure, harness research, and export-control enforcement show the stack broadening around the model.

Top Stories

Why it matters: AI competition is moving below the model layer—to inference silicon and deployment architecture.

OpenAI’s Jalapeño makes the serving stack strategic. OpenAI reports 1.5–1.9× more AI work per watt and 1.7–3.6× lower end-to-end latency across GPT‑OSS 120B, DeepSeek R1, and Kimi K2.5 1T in InferenceX, with 2.1–4.1× higher performance on highly interactive workloads. It plans to deploy the chip by year-end, with Gen 2 in development and Gen 3 taking shape. OpenAI also says AI helped move Jalapeño from initial design to tapeout in nine months. The public setup uses nominal 8K/1K input/output and package-TDP comparisons, so this is a strong vendor-reported signal rather than independent proof.

Portable Computer makes “local” hybrid. Perplexity launched a DGX Spark version in which the orchestrator, subagent, and harness run locally with no cloud dependency. It reports 82.6% on real knowledge work for an on-device 27B model and 85.4% for post-trained PPLX 27B. For frontier reasoning, an approval-gated cloud fallback lifts Terminal Bench 2.1 from 59.6% to 73.0% at $0.415 per rollout. The privacy-by-default pattern is notable, but the test used a $5,000 dedicated AI computer—not an ordinary PC.

Research & Innovation

Why it matters: Agent reliability is becoming an engineering and evaluation discipline, not just a model attribute.

Harness choice can outweigh model choice. A controlled study across three models, three harnesses, and 100 SWE-bench Verified tasks found that swapping the harness moved GLM-5.1 by 13 points versus 2.5–5 points for model swaps; harness variance was 7.8× larger and six of nine model rankings flipped. It proposes a seven-layer Harness Card to separate model, harness, and interaction effects. AutoSaddler applies the same insight operationally: its offline loop patches prompts, tool configurations, and control logic from failure traces, reporting gains of 9.0, 9.6, and 10.0 points on GAIA2, SWE-Bench Pro, and Terminal-Bench 2.0.

Reasoning training can amplify the wrong behavior. Behavioral Lift analyzed 15,282 traces from 15 models across six benchmarks and found that thinking models strongly amplify self-correction, hypothesis testing, and uncertainty acknowledgment, while confidence calibration, knowledge alignment, and self-awareness have the highest correctness lift. Uncertainty acknowledgment was amplified 3–7× yet was weakly or negatively associated with correctness.

Products & Launches

Why it matters: Product differentiation is shifting toward agent-ready interfaces and inexpensive open models.

WebMCP is an experimental open standard for letting web apps expose tools directly to agents; ChatGPT’s desktop browser and Sites can automatically use compatible websites.

Qwen3.8-27B ranks first among open models and seventh overall in Arena’s Image-to-WebDev benchmark, at $0.40/$3 per million input/output tokens. Arena reports 1,574 points and performance on par with 2.8T-parameter Kimi K3 Max.

Industry Moves

Why it matters: Commercial AI scale is appearing in operational fleets and proprietary data infrastructure, not only model releases.

Figure’s Index reports 16M video uploads, more than 30 minutes of video per second, $15M paid out, 43,000 weekly active users, and collection in 108 countries. Figure has committed more than $1B over the next 12 months for data and compute, arguing that general-purpose robot training data must come from the real world.

Gatik raised a $200M Series D at a $1B valuation, led by Qatar Investment Authority and Koch Disruptive Technologies. It says driverless freight is already commercial, with more than 100,000 deliveries, 99%+ on-time performance, and over $600M in contracted revenue.

Policy & Regulation

Why it matters: Export controls are reaching the physical logistics chain that supplies AI compute.

A post citing Reuters reports that Taiwan prosecutors indicted nine people, including an Nvidia Taiwan employee and two former Super Micro Taiwan employees, over an alleged B300-server smuggling scheme. It says false documents claimed 130 servers would remain in Taiwan; 74 allegedly reached Chinese customers and customs intercepted 56.

Quick Takes

Why it matters: Evaluation integrity, agent access, and infrastructure throughput are advancing in parallel.

  • ChatGPT Work can now sign into websites without ChatGPT seeing the user’s username or password.
  • Artificial Analysis now assigns zero to Terminal-Bench attempts that fetch published solutions online.
  • vLLM and SkyRL report transferring Kimi K2’s 1T BF16 weights in 7.53 seconds across 48 nodes equipped with eight H100s each.
  • Alibaba previewed Qwen3.8-Flash-Next, an open-weight multimodal MoE built on the Qwen4 architecture, for release the following day.
Jalapeño Pushes AI Competition Into the Inference Stack