ZeroNoise Logo zeronoise
Post
Opus 5.5’s `xhigh` Setting Looks Better Than `max`—So Far
•
3 min read
• 206 docs
Theo’s informal comparison and a separate scientific-research benchmark both favor `xhigh` over `max`; the brief adds practical guardrails for unattended runs, verification, test pruning, and LangSmith’s new trace-to-SFT workflow.

🔥 TOP SIGNAL

Use Opus 5.5 xhigh as the baseline, not max. Theo’s self-described “silly” Skatebench moved from 78% to 79% accuracy on max, while token use grew 15×, cost 13×, and average latency rose from 6s to 50s; the slowest max run was 20× slower. A separate 70-task scientific-research benchmark reported 62% on xhigh versus 59% on max—useful direction, not a coding benchmark.

⚡ TRY THIS

  • Make unattended runs bounded. Put this in CLAUDE.md: “When a step doesn't need my input, keep going. Put status notes in the same message as your next action. Stop and ask only when you can't continue without me, or before anything destructive: deleting data, force-pushing, or changing anything outside this repository.” Keep destructive-command permission prompts on. For remote work, Theo explicitly authorized environment-variable copying, required checks for the clone, environment, and Claude Code/T3 Code setup, told the agent not to control his active machine, and said to ask if setup failed; he reports the handoff took about 17 minutes.

  • Build executable backpressure. Huntley recommends tests for architectural rules (e.g. fail when SQL-domain code couples to REST) and properties checked against generated inputs, rather than only hand-picked cases; his string-reversal example shows how Unicode can expose gaps. Feed reproducible failure reports back to the agent. Huntley says he works at Antithesis, so the deterministic fault-injection offering is a company-affiliated pitch.

  • Separate builders from reviewers. In his T3-codebase experience, Theo says a different model family can catch issues Claude misses, though it may return more low-value findings. Give the reviewer the diff; ask for only merge blockers, with file/line, why it is wrong, and a reproduction path. Require it to flag what it could not verify, and provide tests or browser access to check claims.

  • Prune tests by proof, not quota. Steipete reports OpenClaw removed around 400k LOC of tests with little change in coverage; his suggested prompt is to “remove 20% of the least useful tests while maintaining code coverage within 2%.” The linked skill is more conservative: do read-only discovery, document what each candidate catches and what stronger proof remains, retain independent contracts and regressions, then validate a coherent owner-boundary batch with owner and sibling tests. Coverage parity alone is not a deletion case.

📡 WHAT SHIPPED

  • LangSmith Trajectories + Fine-Tuning (smithtune, public beta). Trajectories orders human, AI, tool, and system-prompt messages across the main agent and subagents. smithtune turns LangSmith traces into supervised fine-tuning data (SFT only), trains via Fireworks or Baseten, and replay-evaluates the tuned model against the base before deployment; preserve each turn’s context and tool availability, which can change during long runs. The demo’s 50 accepted examples split 41/4/5 across train/validation/test and showed only a slight agreement lift; the presenter said the sample was too small to expect much benefit. It also knowingly uploaded PII for later removal—redact before reproducing.

  • LangSmith Engine v2: LangChain says it red-teams agents before production, tests proposed fixes before presenting them, and surfaces inefficient agent work plus cost/latency trends.

🎬 GO DEEPER

  • Video — LangChain’s SmithTune walkthrough: Watch how the demo preserves per-turn context, drafts a task rubric, and uses two judges to curate traces; it demonstrates the data workflow, not robust model gains.
  • Repo — OpenClaw’s test-audit skill: A practical counterweight to percentage-based pruning: read-only discovery, evidence for each deletion, and validation at the owner boundary.

Editorial take: Keep reasoning effort adaptive; spend the saved budget on checks that can disprove a patch and give the agent a reproducible fix target.

Opus 5.5’s `xhigh` Setting Looks Better Than `max`—So Far
Summary
Coverage start
1 day ago
Coverage end
17 hours ago
Frequency
Daily
Published
16 hours ago
Reading time
3 min
Research time
6 hrs 44 min
Documents scanned
206
Documents used
17
Citations
30
Sources monitored
110 / 111
Insights
Skipped contexts
Source details
Source Docs Insights Status
Brent Traut 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Aman Karmani 0 0
Jacob Jackson 0 0
Cursor Blog | RSS Feed 0 0
Nicholas Moy 0 0
Mike Krieger 0 0
Sualeh Asif 0 0
Michael Truell 0 0
Google Antigravity 0 0
Aman Sanger 0 0
cat 0 0
Mark Chen 0 0
Greg Brockman 0 0
Tongzhou Wang 0 0
fouad 0 0
Calvin French-Owen 0 0
Hanson Wang 0 0
Ed Bayes 0 0
Alexander Embiricos 0 0
Tibo 0 0
Romain Huet 0 0
DHH 19 1
Jane Street Blog 0 0
Miguel Grinberg's Blog: AI 0 0
xxchan's Blog 0 0
<antirez> 0 0
Brendan Long 0 0
The Pragmatic Engineer 1 1
David Heinemeier Hansson 0 0
Armin Ronacher ⇌ 8 3
Mitchell Hashimoto 0 0
Armin Ronacher's Thoughts and Writings 0 0
Peter Steinberger 0 0
Theo - t3.gg 41 12
Sourcegraph 0 0
Anthropic 0 0
Cursor 0 0
LangChain 1 1
Anthropic 0 0
LangChain Blog 0 0
LangChain 39 8
Cursor 0 0
Riley Brown 0 0
Riley Brown 10 0
Jason Zhou 6 0
Boris Cherny 0 0
Mckay Wrigley 0 0
geoff 23 3
Peter Steinberger 🦞 7 2
AI Jason 0 0
Alex Albert 0 0
Latent.Space 4 4
Logan Kilpatrick 0 0
Fireship 0 0
Fireship 0 0
Kent C. Dodds 🐨 9 0
Practical AI 0 0
Practical AI Clips 0 0
Stories by Steve Yegge on Medium 0 0
Kent C. Dodds Blog 0 0
ThePrimeTime 0 0
Theo - t3․gg 1 1
ThePrimeagen 10 1
Ben Tossell 1 0
swyx 11 0
AI For Developers 0 0
Geoffrey Huntley 0 0
Addy Osmani 6 2
Andrej Karpathy 0 0
Simon Willison 2 1
Matthew Berman 1 0
Changelog 0 0
Simon Willison’s Newsletter 0 0
Agentic Coding Newsletter 0 0
Latent Space 1 1
Simon Willison's Weblog 2 0
Elevate 0 0
Lukas Möller 0 0
Jediah Katz 0 0
Sualeh Asif 0 0
Mike Krieger 0 0
Michael Truell 0 0
Cat Wu 0 0
Kevin Hou 0 0
Aman Sanger 0 0
Nicholas Moy 0 0
Andrey Mishchenko 0 0
Jerry Tworek 1 1
Romain Huet 0 0
Thibault Sottiaux 0 0
Alexander Embiricos 0 0
xxchan 0 0
Salvatore Sanfilippo 1 1
Armin Ronacher 0 0
David Heinemeier Hansson (DHH) 0 0
Alex Albert 0 0
Logan Kilpatrick 0 0
Shawn "swyx" Wang 1 1
Jason Zhou 0 0
Riley Brown 0 0
McKay Wrigley 0 0
Boris Cherny 0 0
Ben Tossell 0 0
Geoffrey Huntley 0 0
Peter Steinberger 0 0
Addy Osmani 0 0
Simon Willison 0 0
Andrej Karpathy 0 0
Harrison Chase 0 0