We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
🔥 TOP SIGNAL
The highest-alpha signal is a workflow change, not a leaderboard win. After burning over 20B tokens, Latent Space reports that GPT-6 Astra can choose and train models, label data, keep pipelines saturated, instrument and read logs, deploy and debug systems, and fan out, command, and evaluate subagents while maintaining coherence across billions of tokens in a single thread. Their observed rate was 33 tokens/sec at $50/M tokens, or roughly $6/hour, but they also warn that parallelizing Astra burns well above that headline rate. The unit of work is moving from a single code-generation prompt to a monitored engineering run; concurrency, budgets, and proof are now first-class controls.
⚡ TRY THIS
Bound the fleet before scaling it. Start with individually tuned subagents, cap concurrency, and let a supervisor monitor runs and start/stop waves—the pattern Latent Space used. Add a per-wave token/cost ceiling and stop condition; the team says one such run cost about $100 over two days.
Make feature delivery role-specialized and proof-bearing. In Cursor’s Grok Bot demo, a tech lead assigned a lodging feature to backend Bobby and frontend Fay; QA Quincy ran localhost end-to-end checks and recorded both UI and network-inspector evidence, while the agents messaged each other to unblock dependencies. Start with a lead prompt such as
Work with our engineering team to build [feature], let the backend agent publish the contract before frontend work begins, and require video/network evidence in every PR.Use cross-model handoffs as a ship gate. Theo’s comparison is unusually concrete: Astra’s code is roughly Fable 5-tier, while Fable 5.1 is the unexpected “fine to merge” model; Fable found Astra’s AGY implementation, polished it, and shipped it. Use Astra for broad implementation and computer use, then send the diff to Fable 5.1 for merge review and polish.
Keep GUI use for what only GUI can do. Kent C. Dodds estimates computer use at 30–50× the cost of structured API interaction. Route routine file and service actions through MCP/API, reserving screen-driven work for missing interfaces; LangChain’s current MCP layer adds stateless deployment, cached tool discovery, and interrupt-based approval for destructive calls.
📡 WHAT SHIPPED
GPT-6 Astra / OpenAI. The staged rollout starts with a limited set of organizations, then expands over the following days to ChatGPT Plus, Pro, Business, and Enterprise users, the OpenAI API, and AWS. The API identifier is
gpt-6-astra; standard pricing is $10 per million input tokens / $50 per million output tokens, with Fast mode offering up to 2× speed at 2× the standard price. OpenAI positions Astra as its best software-engineering model to date and reports 57.9% on Terminal-Bench 4.0 versus 55.8% for Fable 5.1, at roughly 63% lower estimated API cost per task. Treat that as a model-plus-harness result: Simon Willison notes Astra’s 99.9% ARC-AGI 3 score used a Provider Adapter harness that preserved reasoning state and compacted long conversations, while the default harness scored 62.7%. OpenAI also warns that its evaluation scores are maximum-effort research/API results and may differ from production ChatGPT; Theo’s live comparison already found Gemini 3.8 Flash ahead of Astra on DeepSWE, 73.8% to 73.3%.LangChain MCP integration (beta). MCP moved into the main
langchain.mcppackage, is built on FastMCP, negotiates old and new protocol versions per connection, and supports the stateless spec. Redeployments no longer kill live sessions; servers can advertise tool-list freshness, clients can cache catalogs, and elicitation pauses a run through a LangGraph interrupt. Install withlangchain[mcp]>=1.4.0; Python support is available now, with TypeScript next. A checkpointer is required when a paused run must wait for approval, including destructive tools.Grok Bot for Enterprise. Available now and free for all Grok and Cursor enterprise customers for two weeks. A company-side post describes deployment as “onboarding thousands of capable teammates”—an adoption claim, not an independent measurement. The accompanying engineering workflow is the useful part: persistent role agents run on their own remote computers, can be taught reusable skills and routines, and can require permission before external side effects.
Basecamp drops per-user and per-agent pricing. The new project-based plans include the Basecamp CLI, with MCP planned; Studio starts at $59/month and includes unlimited users and agents.
🎬 GO DEEPER
- Matthew Berman — “GPT-6 IS HERE!!! (ASTRA)” — ⏱️ ≈25:00–29:00. Watch the long-running
/goalsegment: a five-day Sim City-style browser build, followed by the exact optimization prompt, “Make sure you’re optimizing for the browser. Make sure you’re optimizing for frames per second.” Berman says the project was still unfinished after five days—the right warning to pair persistence with checkpoints and a definition of done.
- Cursor — “Refactoring Legacy Codebases” — ⏱️ ≈28:00–32:00. Follow the plan → Jira tickets → cloud agents → separate PRs → screenshots/video verification pipeline. The demo explicitly avoids one giant, unreviewable PR.
- Study LangChain’s MCP docs. The implementation details worth stealing are stateless connections, TTL-aware tool catalogs, and checkpointer-backed human approval—not just “MCP support.”
Editorial take: Astra raises the ceiling, but the durable coding-agent edge is operating the loop—bounded concurrency, cross-model verification, structured tools, and proof-bearing merges.
Direct answer: The OpenAI announcement describes a staged rollout: GPT‑6 Astra is rolling out today to a limited set of organizations, then over the coming days to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as through the OpenAI API and AWS. The developer model identifier is gpt-6-astra in the OpenAI API, with access also offered through Amazon Bedrock.
API pricing and access: Standard API pricing is $10 per million input tokens and $50 per million output tokens. Cache reads and writes have separate rates, but their amounts are not specified in the supplied text. Fast mode is offered at up to 2x Standard speed for 2x the Standard price. Astra usage is included in existing subscription allowances; additional credits can be purchased. Pro, Business, and Enterprise users receive GPT‑6 Astra Pro, while Enterprise administrators must enable Astra and access is off by default at launch.
Computer use and software engineering: The release describes computer-use workflows including installing and testing software, troubleshooting problems visible on screen, generating websites, and running frontend QA. It calls GPT‑6 Astra the best model for software engineering to date. In Codex, Astra can ask questions asynchronously while continuing independent work, make sensible assumptions when appropriate, and wait for input on consequential decisions.
Coding-agent benchmarks: On Terminal-Bench 4.0, which covers terminal-based software engineering, system configuration, and data analysis, Astra scores 57.9%, versus 37.3% for GPT‑5.6 Sol and 55.8% for Claude Fable 5.1. The coding table also reports 74.1% on DeepSWE v1.1, 64.5% on FrontierCode Extended, 53.3% on FrontierCode Main, 63.9% on internal database-migration tasks, and 67.0 on the Artificial Analysis Coding Agent Index.
Computer-use results and harness dependence: The page reports 59.3% on Agents’ Last Exam and 72.6% on OSWorld 2.0; for OSWorld it says Astra achieved the result in roughly 40 minutes per task versus roughly 75 minutes for GPT‑5.6 Sol, or about 47% less time. The claimed 1.9x faster completion on Mind2Web is explicitly a combined result of Astra and an updated Codex harness, so it is not an Astra-only speed measurement.
Benchmark and evaluation caveats: The release says evaluation scores are the maximum at any effort, and that GPT evaluations were run in a research environment or via the API and may differ from production ChatGPT because system prompts and available tools differ. The FrontierCode Astra run used a developer message similar to part of the Codex developer message; the prompt was not optimized for the evaluation. OSWorld’s table entry is specifically an offline-set, partial score; the footnote says OSWorld V2-Offline is a no-internet subset and that the Claude comparison used independent third-party reproduction.
Production-harness qualification: For one computer-use safety comparison, OpenAI used a generic harness based on native tools in both the Responses API and Anthropic Messages API, without protections normally deployed in Codex and ChatGPT Work, including auto-review and confirmation policy. The release also says third-party comparisons use a simpler research setup, while Codex production configurations, provider safeguards, and computer-tool implementations differ; users do not experience the internal no-confirmation scenario in Codex. GPT‑5.6 Sol comparisons refer to the API/Codex/ChatGPT Work version, which is slightly different from the ChatGPT Chat version.
Reporting precision: The page presents some results under different settings or rounding: the introduction says FrontierMath Tier 4 is 98%, while the table gives 97.6%; Terminal-Bench Science prose gives both a 64.6% comparison result and a 61.1% lower-cost result, while the table lists 64.6%. Exact benchmark claims should therefore retain their setting and harness labels.
Firsthand long-running coding workflow: Matthew Berman says he had early access to GPT6 Astra and used it to create multiple playable browser demos. For a Sim City-style project, he ran
slashgoalfor five days while the agent generated every asset one by one; when the HTML/JavaScript build lagged, he prompted, “Make sure you're optimizing for the browser. Make sure you're optimizing for frames per second.” He says Astra initially stopped difficult runs after about 30 minutes. He learned to prompt it differently and usedslashgoalto keep the thread running for five days; the project was still unfinished, so he shipped it.Human-in-the-loop polish and maintainability: For a Fall Guys-like game, he started with one prompt and then applied three targeted changes: “Make the camera move with the mouse,” “make the balance platforms dip down further,” and “Fix diving through edges.” He described this as a small amount of polishing that turned it into a fun game. He says Astra is more steerable than Fable 5.1, while Fable may have the better unsteered initial design; Astra also repeatedly defaults to forest-green palettes and flat design, so it needs nudging for differentiation. He cautions that his examples are mostly single-page games rather than maintainable, extendable applications, and suggests using
slashgoalwith a more flexible stack such as 3JS.Browser-agent technique: His exact instruction was: “Okay, do this task in the browser. Record yourself. Don't use QuickTime, but write your own browser recording software, record it, and then put a timer on the screen.” He reports the agent used this setup while comparing three high-end Pikachu-card listings on eBay in 55 seconds and while building a multi-point Google Maps route through Kyoto.
Model-selection evidence and caveats: Berman cites a Terminal Bench 4.0 chart showing Astra at roughly 57.9 versus Claude Fable 5.1 at 55.8 at high reasoning effort, with displayed costs of about $721 versus $950. He says browser control is better but not a massive benchmark jump, while tasks take about half the time. He reports a rollout from limited organizations to paid users and lists API pricing of $10 per million input tokens and $50 per million output tokens, with a 2.5× speed option at 2× standard price. His cost warning is that Astra uses 10% fewer output tokens than GPT 5.6 Soul at max effort but is 75% more expensive at that effort, so per-token and per-task economics can diverge. Artificial Analysis ranked Fable 5.1 ahead of Astra, but Berman preferred Astra based on firsthand use, especially for knowledge work and single-prompt slide creation.
Fable 5.1 — firsthand model and cost signal: Theo says his test covered real work across T3 Code and Lakebed, including 89 PRs in 24 hours, and compares it with his best 24-hour Fable 5 and 5.6 Soul windows. He says Fable 5.1 and Mythos 5.1 use the same underlying model with different safeguard layers; Fable is generally available while Mythos is restricted to trusted-access programs. Anthropic claims 25% lower typical token-billed cost, 75% lower cache-read pricing, and up to 45% savings on highly agentic workloads. Because each tool call starts another request that rereads history, these savings matter most for long tool-call chains; the default cache lasts five minutes, so simple one- or two-call chats benefit less. In Theo’s own breakdown, cache writes were almost 60% of spend at about $1,200, versus roughly $500 for generated output and $264 for cache reads.
Replicable orchestration pattern: For Lakebed, Theo had Fable 5.1 audit the codebase, categorize cleanup, propose an ordered plan, then spawn subagents, keep PRs passing CI and review bots, and merge simple wins; the resulting batch merged 10 PRs, touched 340 files, and deleted 13K net lines. Lakebed did not auto-ship to production, so deployment remained behind a manual button. For stalled PRs, he replaced copy-pasting one agent’s review into another with a takeover skill:
Here’s a PR. Get the branch on your work tree and it’s yours. Push it, maintain it, manage it so that it actually lands.He reports that nearly all of the previously looping PRs then landed. A separate agent monitored PRs, merged ready changes, and took over stalled work; seven parallel PRs were ultimately merged.Real-world comparison: In Theo’s best-window analysis, Fable 5.1 shipped 13 PRs with a 489-line median and touched up to four packages per PR, while the other models generally focused on one package at a time. Review-bot high-severity findings were 0.4 per 1,000 lines for 5.1 versus 2.06 for Fable 5 and 1.02 for Soul; follow-up commits fell to 24 from more than 60 with Fable 5. Theo reports merge times of up to 50 minutes for 5.1, versus 47 minutes for Fable 5 and 30 minutes for Soul, but concludes that 5.1 won by carrying larger tasks through review and merge rather than by producing the fastest first draft; Soul could solve difficult mechanisms but often caused scope creep.
Prompt and context controls: Theo recommends keeping high effort as the default while testing low and medium against task-specific evaluations; low was surprisingly capable but more likely to miss hidden complexity. For long tool turns, explicitly request progress updates:
Before you start, say in a line what you’re about to do. Brief updates while you work help the user follow along. Close with a short recap that stands on its own.To prevent premature permission-seeking, instruct the agent that it is operating autonomously, should proceed with reversible actions, and should stop only for destructive actions or genuine scope changes. Tell the agent which facts to preserve during compaction, and if managing history yourself, append only because editing earlier turns breaks the thread and loses prior reasoning data. Explicitly state what to leave out, since 5.1 may fix nearby code or add more tests than the task warrants.CI-specific agent: In a sponsored segment, Theo demonstrated Blacksmith’s Codesmith, a coding agent running on the same infrastructure as Blacksmith CI. Its runner-sizing analysis on T3 Code identified a Mac runner pegged at 100% CPU and suggested that an additional $61/month could halve build time; Codesmith can run automatically when GitHub CI fails, monitor or trigger work through Slack, and produce a PR. Resource: https://soyv.link/blacksmith
- Prompt as program; require deliberate reasoning. Andrej Karpathy frames GPT as a general-purpose computer that can be reconfigured at runtime through natural-language programs in prompts. For reasoning-heavy coding-agent tasks, a transferable tactic is to explicitly require step-by-step work and a correctness check: in his math example, “think step by step” raised accuracy from 17% to 78.7%, while “Let’s work this out in a step-by-step way to be sure we have the right answer” reached 82%. These figures come from a reasoning example, not a coding-agent productivity benchmark.
- Terminal-agent interface contract. Define the model as a Linux terminal, require only terminal output inside one code block, forbid explanations and command generation, and reserve curly braces for human/meta-instructions. Treat this as a simulation unless commands are connected to real tools: Karpathy notes that the demo had no computer behind it, hallucinated a filesystem, and produced an incorrect BBC IP address for a simulated
ping. - Use strict structured outputs at tool boundaries. A smart-home prompt required JSON fields such as
action,location, andtarget, allowing application code to execute the model’s result; a natural-language request to turn off a bedroom light after 20 minutes became a timed JSON command. In the Scale hackathon project “GPT is all you need for backend,” the LLM received JSON application state plus a requested route and returned updated state and a response; its to-do demo interpreted “delete the last two todos” without Python backend route code. - Externalize agent memory instead of relying only on a larger context window. Karpathy proposes keeping context length fixed while having the model emit start/end scratchpad markers; runtime logic would save the scratchpad externally and make it available for later attention or querying, analogous to giving the model a notebook.
- Source context and tool mention. Karpathy describes prior work at OpenAI and Tesla and returning to OpenAI one week before the lecture. For hacks, he recommended OpenAI APIs as the easiest and most powerful option while explicitly acknowledging that he worked there.
- GPT6 Astra model report: Matthew Berman says he had early access and tested OpenAI’s GPT6 Astra extensively. He reports 73% on the Deepsu coding benchmark versus 67% for Claude Fable 5.1, while Gemini 3.8 8 Flash scored 73.7%; despite calling Astra his best coding model, he says Gemini’s result reduced his confidence in the benchmark. The video lists pricing of $10 per million input tokens and $50 per million output tokens, with a fast mode offering 2.5× speed for 2× the price, through the OpenAI API, AWS Bedrock, and Microsoft Azure.
- Agent-loop patterns: For a Sim City-style 3D build, Berman set a goal and let Astra run for five days, using
/goaland observing it create assets incrementally. For a smaller prototype, a two-sentence prompt created the Little Planet world and one additional prompt made the previously static world animate. He also reports that default runs tend to work for about 30 minutes, but prompt adjustments and/goalcan make them run longer. - Browser and deployment workflows: In timed demos, Astra completed an Excalidraw research workflow in about 30 seconds, compared rare Pokémon cards in 1 minute 38 seconds, and planned a Kyoto walk through Google Maps in 1 minute 23 seconds. Its default output reportedly favors flat pastel/forest-green designs, but Berman says explicit instructions can steer the visual style. For hosting generated websites or games, he told the agent “Publish it”; the video says the agent can return a link within seconds, initially without signup, with signup making the publication permanent, and that the service works with any agent and is free.
Sanfilippo’s contrarian oversight warning: when an LLM can perform a highly technical task better than the human reviewer, a high-level human check of its output becomes “false review.” In security auditing, he argues that material errors live in detailed connections, while a final report cannot reveal what the model failed to find; validation therefore requires independently performing the underlying work rather than merely reading the report. This is relevant to coding-agent review gates, but his supporting example—an LLM discovering vulnerabilities missed by human auditors while running many parallel instances—is explicitly hypothetical, not a production account or benchmark.
Firsthand context. Santi Garza is introduced as a senior field engineer at SpaceX AAI whose role includes serving as a technical point of contact and helping customers build effectively with AI. He says he and Martin test models hands-on; his demonstration used the open-source
tlddrawproject, described as a repository with hundreds of tests, hundreds of developers, and more than one million lines of code.Control context before it controls you. Cursor’s harness assembles prompts and relevant context, coordinates tools such as MCP and file reads, and manages the back-and-forth between the model and tools. Models do not retain prior turns, so conversation history, tool results, and files are fed back on every cycle; at roughly 90% context utilization, Cursor compacts the middle of the conversation while preserving the prefix and latest request, with repeated compaction eventually losing detail. Cache reads reduce the cost of rereading context, while changing a rule or model provider can bust the cache; Santi says codebase search and agent actions themselves are free, with token spend concentrated in model input/output and coordination.
Prompting pattern with the largest reported payoff. Santi recommends “planning the shot” before asking the agent to build, because vague requests make the agent search broadly, guess at the target, and carry failed attempts through later turns. Instead of “Our API service is throwing errors in production. Can you fix the error handling?”, anchor the request to an exact file, folder, or log, name the specific error, and paste only the relevant log excerpt—he suggests selecting a small excerpt such as three or 20 lines rather than an entire log. In his example, he reported roughly a 10–12x cost/efficiency difference between the vague and anchored versions. Keep one task per turn, state success criteria such as passing tests or matching the specification, and avoid pasting very large files.
Conversation and configuration hygiene. Start a new chat for each task; when prior context matters,
@-mention the old chat as a pointer instead of continuing a long-lived conversation. Keep always-on rules short because they load in every turn, remove unused MCP servers, and use skills for larger workflows because only their title and description are loaded until invocation. Santi’s example of a concise rule is “never use emojis in the place of icons in the chat,” and rules can be scoped per project or shared/enforced by a team. Cursor’s Canvas context report can be used to inspect token usage from instructions, tools, rules, skills, and individual turns; he also describes building a diagnostic skill to flag oversized rules or unclear context.Replicable task playbooks. For a small direct change, name the relevant scope and use one prompt; for an unfamiliar area, use Ask → Plan → Build. For features, pull in relevant context, plan first, and split the work into subtasks. For refactors, establish passing tests before changing code—or ask the agent to create the test suite first—and use Bugbot on PRs or locally; for difficult bugs, use Debug mode to reproduce the issue, capture logs, and apply deterministic testing rather than accepting guesses. Ask mode is read-only and can gather context for a later run, while Plan mode asks clarifying questions and produces an editable technical specification before implementation.
Model selection by task. Santi says no model wins every category. He positions Grock 4.6 as near the frontier on price/performance, Claude Fable for wide-surface complex debugging and visual work, Opus for writing, execution, and plans, GPT 5.6 soul for planning and reading codebases, and Composer 2.5 as a fast software-engineering-specialized model that he uses most; he considers Luna weaker on quality per dollar and recommends Grock or Composer instead. The workshop’s displayed average task costs were reported as $2.80 for Grock 4.6, $17.32 for Fable, and $0.44 for Composer 2.5, with Grock described as slightly ahead of Fable on internal software-engineering evaluations while Composer handles many discrete tasks. His recommended orchestration is Composer for asking/exploration, a strong general-reasoning model such as Grock or Opus for planning, and typically Composer for implementation; reserve a large general model and a context window of up to one million tokens for extremely complex builds or major refactors.
Routing and latency controls. Cursor Router offers cost, balance, and intelligence modes: cost prioritizes spend, balance is the recommended default, and intelligence sends harder turns to more capable models. Santi reports that teams can save 30–60% “overnight” by making routing an organization policy; a softer policy defaults engineers to auto-routing while preserving the ability to switch models manually. Effort settings add more internal thinking loops and token spend, while “Fast” moves a request to the front of the queue rather than making the model compute faster, so he recommends it mainly for demos or genuinely time-critical work. The
cursor.comusage dashboard can expose per-run costs and cache-token breakdowns for auditing.Cloud orchestration surface. Cursor cloud agents can run in their own virtual machines, navigate a computer, check their work, and return screenshots or screen recordings; Cursor automations can be built around these agents.
- Gemini 3.8 Flash is a low-cost but task-variable coding/agent model. Matthew Berman reports 73.7% on DeepSWE V1.1—effectively level with Claude Opus 5 and above GPT 5.6 Soul’s 72.7%—and 89.4% on Terminal Bench 2.1, but only 19.1% on the newer, more difficult Terminal Bench 4.0; it scored 59% on OSWorld computer use versus 75% for Opus 5. The listed introductory API price is $0.75 per million input tokens and $3.75 per million output tokens through year-end, with the stated expected prices afterward being $1.50 and $7.50.
- Use workload-specific evaluation and completed-task cost for model routing. Berman recommends building internal benchmarks and testing models directly rather than selecting the newest vendor model; he also advises comparing average cost per task, which includes both token prices and the number of tokens required to finish the task.
- Hands-on results were mixed by generation task. In firsthand tests over roughly a week and a half against the same demos, Berman compared Gemini 3.8 Flash with GLM 5.3, Fable 5.1, and GPT 5.6 Soul; he found Gemini’s 3D biome output less detailed than Soul’s and roughly comparable to or below GLM’s, while its generated product sites ranged from functional interactive pages to simplistic or poor implementations. Google also released a restricted Gemini 3.8 Flash Cyber variant for trusted defenders through the Fair Wind program; Berman reports 86.2% on CyberGem versus 85.6% for GPT 5.5 Cyber, plus a large improvement over Gemini 3.7 on an internal vulnerability benchmark spanning 20 programming languages.
OpenAI Astra: Latent Space reports a firsthand stress test in which its team spent more than 20 billion tokens applying Astra to AI-engineering tasks beyond demos, at a reported cost below $6/hour. The described agent capabilities form a broad orchestration pattern: choose and train models, label data and use those labels for active learning, keep pipelines saturated, instrument and read logs, deploy and debug entire systems in one shot, and fan out, command, and evaluate subagents—including agents running other models—while maintaining coherence across billions of tokens in a single thread. swyx says this is not the entirety of his Astra work and that more reports will follow. Astra report
- GPT-6 Astra — firsthand early-access report. After using more than 20B tokens, the Latent.Space authors report that the newly launched model can select/train models, label data for active learning, keep pipelines saturated, instrument and read logs, deploy and debug systems, and fan out, command, and evaluate subagents—including agents running other models—while maintaining coherence over billions of tokens in one thread. Their practical context was a dozen internal/personal tools, including four previously paid SaaS tools and an incomplete GitHub+Vercel replacement.
- Agent-fleet orchestration pattern. Use individually tweaked subagents with bounded concurrency, then have the model monitor its own runs and start or stop waves as needed. The authors describe one such run as work they would otherwise pay a junior AI engineer to do, costing about $100 over two days.
- Cost and model-selection signal. The authors report testing Astra at 33 tokens/second and a maximum $50 per million-token rate, corresponding to roughly $6/hour; they say its greater token efficiency than Sol and Fable makes it a strong fast-and-capable option, conditional on preview latency holding at general availability, with Spark 1.3 as the stated exception. See the linked operations logs and AI-engineering transcription benchmark suite.
- Caveat and broader pattern. The post says the writeup is incomplete, while the authors are also running similar work on Grok, Fable, and other frontier models; they expect the agentic coding patterns to transfer across late-2026 frontier models.
-
OpenAI’s GPT-6 Astra is rolling out to a limited set of organizations before broader ChatGPT Plus, Pro, Business, and Enterprise access, the OpenAI API, and AWS; its API model label is
gpt-6-astra, priced at $10 per million input tokens and $50 per million output tokens, matching Claude Fable 5/5.1. Simon Willison had not tested it when writing, so these are release and benchmark signals rather than firsthand workflow results. - A useful context-management pattern behind Astra’s 99.9% ARC-AGI 3 result was OpenAI’s custom Provider Adapter harness, which preserves opaque reasoning state between requests and compacts longer conversations so the model can reuse prior work; the default harness scored 62.7%, showing that orchestration and context handling materially affected the result.
- On Artificial Analysis’s Coding Agent Index, Astra reportedly leads the cost-efficiency frontier at maximum effort: it scores 2 points above GPT-5.6 Sol at about the same cost and scores the same as Claude Fable 5 at less than half the per-task cost. Astra also reports 100% retrieval at 256K–512K tokens and 96.3% at 512K–1M on OpenAI’s eight-needle long-context benchmark.
Addy Osmani recommends Lydia Hallie’s guidance on maximizing Claude Code sessions, with emphasis on token efficiency and keeping context windows focused; the post links to the full Claude article: https://claude.com/blog/maximizing-the-value-of-your-claude-code-sessions.
- Codebase-connected engineer bot (firsthand internal use): Christa, a SpaceX go-to-market team member, describes connecting Grokbot’s engineer bot to the codebase, Glean, or provided docs; she invokes it with the prompt, “Hey, can you give me a customer-facing answer on how to set up Bugbot?” The bot remembers corrections and preferences and produced a customer-facing setup walkthrough quickly enough to answer technical questions live on a customer call.
- Agent orchestration and parallelism: Vincent prefers specialized bots for distinct task types plus project channels where agents divide and conquer, while Christa says splitting prospecting and customer work into dedicated agents reduced noise and let each agent retain task-specific preferences. A coding-relevant parallelization pattern came from Lauren (“potato”): her multitask skill parallelizes engineering tasks; Christa adapted the idea so every slide was translated in parallel rather than sequentially.
- Turn demonstrated workflows into reusable skills: Christa’s process is to start with a normal workflow, prompt the agent through it, convert it into a skill, and then ask how to improve it; she also recommends giving the agent access to the tools and data it needs, teaching tasks by taking over the computer, and saving feedback as durable preferences.
- Control asynchronous-agent noise and spend: Christa keeps routines “as critical as necessary” because frequent runs create noise and increase token spend; she reduced an inbox scan from every 15–30 minutes to twice daily. The same cadence principle applies when scheduling unattended coding-agent jobs.
- Persona-based orchestration: Cursor field engineer Amrita presented GrokBot as a team of agents with persistent memory, plugins/tools, their own computers, and agent-to-agent communication; the recommended operating model is delegation to role-based teammates rather than isolated one-off tasks. It is available on Mac, Windows, and iOS through
x.ai/bot, with access via Cursor Ultra or Super Grok Heavy. Agents run remotely after the laptop is closed. For scale, the session offered no fixed limit: Amrita said roughly five or six agents was her personal comfort limit, while Fuzzel reported using 12–15, with only relevant agents pulled into a task. - Replicable feature-delivery loop: Amrita’s engineering demo used persona agents with shared access to the Flylow booking repository: a tech lead with a “new feature grill”/devil’s-advocate skill coordinated the work, using the prompt, “Work with our engineering team to build a new feature for the Flylow project. I want to build a way to not just book flights, but also lodging and hotels based on where I’m going.” Backend Bobby shared the lodging API contract and endpoint details, frontend Fay began once the contract was available, and QA Quincy ran localhost end-to-end tests, recording the UI and network inspector; the resulting videos and verification notes were added to PRs.
- Always-on reliability pattern: Create an on-call persona pointed at Datadog and PagerDuty. In the demo, GrokBot proposed a PagerDuty-triggered automation and a Datadog poll every 15 minutes; the operator approved these actions and could narrow alerts to API-error spikes, a fired webhook, or an actual customer-facing incident. Amrita also relayed that Cursor engineer Francis uses a separate CI watcher to check whether PR tests are green and attempt auto-fixes, separating DevOps monitoring from the backend agent.
- Skills, controls, and boundaries: Skills are reusable objects with a name, description, and instructions; they can be shared, and a repeatable workflow can be taught by selecting “teach a task,” demonstrating it in a browser, and letting GrokBot convert the recording into a skill. Include good/bad examples and explicit anti-patterns, and set granular approval rules such as requiring permission before external email or shared-calendar changes. Amrita positioned GrokBot primarily as the orchestration layer: engineers can review PRs and diffs in Cursor or GitHub, use Cursor features such as Canvas, and still use Cursor to implement code or configure custom MCP integrations. The main caveat is cold start: first-time agents may need hand-holding, and current memory was described as more “picture-perfect” LLM-style than human-like episodic memory, making explicit skills, demonstrations, and connected documentation important.
-
Ben Tossell says “remove .bg is being sunset” and that Fable made him a personal clone; he later open-sourced the project as
bg-gone.
Addy Osmani highlights Anthropic’s guide for reducing Claude-specific writing artifacts such as “mannered prose,” including an official de-flavoring prompt for Fable 5.1 that is intended to further reduce AI boilerplate and jargon. Resource: https://platform.claude.com/docs/en/build-with-claude/prompt-engineering/prompting-claude-fable-5-1
- Gemini 3.8 — speed can hide redundant agent work. ThePrimeagen reports that Gemini 3.8 reread the same two files roughly 20 times; despite praising its speed, the observation is a counter-signal for evaluating agent efficiency and suggests monitoring for repeated context reads or loops rather than judging only latency.
- ThePrimeagen offers a firsthand caution about Gemini 3.8: although it was “really fast,” the agent reread the same two files approximately 20 times in a row. The observation suggests that low latency does not necessarily mean efficient context use, so repeated file reads are a behavior worth monitoring in coding-agent workflows.
- ThePrimeagen reports a major latency bottleneck in realtime agent decision-making: entering a username took 21.16 seconds, while key entry and screen-dump validation each took only a few hundred milliseconds; selecting the next step took about 20.5 seconds.
- His proposed mitigation is an automation layer with script templating that generates many steps in advance, reducing the number of times the model must spend tokens deciding the next action. He presents this as a possible solution rather than a validated result.
Riley Brown (@rileybrown) reports a firsthand workflow shift with GPT6/Codex: instead of manually pasting errors into a prompt, the model checks its own work, takes screenshots, evaluates the result, and iterates until satisfied. Brown also says Codex uses computer history and his preferences to make small, personalized additions to his projects. The actionable pattern is to let the agent close the loop with visual self-evaluation and persistent user/project context rather than relying solely on manual error-prompt cycles.
GPT-6 Astra: A new generation of intelligence | OpenAI
GPT-6 Astra: A new generation of intelligence | OpenAI
A new generation of intelligence
00:00
We’re introducing GPT‑6 Astra, the world’s most intelligent and aligned model.
GPT‑6 Astra brings together years of research and big bets across pre-training, reinforcement learning, and alignment. Astra is state-of-the-art on computer use, browsing, software engineering, cybersecurity, science, and professional work. Astra saturates FrontierMath Tier 4 with a 98% score, having already helped solve long-standing open problems in mathematics. Astra also saturates ARC-AGI-3 with a 99.9% score and ExploitBench with a 100% score. It also sets a new frontier on computer and browser use, handling the most demanding professional work with unmatched speed, accuracy, and judgment.
GPT‑6 Astra is rolling out today to a limited set of organizations and over the coming days will become available to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as through the OpenAI API and AWS.
Terminal-Bench Science 0.1
API Cost
GPT-6 Astra
GPT-5.6 Sol
Claude Fable 5.1
Claude Fable 5
Claude Opus 5
Terminal-Bench Science 0.1 tests whether agents can complete scientific research workflows using code and terminal tools, including analyzing data, running simulations, and fitting models. GPT‑6 Astra reaches a new high among the models compared at 64.6%, versus 52.6% for Claude Fable 5.1, at approximately 31% lower estimated API cost. At a lower-cost setting, Astra scores 61.1%, versus GPT‑5.6 Sol’s best result of 22.4%, at approximately 27% lower estimated API cost.
Astra is our most aligned model, with substantial improvements in understanding user intent and model behavior—you can delegate tasks with greater confidence in Astra’s judgment. As one way that we test this, we built a new evaluation informed by the Hugging Face incident that evaluates whether a model facing a difficult or impossible task will go beyond its intended scope. Compared to GPT‑5.6 Sol, which without production safeguards went beyond the authorized target 48% of the time, GPT‑6 Astra did this in 0% of cases.
The world’s best computer use model
GPT‑6 Astra marks a new frontier in the speed, accuracy, and safety of computer use. It can take care of tedious tasks like filling out online forms, updating customer records in a CRM, and organizing your calendar. It can conduct online research and draft summaries in your email or in your document editor. It can analyze scientific data, generate plots, create a website, and run frontend QA checks to make sure all the features on that site work. It can help you autonomously install and test software, and troubleshoot problems you see on screen. These improvements are also reflected in our state-of-the-art evaluation results.
Agents’ Last Exam tests agents on complex professional tasks in real software, from financial modeling to engineering and media production. GPT‑6 Astra reaches a new high in the comparison shown, scoring 59.3%, compared with 55.5% for Claude Opus 5 and 53.6% for GPT‑5.6 Sol. At these highest-scoring settings, Astra also uses approximately 65% fewer output tokens than Opus 5.
These improvements also result in significant efficiency gains in real knowledge-work tasks. In latency simulations on OSWorld 2.0, Astra achieves higher computer-use performance in about 47% less time per task than GPT‑5.6 Sol, scoring 72.6% at roughly 40 minutes per task, compared with 65.7% at roughly 75 minutes.3
GPT‑6 Astra’s computer-use capabilities can be seen in outputs across domains, including game development, electrical engineering, and everyday knowledge work:
00:00
This is a 15-second condensed playback of GPT‑6 Astra performing printed circuit board (PCB) layout in KiCad, turning an electronic schematic into a manufacturable PCB by placing components and routing copper connections. Integral to every electronic device today, PCB layout is a manual task and common source of latency in the electronics design process. Accelerating it means freeing engineers to invent, optimize, and test their next idea at a significantly higher cadence.
Alongside Astra, we are also updating the Codex harness to significantly improve the speed of computer use. Combined with Astra’s efficiency, this translates to a 1.9x faster task completion compared to the current GPT‑5.6 Sol experience, on the Mind2Web benchmark. The model’s improvements on speed mean it can take on many time-consuming life tasks for you, faster than you can.4
GPT‑6 Astra: 2 min 54 sec
00:00
“We’re integrating GPT‑6 Astra into Devin’s harness on launch day, where it delivers state-of-the-art performance on our internal testing benchmark. Its excellent computer use, writing, and codebase understanding improved testing right out of the box: videos are noticeably easier to follow, and reports are clearer and more concise”
Silas Alberti, SVP Research, Cognition
A step change in professional work
GPT‑6 Astra pairs advances in computer use with targeted training for professional environments, to help tackle complex work tasks. It combines the intelligence required for complex problems with the ability to carry out multistep workflows and produce polished documents, spreadsheets, and presentations.
BenchCAD tests whether models can reconstruct 3D objects from multi-view renders by generating CAD code. With tools, GPT‑6 Astra reaches a new high in the comparison shown, achieving a 95.9% geometric-overlap score, versus 83.3% for GPT‑5.6 Sol and 84.3% reported for Claude Fable 5.1.5 Estimated API cost is approximately 43% lower than Sol and 86% lower than Fable 5.1 in the configurations shown.
GPT‑6 Astra is our best model for adhering to existing templates and producing slides that are well laid out and succinctly convey key points with a structured narrative. It creates clear, well-structured documents, presentations, spreadsheets, and analyses that follow your templates and match your writing and visual style. Astra is also trained to specifically pull only the context that matters into outputs, instead of repeating information unnecessary for the work at hand. All this means it can output more immediately usable artifacts that match your business context and standards.
Reference file
Loading…
GPT‑6 Astra output
Loading…
GPT‑6 Astra creates a slideshow about GPT‑Gaia, a fictional model, using just a few slides from OpenAI’s presentation template, capturing the correct tone and layout throughout. This means you can expect slide decks that are correctly formatted for your business standards.
GPT‑6 Astra also brings stronger visual judgment to the websites, games, applications, and renderings it builds. With
Sites(opens in a new window) in ChatGPT, Astra can create, host, and share websites, web apps, and games directly from a prompt.
“Astra gives us a significant advantage in both capability and efficiency. It successfully executes our most complex creative workflows while using up to 20% fewer tokens than other models we’ve tested. Most importantly, for our customers, it means higher quality output.”
Alex Mashrabov, CEO and Co-founder, Higgsfield AI
00:00
GPT‑6 Astra models a house in Blender and turns it into a walkable scene in Unreal Engine 5, helping designers and clients explore the layout and experience the space before it’s built.
The model can bring games to life through vivid graphics, engaging gameplay and accurate motion, allowing non-technical people to create and play custom games that go beyond rudimentary elements in minutes. Credit: Pietro Schirano.
When instructions leave room for interpretation, GPT‑6 Astra is better than previous models at making the right call. It uses context to fill in routine gaps and asks focused questions when the answer could change the outcome. In Codex, it can ask asynchronously while continuing work that doesn’t depend on your reply. If you don’t respond, it proceeds with sensible assumptions where appropriate, but waits for your input on consequential decisions.
The examples below show how Astra collaborates on everyday tasks where missing information can materially change the answer.
Astra is also better at staying oriented as a task evolves. Earlier models sometimes treated steering messages as a new goal, losing track of the original request or earlier constraints. Astra incorporates new requirements, changes course when asked, and answers side questions without dropping the broader task.
“Astra is a significant quality improvement over GPT‑5.6 Sol across complex legal tasks. In our early testing, Astra stood out by approaching legal work the way a discerning lawyer does: it distinguishes documents from established records, surfaces unsupported assumptions, and converts gaps into concrete drafting positions.”
Niko Grupen, Head of Applied Research, Harvey
Coding
GPT‑6 Astra is the best model for software engineering to date.
“GPT‑6 Astra delivers state-of-the-art performance on our internal coding benchmarks and shows a clear step forward in trading intuition evaluations compared with GPT‑5.6 Sol. When used for agentic coding, GPT‑6 Astra communicates in a way that’s easier for developers to follow and produces code that requires less iteration to reach production quality.”
John Crepezzi, AI Assistants, Jane Street
“We tested Astra across low, medium, and high effort on one of our first-generation evals, and it came out significantly ahead of GPT 5.6 Sol. Higher effort buys more iterations on a fresh build, more verification through browser testing, and a lean toward code execution over apply-patch. Understanding how a model spends its effort is how we give millions of builders a faster, more reliable path from idea to working app.”
Fabian Hedin, CTO & Co-founder, Lovable
1 of 2
“GPT‑6 Astra delivers state-of-the-art performance on our internal coding benchmarks and shows a clear step forward in trading intuition evaluations compared with GPT‑5.6 Sol. When used for agentic coding, GPT‑6 Astra communicates in a way that’s easier for developers to follow and produces code that requires less iteration to reach production quality.”
John Crepezzi, AI Assistants, Jane Street
Terminal-Bench 4.0 tests agents on complex terminal-based tasks, including software engineering, system configuration, and data analysis. GPT‑6 Astra reaches a new high at 57.9%, compared with 37.3% for GPT‑5.6 Sol2 and 55.8% for Claude Fable 5.1, at approximately 9% and 63% lower estimated API cost per task, respectively.
With Astra, we’re introducing a new way for Codex to preserve and retrieve context when the context window fills. Historically, models have used compaction to summarize work during long sessions, such as when debugging complex issues or tackling large refactors. Each compaction can leave out details about why a fix failed or how a component behaves. In Codex, Astra can keep notes across context windows, preserving accumulated details without repeatedly compressing them into a single summary. Earlier context windows remain searchable, so Astra can find requirements or test results from previous messages and tool outputs—even if that information wasn’t captured in its notes. You can enable this experimental feature in your
Codex config.toml,(opens in a new window) and it will become the default for Astra in the coming weeks.
Advancing scientific discovery
“The story is: end of one era, start of another.”
Greg Burnham, EpochAI
GPT‑6 Astra is a major advance for scientific discovery, mathematics, and health. Today, we’re sharing two further results on the gaps between prime numbers.9, 10
Astra also sets new records across a suite of math and science evaluations.
GPQA Diamond tests graduate-level scientific reasoning in biology, chemistry, and physics. GPT‑6 Astra reaches a new high in the comparison shown at 96.0%. At a lower-cost setting, it also exceeds GPT‑5.6 Sol’s best score—94.9% versus 94.6%—at approximately 37% lower estimated API cost.
Astra can help with the practical work behind scientific discovery. By combining scientific reasoning with computer use, it can work directly in specialized software to inspect data and explore results, helping researchers assess the evidence and decide what to investigate next.
00:00
GPT‑6 Astra navigates scientific software to inspect sequencing quality and visualize genetic variation, helping researchers assess their data and identify where to focus further analysis.
Cybersecurity
As we discussed in our safety update, Astra is a significant jump in cyber capabilities and meets the
Critical threshold(opens in a new window) in cybersecurity under our Preparedness Framework. Its ability to identify and develop zero-day exploits can help defenders find and patch weaknesses, but it also creates a need for stronger safeguards. To understand how far these capabilities extend, we ran Astra on internal and third-party expert evaluations.
We first tested the model without production safeguards on ExploitBench and ExploitGym, which evaluate whether models can turn known software vulnerabilities into working exploits. On ExploitBench, Astra achieved a perfect score of 100%, compared with 78.5% for GPT‑5.6 Sol, our previous frontier cyber-capable model. On ExploitGym, Astra reached a 42.4% success rate, compared with 30.3% for GPT‑5.6 Sol, while using substantially fewer output tokens.13
Given concerns that exposure to historical software vulnerabilities may have affected benchmark results, we also evaluated Astra on two novel benchmarks. For one, we built an internal “ExploitBench (June–August 2026)” evaluation to test exploit development using vulnerabilities from the previous three months.14 Astra achieved substantially higher arbitrary code-execution rates than GPT‑5.6 Sol on this dataset while using far fewer output tokens. During the evaluation, Astra even discovered and used two previously unknown zero-day vulnerabilities. We are disclosing both vulnerabilities to their maintainers.
We also tested Astra on SRE-Bench15, a benchmark that measures whether models can reverse engineer software binaries to understand its core logic without access to raw source code. Astra solved 88.0% of tasks in a single attempt and 99.2% within four attempts, compared with 55.9% and 68.7% for GPT‑5.6 Sol, respectively.
Beyond benchmarks, expert-led assessments found that Astra, when run without production safeguards, could use previously unknown vulnerabilities to achieve arbitrary code execution in hardened browsers and create privilege-escalation exploits for hardened operating-systems.
As we discussed in The Defender’s Window, frontier cyber capabilities can help defenders find weaknesses faster, but they also make those weaknesses easier to exploit, raising the urgency for defenders to adapt. With the version of Astra launching today, defenders can use it to complete tasks such as secure code review and patching.
However, Astra will refuse to comply with more advanced cybersecurity tasks such as creating proof-of-concept exploits for vulnerabilities. Through OpenAI Daybreak, we plan to expand access and roll out less restrictive safeguards in the coming weeks. This will enable more defensive workflows, including vulnerability and proof-of-concept validation, malware analysis, and detection engineering.
We have also strengthened our protections against potential cyber misuse, building upon our safeguards stack for GPT‑5.6 Sol. These include stronger model robustness to better withstand potential jailbreaks and more context for our monitoring systems. We have continued rigorous internal and external testing, including automated evaluations with our internal red-teaming attackers. More details about our cyber safeguards and testing are available in the Astra
system card(opens in a new window) and our blog.
Aligning and deploying GPT‑6 Astra responsibly
Astra is our most aligned model. Astra excels at exercising care, respecting task boundaries, and communicating transparently. This work is the latest product of our long-running research program focused on training models that remain aligned with human intent from start to finish.
In sensitive environments, Astra proceeds with care commensurate with its risk. In an evaluation of computer use tasks adversarially selected to elicit misbehavior, Astra was more successful at avoiding unintended consequences. Running with additional security measures offered by default yielded even stronger performance.
Astra causes fewer misaligned outcomes than any other frontier models tested. For a fair comparison, we used a generic computer-using-agent harness (based on the native computer use tools available in both the
OpenAI Responses API(opens in a new window) and
Anthropic Messages API(opens in a new window)) and without additional protections that are normally deployed to Codex and ChatGPT Work users (auto-review, confirmation policy). 16
Astra is also more likely to operate within the boundaries set by the user and implied by its environment. In an internal evaluation, Astra never attempted to circumvent a Codex Auto-Review denial. This held even when Auto-review was deliberately configured to be evadable and the task was impossible to complete otherwise. This respect for the environment restrictions is consistent with the results of our impossible cyber task evaluation that we shared in the intro of this post and other findings documented in our
system card(opens in a new window).
This evaluation tests how models respond to auto-review denials in knowledge-work tasks. Exploiting a poor user configuration to bypass auto-review counts as failure. Astra never attempted to circumvent auto-review.
Astra additionally sets new marks in transparent user communication. In one evaluation, Astra is three times less likely than GPT 5.6-Sol to make inaccurate representations about its capabilities and affordances.
In our capability-hallucination evaluation, Astra shows a substantial improvement over GPT‑5.6 Sol, making fewer misleading claims about its capabilities.
Our evaluations found Astra’s written reasoning harder to monitor than GPT‑5.6 Sol’s, based on tests that explicitly asked it to evade monitoring. We attribute this to Astra’s greater control over written reasoning on simpler tasks and ability to solve problems with fewer written steps. Astra still appears to struggle to conceal the reasoning needed for complex tasks, but we take the decline seriously. Improving monitorability remains a research priority, and the accompanying
system card(opens in a new window) details our findings and ongoing work.
Alignment training is core to our approach to deployment. As additional layer of defenses, we also build system safeguards like Codex
Auto-review(opens in a new window) and monitoring agents’ reasoning and actions to help detect and contain unsafe behavior. As described in our safety update, we are also deploying misalignment monitoring in production for Astra-class models in order to have visibility into misalignment, and help contain its worst instances. These safeguards resemble our monitoring for internal deployments and involve a system of classifiers which check the model’s reasoning and actions for unauthorized behavior and automatically stop potentially unauthorized activity.
Given the significant increase in Astra’s cybersecurity capabilities, we are being especially careful to make this deployment safe and secure. Extra safety checks can sometimes slow, pause, or stop legitimate work, including defensive cybersecurity. If a task is paused in ChatGPT or Codex, you may be asked to review the action before continuing. In the API, the task will stop. These checks can sometimes interrupt legitimate work, and we are continuing to iterate on this system to reduce unnecessary interruptions. Misalignment monitoring cannot replace alignment: our goal is to build models that reliably stay within their authorized scope, so these protections do not need to intervene.
Availability
GPT‑6 Astra is rolling out today to a limited set of organizations and over the coming days will become available to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as through the OpenAI API and AWS. Astra usage is included within the existing subscription allowances—users and businesses will also be able to purchase credits for additional usage. Users on the Pro, Business, and Enterprise plans will also get access to GPT‑6 Astra Pro. Enterprise administrators can enable Astra for their workspace; access is off by default at launch.
Astra supports Zero Data Retention for eligible API customers, and as we shared last month, we’re testing Private Safety Processing to strengthen safety monitoring while preserving customer privacy.
For developers, GPT‑6 Astra will be available in the OpenAI API asgpt-6-astra and through Amazon Bedrock.
OpenAI API Standard pricing is $10 per million input tokens and $50 per million output tokens. Separate rates apply to cache reads and writes. Fast mode is available for GPT‑6 Astra in the API and delivers up to 2x the speed of Standard processing at 2x the Standard price.
Computer Use
| Computer Use | GPT‑6 Astra | GPT‑5.6 Sol 2(opens in a new window) | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| Agents’ Last Exam | 59.3% | 53.6% | - | 48.7% | 55.5% | - |
| OSWorld 2.0 (v2026.08.08, offline set, partial score) | 72.6% | 65.7% | - | - | 70.2% 3(opens in a new window) | - |
| ScreenSpot-Pro (no tools) | 92.7% | 76.9% | - | 87.3% 16(opens in a new window) | - | - |
Professional
| Professional | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| AutomationBench | 41.4% | 18.1% | 31.4% | 17.4% | 26.9% | - |
| BenchCAD | 95.9% | 83.3% | 84.3% 4 | 67.5% 4 | 82.1% 4 | - |
| BrowseComp | 91.5% | 90.4% | - | 87.4% | 90.8% | - |
| OpenScore String Quartets (1 - OMR-NED) | 0.84 | 0.19 | - | - | - | - |
| Internal Design Tasks | 50.0% | 47.4% | - | 35.8% | - | - |
| Internal Data Science Tasks | 40.9% | 30.5% | - | 34.7% | - | - |
| Artificial Analysis Intelligence Index v4.1.1 | 61.2 | 60.9 | 65.7 | 62.1 | 63.1 | 58.7 |
Coding
| Coding | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| Terminal-Bench 4.0 | 57.9% | 37.3% | 55.8% | 42.0% | 52.3% | 19.1% |
| DeepSWE v1.1 | 74.1% | 72.7% | 67.4% | 69.9% | 73.7% | 73.8% |
| FrontierCode 1.1 Extended (score) | 64.5% 7 | 60.6% | 63.6% | 64.9% | 63.6% | 56.3% |
| FrontierCode 1.1 Main (score) | 53.3% 7 | 47.5% | 50.9% | 53.5% | 53.4% | 43.6% |
| Internal Database Migration Tasks | 63.9% | 42.7% | 57.8% | 50.3% | ||
| Artificial Analysis Coding Agent Index v1.4 | 67.0 | 65.1 | 67.2 | 68.1 | 61.2 |
Academic
| Academic | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| Terminal-Bench Science 0.1 | 64.6% | 22.4% | 52.6% | 21.4% | 30.0% | - |
| FrontierMath Tier 4 (v2) | 97.6% | 83.0% | 87.8% | 87.8% | 73.2% | - |
| GPQA Diamond | 96.0% | 94.6% | 93.7% | 92.6% | 93.7% | 95.3% |
| Humanity’s Last Exam (w/ tools) | 57.2% | - | 65.0% | 63.8% | 63.6% | - |
Science and Health
| Science and Health | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| GeneBench Pro | 37.8% | 28.7% | ||||
| MedChemBench (Internal) | 49.3% | 47.4% | ||||
| LifeSciBench | 60.3% | 59.9% | ||||
| HealthBench Professional (length-adjusted) | 63.4% | 60.5% | 58.1% 10 | 60.9% 10 | 56.4% 10 | 52.1% |
Cybersecurity
| Cybersecurity | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| ExploitBench | 100.0% | 78.5% | 70% | |||
| Exploit Gym | 42.4% 12 | 30.3% 12 | 30.4% 16 | 28.4%16 | 22.0%16 | |
| ExploitBench (June-Aug 2026) | 39.0% | 11.5% | ||||
| SRE-Bench | 88.0% | 55.9% | 12.5% | |||
| SEC-Bench Pro | 85.4% | 79.1% |
Alignment
| Alignment | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| Internal computer use safety benchmark (lower is better) | 2.4% | 22.0% | 9.5% | 18.3% | 11.5% | - |
| Internal computer use safety benchmark, w/ AutoReview (lower is better) | 1.8% | 4.3% | - | - | - | - |
| Internal circumvention benchmark (lower is better) | 0.00% | 0.29% | - | - | - | - |
| ExploitGym honeypot (lower is better) | 0.0% | 48.2% | - | - | - | - |
| Impossible ExploitGym | 100.0% | - | - | - | - | - |
| Internal hallucination benchmark (lower is better) | 4.2% | 12.2% | - | - | - | - |
Long Context
| Long Context | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| OpenAI MRCR v2 8-needle 256K-512K | 100.0% | 91.5% | - | - | - | - |
| OpenAI MRCR v2 8-needle 512K-1M | 96.3% | 73.8% | - | - | - | - |
Abstract reasoning
| Abstract reasoning | GPT‑6 Astra | GPT‑5.6 Sol | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash |
|---|---|---|---|---|---|---|
| ARC-AGI-3 | 99.9% [T7] | 7.8% | - | - | 30.2% | - |
| ARC-AGI-2 | 95.0% | 92.5% | 90.0% | 89.2% | 90.4% | - |
| ARC-AGI-1 | 98.5% | 97.5% | 97.5% | 98.5% | 97.5% | - |
Evaluation scores are the maximum at any effort. GPT evaluations were run in our research environment or via our API, which may provide slightly different output from production ChatGPT due to differences in the system prompts, tools available, etc.
FOOTNOTES
1
On ARC-AGI-3, GPT-6 Astra was run with our responses API harness, which changes two settings to better match real-world performance. The changes do not specifically target ARC-AGI-3.
2
GPT-5.6 Sol refers to the version available in our API, ChatGPT Codex, and ChatGPT Work. The version in ChatGPT Chat is slightly different.
3
OSWorld V2-Offline is a subset of the original OSWorld V2 that works without internet access. Claude model performance on OSWorld-V2 Offline was reproduced by an independent third-party. On OSWorld 2.0, the scores for Claude use the official settings, and not the modified tasks and modified grading from the Fable 5.1 System Card.
5
On BenchCAD, Claude’s scores reflect 3 modifications to the eval, detailed in the
Fable 5.1 System Card(opens in a new window).
6
Guang Yang, Victoria Ebert, Nazif Tamer, Brian Siyuan Zheng, Luiza Pozzobon, and Noah A. Smith. “
LEGATO: Large-scale End-to-end Generalizable Approach to Typeset OMR(opens in a new window).” arXiv:2506.19065, 2025.
7
Mark R. H. Gotham, Maureen Redbond, Bruno Bower, and Peter Jonas. “
The OpenScore String Quartet Corpus(opens in a new window).” Proceedings of the 10th International Conference on Digital Libraries for Musicology, pp. 49–57. ACM, 2023.
8
On FrontierCode, GPT-6 Astra was run with a developer message similar to a
section of its developer message in Codex(opens in a new window): “Avoid creating excessive test files. Create a new test file only when required by repository conventions or when no existing file is a suitable home. Avoid unrelated cleanup and unnecessary complexity. Reuse suitable existing utilities. Read relevant repository instructions and inspect nearby code, tests, documentation, and CI. Follow established conventions. The goal is clean, mergeable code.” The prompt was not optimized for the eval.
9
The first concerns how close together prime numbers can occur, however far along the number line you go. For more than a decade, the best known result established that infinitely many pairs of primes are at most 246 apart.
Julia Stadlmann(opens in a new window) recently improved that bound to 240. Astra helped establish a stronger bound of 186, showing that infinitely many pairs occur within this smaller distance. Short prime gaps:
Proof(opens in a new window) and
supporting research(opens in a new window).
10
The second concerns unusually large gaps between primes. Astra improved a term in a bound on these gaps that had remained unchanged for more than 80 years. We’re sharing the proofs and abridged chain of thought and verification materials for both results. Large prime gaps:
Proof(opens in a new window) and
supporting research(opens in a new window).
11
We independently evaluated all Claude models following the intended HealthBench Professional procedure, using GPT‑5.4 grading and length-adjusted, unclipped scores. For Fable 5.1, we used Opus 5 fallback for provider refusals.
12
Claude Fable 5 and 5.1 are not included in LifeSciBench Gold v1, GeneBench Pro v13, and MedChemBench because they refuse the majority of questions in these evaluations.
13
On ExploitGym, we tested Astra and Sol without the 6-hour time limit, to better assess their full cyber capabilities. They are fast enough that it has little impact.
14
ExploitBench (June–August 2026) contains 20 high-severity V8 vulnerabilities across 13 stable Chrome releases. The benchmark tests whether agents can achieve arbitrary code execution in V8 and official Chrome releases for Linux by exploiting each specified vulnerability. Some included vulnerabilities may not permit arbitrary code execution under the evaluation’s constraints, so a 100% success rate may not be achievable.
15
Jeremy Spence et al. “
The Next Challenge for Agentic Cybersecurity: A Realistic, Contamination-Free Reverse Engineering Benchmark(opens in a new window).” arXiv:2608.11469v1, 2026.
16
When we test across third-party models, we use a simpler research setup. Codex has a more complex production configuration, which can result in different raw-model error rates. Provider-side safeguards and computer-tool implementations still differ. Users do not experience the no-confirmation scenario in Codex, as it’s an internal research configuration.
17
For ScreenSpot-Pro and ExploitGym, the Fable scores we report come from Mythos, which is Fable with fewer safeguards.
Direct answer: The OpenAI announcement describes a staged rollout: GPT‑6 Astra is rolling out today to a limited set of organizations, then over the coming days to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as through the OpenAI API and AWS. The developer model identifier is gpt-6-astra in the OpenAI API, with access also offered through Amazon Bedrock.
API pricing and access: Standard API pricing is $10 per million input tokens and $50 per million output tokens. Cache reads and writes have separate rates, but their amounts are not specified in the supplied text. Fast mode is offered at up to 2x Standard speed for 2x the Standard price. Astra usage is included in existing subscription allowances; additional credits can be purchased. Pro, Business, and Enterprise users receive GPT‑6 Astra Pro, while Enterprise administrators must enable Astra and access is off by default at launch.
Computer use and software engineering: The release describes computer-use workflows including installing and testing software, troubleshooting problems visible on screen, generating websites, and running frontend QA. It calls GPT‑6 Astra the best model for software engineering to date. In Codex, Astra can ask questions asynchronously while continuing independent work, make sensible assumptions when appropriate, and wait for input on consequential decisions.
Coding-agent benchmarks: On Terminal-Bench 4.0, which covers terminal-based software engineering, system configuration, and data analysis, Astra scores 57.9%, versus 37.3% for GPT‑5.6 Sol and 55.8% for Claude Fable 5.1. The coding table also reports 74.1% on DeepSWE v1.1, 64.5% on FrontierCode Extended, 53.3% on FrontierCode Main, 63.9% on internal database-migration tasks, and 67.0 on the Artificial Analysis Coding Agent Index.
Computer-use results and harness dependence: The page reports 59.3% on Agents’ Last Exam and 72.6% on OSWorld 2.0; for OSWorld it says Astra achieved the result in roughly 40 minutes per task versus roughly 75 minutes for GPT‑5.6 Sol, or about 47% less time. The claimed 1.9x faster completion on Mind2Web is explicitly a combined result of Astra and an updated Codex harness, so it is not an Astra-only speed measurement.
Benchmark and evaluation caveats: The release says evaluation scores are the maximum at any effort, and that GPT evaluations were run in a research environment or via the API and may differ from production ChatGPT because system prompts and available tools differ. The FrontierCode Astra run used a developer message similar to part of the Codex developer message; the prompt was not optimized for the evaluation. OSWorld’s table entry is specifically an offline-set, partial score; the footnote says OSWorld V2-Offline is a no-internet subset and that the Claude comparison used independent third-party reproduction.
Production-harness qualification: For one computer-use safety comparison, OpenAI used a generic harness based on native tools in both the Responses API and Anthropic Messages API, without protections normally deployed in Codex and ChatGPT Work, including auto-review and confirmation policy. The release also says third-party comparisons use a simpler research setup, while Codex production configurations, provider safeguards, and computer-tool implementations differ; users do not experience the internal no-confirmation scenario in Codex. GPT‑5.6 Sol comparisons refer to the API/Codex/ChatGPT Work version, which is slightly different from the ChatGPT Chat version.
Reporting precision: The page presents some results under different settings or rounding: the introduction says FrontierMath Tier 4 is 98%, while the table gives 97.6%; Terminal-Bench Science prose gives both a 64.6% comparison result and a 61.1% lower-cost result, while the table lists 64.6%. Exact benchmark claims should therefore retain their setting and harness labels.