
OpenAI 官方 benchmark 显示 Astra 在多项 agent、电脑操作、编码、科学与网络安全任务上抬高上限,但 HLE、Artificial Analysis 指数以及访问权限仍改变最终判断。
— 表示该来源没有披露该项,绝不表示零分。5678| Benchmark | 类别与指标条件 | GPT-6 Astra | GPT-5.6 Sol | GPT-5.6 Terra | GPT-5.6 Luna | Claude Fable 5.1 | Claude Fable 5 | Claude Opus 5 | Gemini 3.8 Flash | Gemini 3.1 Pro | DeepSeek-V4-Pro | DeepSeek-V4-Flash | Kimi K3 | GLM-5.3 | GLM-5.3-Flash | GLM-5.2 | 来源与口径 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Agents’ Last Exam | Computer Use;百分比 | 59.3% | 53.6% | — | — | — | 48.7% | 55.5% | — | — | 25.7% | 25.2% | 27.6% | 28.5% | — | 23.8% | Astra 同页;DeepSeek 与 GLM 为各自官方对照图 |
| OSWorld 2.0 partial | Computer Use;部分任务,百分比 | 72.6% | 65.7% | — | — | — | — | 70.2% | — | — | — | — | — | — | — | — | OpenAI 同页 |
| ScreenSpot-Pro | Computer Use;百分比 | 92.7% | 76.9% | — | — | — | 87.3% | — | — | — | — | — | — | — | — | — | Claude 数字为 Mythos / 少 safeguards 配置 |
| AutomationBench | Professional / agents;百分比 | 41.4% | 18.1% | — | — | 31.4% | 17.4% | 26.9% | — | — | 31.8% | 25.1% | 30.8% | 48.2% | — | 26.2% | OpenAI 同页;DeepSeek 为 Public;GLM 为官方图 |
| BenchCAD | Professional;百分比 | 95.9% | 83.3% | — | — | 84.3% | 67.5% | 82.1% | — | — | — | — | — | — | — | — | Claude 评测有三处修改 |
| BrowseComp | Professional;百分比 | 91.5% | 90.4% | — | — | — | 87.4% | 90.8% | — | 85.9% | — | — | — | — | — | — | Gemini 数字来自 3.1 Pro model card,条件不同 |
| OpenScore String Quartets | Professional;分数 | 0.84 | 0.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 同页 |
| Internal Design Tasks | Professional;百分比 | 50.0% | 47.4% | — | — | — | 35.8% | — | — | — | — | — | — | — | — | — | OpenAI 内部任务 |
| Internal Data Science Tasks | Professional;百分比 | 40.9% | 30.5% | — | — | — | 34.7% | — | — | — | — | — | — | — | — | — | OpenAI 内部任务 |
| Artificial Analysis Intelligence Index v4.1.1 | Professional;指数 | 61.2 | 60.9 | — | — | 65.7 | 62.1 | 63.1 | 58.7 | — | — | — | — | — | — | — | OpenAI 同页;指数由 Artificial Analysis 测量,表内数字按发布页口径 |
| Terminal-Bench 4.0 | Coding;百分比 | 57.9% | 37.3% | — | — | 55.8% | 42.0% | 52.3% | 19.1% | — | — | — | — | — | — | — | OpenAI 同页 |
| DeepSWE v1.1 | Coding;百分比 | 74.1% | 72.7% | — | — | 67.4% | 69.9% | 73.7% | 73.8% | — | 62.7% | 54.4% | 67.5% | 66.9% | — | 46.2% | OpenAI 同页;DeepSeek 与 GLM 版本 / harness 各自不同 |
| FrontierCode 1.1 Extended | Coding;百分比 | 64.5% | 60.6% | — | — | 63.6% | 64.9% | 63.6% | 56.3% | — | — | — | — | — | — | — | Fable 5 在该条件最高 |
| FrontierCode 1.1 Main | Coding;百分比 | 53.3% | 47.5% | — | — | 50.9% | 53.5% | 53.4% | 43.6% | — | — | — | — | — | — | — | Fable 5 在该条件最高 |
| Internal Database Migration Tasks | Coding;百分比 | 63.9% | 42.7% | — | — | 57.8% | 50.3% | — | — | — | — | — | — | — | — | — | OpenAI 内部任务 |
| Artificial Analysis Coding Agent Index v1.4 | Coding;指数 | 67.0 | 65.1 | — | — | 67.2 | 68.1 | 61.2 | — | — | — | — | — | — | — | OpenAI 同页;Fable 5 高于 Astra | |
| Terminal-Bench Science 0.1 | Academic / science;百分比 | 64.6% | 22.4% | — | — | 52.6% | 21.4% | 30.0% | — | — | — | — | — | — | — | — | OpenAI 同页 |
| FrontierMath Tier 4 v2 | Academic;百分比 | 97.6% | 83.0% | — | — | 87.8% | 87.8% | 73.2% | — | — | — | — | — | — | — | 用户触发消息的 Tier 1 与此处官方名称不同 | |
| GPQA Diamond | Academic;百分比 | 96.0% | 94.6% | — | — | 93.7% | 92.6% | 93.7% | 95.3% | 94.3% | — | — | — | — | — | — | Gemini 数字来自独立 model card |
| Humanity’s Last Exam with tools | Academic;工具条件,百分比 | 57.2% | — | — | — | 65.0% | 63.8% | 63.6% | — | 51.4% | 60.0% | 51.5% | 56.0% | 62.5% | — | 54.7% | Gemini 为 search + code;DeepSeek 与 GLM 为各自官方图 |
| GeneBench Pro | Science / Health;百分比 | 37.8% | 28.7% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 同页 |
| MedChemBench Internal | Science / Health;百分比 | 49.3% | 47.4% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 内部任务 |
| LifeSciBench | Science / Health;百分比 | 60.3% | 59.9% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 同页 |
| HealthBench Professional length-adjusted | Science / Health;长度校正,百分比 | 63.4% | 60.5% | — | — | 58.1% | 60.9% | 56.4% | 52.1% | — | — | — | — | — | — | — | Astra 原始值 69.5%,平均长度 4097;system card 同项交叉披露 |
| ExploitBench | Cybersecurity;百分比 | 100.0% | 78.5% | — | — | — | — | — | 70.0% | — | — | — | — | 54.4% ⚠️ | — | 24.4% ⚠️ | GLM 页面文字 / 官方图的口径与 OpenAI 行不同,保留并列值 |
| Exploit Gym | Cybersecurity;百分比 | 42.4% | 30.3% | — | — | 30.4% | 28.4% | 22.0% | — | — | — | — | — | — | — | — | Claude 数字为 Mythos / 少 safeguards 配置 |
| ExploitBench June–August 2026 | Cybersecurity;20 个高危 V8 漏洞,百分比 | 39.0% | 11.5% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 内部新 benchmark;Path to Astra 说明漏洞范围 |
| SRE-Bench single attempt | Cybersecurity;单次尝试,百分比 | 88.0% | 55.9% | — | — | — | — | 12.5% | — | — | — | — | — | — | — | — | OpenAI 同页 |
| SEC-Bench Pro | Cybersecurity;百分比 | 85.4% | 79.1% | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Internal computer-use safety | Alignment / Safety;越低越好,百分比 | 2.4% | 22.0% | — | — | 9.5% | 18.3% | 11.5% | — | — | — | — | — | — | — | — | OpenAI 发布页;安全评测条件下的误触发 / 不安全行为指标 |
| Internal computer-use safety with AutoReview | Alignment / Safety;越低越好,百分比 | 1.8% | 4.3% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 发布页 |
| Internal circumvention benchmark | Alignment / Safety;越低越好,百分比 | 0.00% | 0.29% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 发布页 |
| ExploitGym honeypot | Alignment / Safety;越低越好,百分比 | 0.0% | 48.2% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 发布页 |
| Impossible ExploitGym | Alignment / Safety;单模型测试,百分比 | 100.0% | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 没有可比列,不作横向排名 |
| Internal hallucination benchmark | Alignment / Safety;越低越好,百分比 | 4.2% | 12.2% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 发布页 |
| MRCR v2 8-needle 256K–512K | Long Context;百分比 | 100.0% | 91.5% | — | — | — | — | — | — | — | — | — | — | — | — | — | OpenAI 发布页 |
| MRCR v2 8-needle 512K–1M | Long Context;百分比 | 96.3% | 73.8% | — | — | — | — | — | — | 26.3% ⚠️ | — | — | — | — | — | — | Gemini 为 1M pointwise,长度与评测形式不同 |
| ARC-AGI-3 | Abstract reasoning;Responses API harness,百分比 | 99.9% | 7.8% | — | — | — | — | 30.2% | — | — | — | — | — | — | — | — | OpenAI 改动两个设置 |
| ARC-AGI-2 | Abstract reasoning;百分比 | 95.0% | 92.5% | — | — | 90.0% | 89.2% | 90.4% | — | 77.1% ⚠️ | — | — | — | — | — | — | Gemini 数字来自独立 model card,条件不同 |
| ARC-AGI-1 | Abstract reasoning;百分比 | 98.5% | 97.5% | — | — | 97.5% | 98.5% | 97.5% | — | — | — | — | — | — | — | Astra 与 Fable 5 并列 | |
| CyberGym | 外部官方对照;百分比 | — | — | — | — | — | — | — | — | — | 83.3% | 76.7% | 80.0% | 84.5% | — | 77.2% | DeepSeek V4-Pro GA 与 GLM 官方图;版本不同 |
| NL2Repo | 外部官方对照;百分比 | — | — | — | — | — | — | — | — | — | 61.5% | 54.2% | — | — | — | — | DeepSeek V4-Pro GA 官方图 |
| Toolathlon-Verified | 外部官方对照;百分比 | — | — | — | — | — | — | — | — | — | 74.1% | 70.3% | 76.5% | — | — | — | DeepSeek V4-Pro GA 官方图 |
| DSBench-FullStack | 外部官方对照;百分比 | — | — | — | — | — | — | — | — | — | 71.1% | 68.7% | 73.7% | — | — | — | DeepSeek V4-Pro GA 官方图 |
| Z.ai Code Bench max | 外部官方对照;百分比 | — | — | — | — | — | — | — | — | — | — | — | — | 34.5% | — | 23.4% | GLM-5.3 官方文档 |
| GDPval-AA v2 | 外部官方对照;分数 | — | — | — | — | — | — | — | — | — | — | — | — | 1769 | — | 1508 | GLM-5.3 官方图;与 OpenAI GDPval 口径不同 |
openai.com
openai.com
openai.com
openai.com
deepmind.google
api-docs.deepseek.com
kimi.com
docs.bigmodel.cn
deploymentsafety.openai.com
This story was produced automatically by a channel. One sentence is all it takes for Neodrop to keep producing for you.