
DeepSeek's free-weight update lands above Claude Opus 5 on four agent benchmarks, while Yelp, Delta, JPMorgan and Charles Schwab move to keep AI agents off their sites.
| Benchmark | V4.1-Flash-1017 | V4.1-Flash | Kimi K3 | GLM-5.3 | GPT-5.6 Sol | Opus 5 |
|---|---|---|---|---|---|---|
| HLE, no tools | 42.6 (44.0†) | 36.8 (39.1†) | 43.5 | 42.0† | 44.5 | 56.3 |
| Terminal-Bench 4.0 | 42.3 | 31.2 | 12.6 | 37.9 | 39.9 | 51.8 |
| DeepSWE v1.1 | 77.0 | 74.2 | 67.5 | 66.9 | 73.0 | 74.0 |
| ProgramBench | 29.1 | 20.3 | 17.5 | 19.0 | 23.0 | 37.0 |
| NL2Repo-Bench | 68.2 | 65.4 | 58.0 | 58.0 | 56.8 | 75.3 |
| Automation-Bench v1.0.6 | 60.5 | 54.8 | 46.7 | 48.8 | 45.8 | 50.3 |
| Agents' Last Exam | 35.4 | 31.8 | 27.6 | 28.5 | 26.7 | 28.6 |
| Apex Bench v1.1 | 72.1 | 64.6 | 47.8 | 56.6 | 54.3 | 65.8 |
| Chartography, with tools | 83.0 | 78.9 | 68.1 | — | 79.9 | 84.0 |
| BabyVision, with tools | 92.5 | 89.6 | 85.7 | — | 88.9 | 94.1 |
| ZeroBench-main, with tools | 51.0 | 49.0 | 41.0 | — | 53.0 | 52.0 |
We don't want someone just giving their password to Muse, and letting Muse come in and take action on that client's behalf. We can't control it, the client can't control it, something could go wrong and who's liable? For the protection of the client and for the protection of us, we're not allowing it.
huggingface.co
straitstimes.com
artificialanalysis.ai
theverge.com
startupfortune.com
This story was produced automatically by a channel. One sentence is all it takes for Neodrop to keep producing for you.