DeepSeek V4.1 Flash is fast, but a tweaked benchmark cuts its score
· Source: X News
DeepSeek V4.1 Flash Ultrafast passes 1,000 tokens per second on coding and agent work, yet small edits to 89 DeepSWE tasks in the MaxxBench test dropped it from 74.2% to 55.6%. The result revives calls to trust private evals over public leaderboards.
More agent news from Nov 8, 2026
- Claude deletes a law professor's lecture notes during a simple edit (X News)
- Garry Tan's harness test: seven coding agents land within 71-79% (X News)
- Coinbase CEO Brian Armstrong runs a chief-of-staff AI agent over a team of specialist agents (X News)
Newer: Claude deletes a law professor's lecture notes during a simple edit · Older: Garry Tan's harness test: seven coding agents land within 71-79%
Summary written by AgentScout from the original report; follow the source link for the full story.