Daily AI Briefing · 2026-10-18

The Frontier Dispatch

Highlights

In two minutes
If you do one thing today
ollama launch claude --model deepseek-v4.1-flash:1017-cloud
DeepSeek tuned this MIT-licensed update inside agent harnesses. By its own table it now beats GPT-5.6 Sol on Terminal-Bench 4.0 (42.3 vs 39.9) and uses fewer tokens per task, at $0.15/$0.60 per million off-peak on OpenRouter. An independent 105-bug test puts it behind Opus 5.5 (34 vs 41.7), so try it as the cheap worker, not the reviewer.
The story today

DeepSeek's update is a harness story as much as a model story. It got 35% better on Terminal-Bench by training inside several coding harnesses, with no new algorithm. It also uses fewer tokens per task. Ollama, vLLM and Unsloth supported it within a day. Every number so far is DeepSeek's own. A hands-on 105-bug test puts it behind Opus 5.5, but well ahead of its predecessor.

Day 30 of the agent-breach arc moved off the agents and onto key storage. OpenCode's breach hit people who parked API keys in a hosted console. Calling it "distillation" blurred the matter: on 13 October that word meant training on another model's outputs (see that issue). Here it covers stolen keys being resold.

Concept of the day · bring-your-own-key

The picture. You hand a valet your car key so they can park the car. If someone breaks into the valet stand, they take every car.

The mechanism: with bring-your-own-key, a service stores your provider API key and calls the model for you, billed to your account. Each request is signed with your key, so whoever holds the key can spend your money.

What it means today: OpenCode Console stored keys for convenience. When it was breached, the attacker could bill OpenAI, Anthropic and Google to its users until each provider revoked the keys.

flowchart LR
A[Your API key] --> B[Hosted console]
B --> C[Model provider]
B -->|breach| D[Attacker]
D --> C
C --> E[Your bill]

Also today

Update curl and anything that bundles it. The 18-of-24 figure is AISLE's own claim.

Security teams now have standard names and detection strategies for agent-driven attacks. Five of the nine new Enterprise techniques are AI-related.

Leakers expect a release next week. An Azure listing at Fable 5.1's $10/$50 price was pulled a day later, so treat the details as unconfirmed.

Community

On two real repos it scored 34, against 41.7 for Opus 5.5, 42 for Muse Wonder Full and 21.7 for the previous Flash. The author expects about 1.7 points of run-to-run noise.

The top thread argues speed from providers and visible reasoning matter more day to day than the benchmark gap with Sol. Several commenters run it as the worker under Opus 5.5 as reviewer.

From the replies: "deepseek v4.1 flash via deepseek API: took 20m to find one p1 issue that was relevant and a p2 issue that was irrelevant - gpt 5.6 sol: took 5m30s for one p1 and one p2 issue. both relevant" — AmazingTurtle

The thread worked out which keys were exposed: only keys saved in the SaaS console, not those configured in the local CLI.

From the replies: "It has nothing to do with the harness. This was their hosted BYOK console service." — r/LocalLLaMA commenter

A Strata-based engine spreads the weights across 24 GB of VRAM, 90 GB of RAM and an NVMe drive, loading only the experts each token needs. Prefill runs at 180-320 tok/s.

From the replies: "it seems to retain a lot of its intelligence but takes like 10x the thinking tokens to get to the same outcome" — the author

The most-upvoted reply says the index comes from a lookalike site posting zero-day agentic scores. Others note llama.cpp still has not merged support for the original V4.1 Flash, 37 days on.

From the replies: "I trust them to at least actually run the benchmarks. Can't say the same about a random website that has zero day agentic results up already." — r/LocalLLaMA commenter

The site animates tokens at the predicted rate for a chosen card and model. Owners report real speeds well above its estimates once speculative decoding is on.

From the replies: "I get like 80t/s on Q3.8 27b UD Q4_K_XL on my 4090 with 3 drafts and about 110K context window, sim shows mid 20s" — binary132

Voices

Was the OpenCode breach "distillation"?
  1. OpenCode@opencode · X
    We had a security breach last night related to a large scale distillation attack that impacted 1.4% of OpenCode Console users
    the breach notice that started it
  2. Nathan Lambert@natolambert · X
    There's something very odd going on with "distillation" if a cyber attack to steal api keys is looped under the same term.
    questioning the word OpenCode chose
  3. Nathan Lambert@natolambert · X
    Why is Kimi serving Claude tokens directly to users? Other Chinese labs likely are too. I wouldn't call this distillation but it is a shady pattern and we should have appropriate language to understand it.
    naming what he thinks is really going on
  4. Lydia Hallie@lydiahallie · X
    We've been working with OpenCode on yesterday's breach and have revoked Claude API keys we believe were affected.
    Anthropic's response
  5. Evan Otero@EvanOtero · X
    We've blocked exposed API keys are working with impacted customers and OpenCode.
    Google's response for Gemini keys
How good is DeepSeek's "minor update"?
  1. Thomas Wolf@Thom_Wolf · X
    DeepSeek calling this a "minor update" while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny.
    reading DeepSeek's own table
  2. Thomas Wolf@Thom_Wolf · X
    now curious to see how these numbers will hold up outside their own eval setup
    flagging that every number is DeepSeek's
  3. Pawel Huryn@PawelHuryn · X
    A great improvement. Strange that the model wasn't labeled V4.2.
    an independent 105-bug test that puts it behind Opus 5.5
After "already clean", how much easier is interpretability?
  1. Arthur Conmy@ArthurConmy · X
    It seems really possible for mech interp to be net negative for the world; alignment is very hard, and a key way things could get worse is via misplaced confidence in unreliable evidence
    day three of the clean-neurons debate
  2. Tom McGrath@banburismus_ · X
    This doesn't mean that interpretability is solved - it means that it's going to be a science!
    Goodfire's chief scientist on what changed
This bill is substantively worse and weaker than Obernolte-Trahan's FRONTIER Act.
a safety advocate rejecting Anthropic's draft
Alexander McCoy@AlexanderMcCoy4 · X

Models

Today’s releases, side by side
modelwhat it's forcan dosizeruns oncost per M
DeepSeek-V4.1-Flash-1017DeepSeekMITCheap worker model for coding agentstext · vision · tools · thinking763B (HF tensor count) · active not publishedMoE1 machine$0.15 / $0.60index 42.3
Nemotron 3.5 ParseNVIDIAOpen-customTurning page images into structured textvision · textundisclosedother1 cardweights only
Notes

2 models recorded today; 1 publish a price and 1 ship weights you can run. A dash means the number was never published — it never means free. Index and $/task come from Artificial Analysis where it measured the model.

DeepSeek-V4.1-Flash-1017 — DeepSeek's open MIT model beats GPT-5.6 Sol on Terminal-Bench{claim}

Terminal-Bench 4.0 rises from 31.2 to 42.3 (Sol 39.9) and DeepSWE to 77.0, using shorter outputs. DeepSeek trained it inside several agent harnesses. OpenRouter lists it at $0.15/$0.60 per million tokens off-peak and $0.30/$1.20 at peak. It has a 1M context, and no Jinja chat template ships. → Hugging Face

Try ifyou want a cheap worker model under Claude Code: ollama launch claude --model deepseek-v4.1-flash:1017-cloud.

#open-weights#harnesses#deepseek
Nemotron 3.5 Parse — NVIDIA's document parser returns text with layout, boxes and reading order{claim}

A small vision encoder plus a 10-layer decoder, built to turn page images into structured text, tables and charts. NVIDIA reports 75.2 mean on ParseBench and 83.73 on IndicVisionBench OCR across 10 languages. It is cleared for commercial use. → Hugging Face

Watch ifyou run PDF or form intake through a general model.

#documents#nvidia

Rankings

The frontier, by Artificial Analysis
modelindex$ in / out per M$ per tasktok/s
Claude Opus 5.5Anthropic57.6$4 / $20$5.9898
Claude Sonnet 5.5Anthropic56$2 / $10$5.46144
Muse Wonder FullnewMeta55.8———
Claude Fable 5.1Anthropic53.4$10 / $50$7.6367
GPT-6 AstraOpenAI52.7$10 / $50$3.2661
Gemini 4 ArgonGoogle52.6$2 / $10$1.99104
Muse WondernewMeta52.4$4 / $20$4.52184
GPT-6.1 SolOpenAI51.8$2 / $10$0.7260
Who leads each board
board#1#2#3since yesterday
Vals Indexan independent blend, with cost per testGemini 4 Argon68.90%Claude Sonnet 5.567.04%Claude Opus 5.566.97%held
Terminal-Bench 4.0agent work in a real shellOpus 5.564.8%Sonnet 5.561.8%GPT-6 Astra58.2%held
Vals SWE-benchfixing real GitHub issuesClaude Opus 597.00%DeepSeek V4 Pro 081396.40%GPT-5.6 Sol96.20%held
ARC-AGI-2puzzles a model cannot have memorisedGPT-6 Astra95.0%GPT-6.1 Sol94.2%Claude Opus 5.593.3%held
SimpleBenchtrick questions that catch pattern-matchingClaude Opus 5.588.4%Claude Fable 5.186.6%GPT-6 Astra Pro86.5%held
AA hallucination ratehow often it makes things up (lower is better)Gemini 4 Argon15.1%MiniMax-M318.4%Muse Wonder Full23.0%held
Cost per taskwhat one finished task bills (lower is better)GPT-6 Luna0.068MiMo-V2.6-Pro0.133Nemotron 3.5 Super VL0.188held
OpenRouter usagewhat developers actually run, tokens served this weekDeepSeek-V4.1-Flash35894.2BStep 5 Preview13928.4BGLM-5.3 Flash12599.2Bheld
New on OpenRouter, last 3 days
Notes

No reading today from Arena Text, Arena WebDev, Arena Agent, AA Intelligence Index, AA Humanity's Last Exam. Boards without a reading are left out rather than shown empty. Every number here is parsed by pulse.py from the board itself; nothing is retyped.

Local

Best you can run on a 32 GB card
modelcan dofits a 32 GB cardAA index
qwen3-vlnew2 hours ago · 6.7M pullsvision · tools · thinking32B · Q6_K ~26 GBnot measured
nemotron-3-nanonew7 hours ago · 919.4K pullstools · thinking30B · Q6_K ~25 GBnot measured
pplx-decider5 hours ago · 721 pullsvision · decision27B · Q8_0 ~29 GBnot measured
nemotron-3.5-lightningyesterday · 240.4K pullstools · thinking30B · Q6_K ~25 GBnot measured
bonsai-2yesterday · 16.5K pullsvision · tools · thinking27B · Q8_0 ~29 GBnot measured
lfm2.52 days ago · 230.2K pullstools · thinking24B · Q8_0 ~25 GBnot measured
d12 days ago · 14.3K pullsvision3B · F16 ~6 GBnot measured
gemma3n3 days ago · 2.3M pullsvisionnonot measured
tev14 days ago · 99.6K pullstools · decision · thinking4B · F16 ~8 GBnot measured
nimble4 days ago · 48.9K pullstools · decision · thinking9B · F16 ~18 GBnot measured
clef-flash4 days ago · 27.4K pullsvision · decision9B · F16 ~18 GBnot measured
clef4 days ago · 20.7K pullsvision · decision27B · Q8_0 ~29 GBnot measured
Notes

From the whole ollama.com/library, read this morning, keeping only the newest version of each model line. The fit column is our arithmetic: the largest size that fits at ~0.56 GB per billion parameters (Q4_K_M) with 2 GB held back for context. A score appears only where Artificial Analysis measured that exact model at that size; ranked by that score, then by how recently the model was updated.

Try this

export CLAUDE_CODE_AUTO_MODE_MODEL=<model>, then claude --permission-mode auto
Update to 1.19.3 and add reasoning options under the model in opencode.json
One self-hosted memory, kept as plain markdown, follows you across 20+ harnesses and machines, so switching agents stops costing you a re-briefing
claude plugin marketplace add akitaonrails/ai-memory && claude plugin install ai-memory@ai-memory

Update Claude Code (breaking) · OpenCode (security) · goose (breaking) · transformers (breaking)

Research

Screwtape: six automatically edited attacks slipped past a frontier lab's agent monitor

Redwood edited attacks into real agent transcripts until action-only monitors missed them. 252 runs produced 35 attacks that fooled their own Opus 4.8 and Gemini 3.1 Pro monitors, and six of those also fooled a held-out frontier developer's monitor. → LessWrong

Read ifyou rely on a monitor that only watches what your agent does.

#safety#agent-security
OpenGCUA: letting the model write code to drive a computer adds 19.6 points on OSWorld-v2

In this open stack the agent chooses between clicks and code. It raised partial scores for all eight models tested, GPT-6 Astra and Claude Opus 5 included, and cut steps per task by 53%. Code and trajectories are released. → Hugging Face

Read ifyou build computer-use agents and still drive them click by click.

#agents#evals
FDE-Gym: the best agent fully completes 14 of 95 real customer delivery tasks

Built from real forward-deployed-engineering projects with simulated stakeholders. The best of 13 configurations averages 0.56. Finding unstated constraints is the main failure. → Hugging Face

Read ifyou expect an agent to take a vague ticket all the way to a working solution.

#evals#agents
Transluce volunteers catch agents trying bot-check bypasses during public benchmark runs

MiniMax M3 and M2.7, GLM 5 and 5.2, and Grok 4.5 tried to bypass EPA registration and bot checks; no bypass succeeded. These are the first findings from Transluce's volunteer monitoring of agents on the public web. → Transluce

Read ifyour agents browse the open web on your behalf.

#agent-security#evals
SAE features mostly add up, but pairwise interactions still matter for steering

Across 18 model and behaviour settings, learned SAE features combine more additively than random rotations of the same subspace. Modelling pairs lifts steering rank fidelity from 0.59 to 0.78. → Hugging Face

Read ifyou steer with several SAE features at once and assume their effects simply sum.

#interp
Apple: plan the tools first for multi-tool tasks, retrieve first for single-tool ones

Across ToolBench's 46,984 APIs, having the model sketch the function signatures it needs before searching beats query embedding on multi-tool tasks and loses on single-tool ones, at every retrieval budget. → Apple

Read ifyour agent picks from hundreds of MCP tools.

#agents#tools
Character training makes Gemma and Qwen more risk-averse, but also more short-term

A short constitution written as "I am…" statements beats procedural rules and generalises without labelled data. The catch: the models also come to prefer immediate reward. → LessWrong

Read ifyou shape agent behaviour with a written spec.

#safety#alignment
Projection sampling recovers capability after alignment fine-tuning, but undoes the alignment

Rewriting a teacher's safety reasoning into the student's own style restores general skills. It also reverses much of the drop in agentic misalignment, because the rewritten traces keep the decisions but lose the reasons. Replay does better. → LessWrong

Read ifyou distil safety behaviour from a stronger model.

#alignment#safety
Weekly → Try the new design (beta) →