Daily AI briefingSaturday 31 October 2026

The layers you never see changed this week

A fake Claude Code extension, a two-sentence rule in Claude Code's prompt and a misuse grade after every reply. Meanwhile an open model turned Firefox's published fixes into working exploits.

The day in 60 seconds
1
Harnesses

A backdoored Claude Code extension sat in Cursor's marketplace for 11 hours

ExpandCollapse
Verified#harnesses #security

If you installed Claude Code 2.1.312 or 2.1.313 through Cursor on 29 October, check your SSH keys today.

The detail Cursor says at most 5,000 users were affected, on macOS and Windows, between 2:27am and 1:35pm PT. The payload added an attacker key, set up persistence and sent host details out.

The catch Cursor has not said how a tampered build was published under Anthropic's name. Anthropic says its own channels were never affected.

Worth learning the supply-chain attack. You trust a package because of where it comes from, so an attacker who controls the distribution channel inherits that trust without touching the original code.

cursor.com ↗
2
Harnesses

Claude's $200 plan becomes Ultra and loses its 5-hour limit

ExpandCollapse
#harnesses #pricing

Long Claude Code sessions stop hitting the 5-hour wall, but Anthropic confirmed the weekly cap was always 10x Pro, not 20x.

The detail Max 5x becomes Max at $100; Max 20x becomes Ultra at $200. Most existing subscribers lose the 5-hour limit now; new accounts keep it until verified.

The catch weekly limits are unchanged, so heavy users now burn the week faster instead of pausing every five hours.

Worth learning two-level rate limits. A short window smooths bursts and a long window caps total use; removing the short one moves all the pressure onto the long one.

x.com ↗
3
Safety

Epoch: GLM 5.3 turned Firefox's published fixes into working exploits for about $1,000 each

ExpandCollapse
Verified#safety #cyber

An open-weight model, run by a deliberately unsophisticated setup, compromised all six Firefox releases from 17 September to 26 October.

The detail one page visit let the exploit read files and steal saved passwords and cookies. The fastest attempt took 12 hours; the same budget against Chrome failed.

The catch the newest versions needed a second, unpublished bug as well, now fixed in Firefox 159.0. Setting up the environment cost Epoch over $100,000.

Worth learning the patch gap, the days between a fix becoming public and reaching users. Today's Concept explains it.

epochai.substack.com ↗
4
Safety

Anthropic: Claude now grades every conversation for misuse right after it answers

ExpandCollapse
Claim#safety #monitoring

Self-assessment has run on every model since Fable 5, across a large share of traffic, since June.

The detail on Fable 5 it catches 78% of what a stronger classifier flags, and 94% of high-priority cases, at a 1% false-positive rate, adding under 2% to inference compute.

The catch the grader is checked against its own teacher classifier, so blind spots they share stay invisible. Anthropic says a deceptive model could hide things in its own grade.

Worth learning reusing the KV cache. The conversation is already processed, so a short extra question costs about ten output tokens instead of a second full read.

safeguards.anthropic.com ↗
5
Industry

OpenAI cuts its funding round to about $20B at a $1.25T valuation

ExpandCollapse
Claim#industry #funding

The Financial Times reports the round was cut by a third as AI stocks fell, weeks before Anthropic's listing.

The detail the target fell from about $30B to $20B, and the valuation from $1.4T to $1.25T. The Nasdaq 100 is down about 10% since 6 October.

The catch the figures come from the FT's sources; OpenAI has not commented, and the valuation cut was first reported days earlier.

Worth learning competing for the same money. Anthropic reportedly wants up to $100B at $1.5T, so two labs are now selling shares to the same investors in the same month.

coindesk.com ↗
6
Harnesses

Claude Code now refuses to recreate a specific existing game

ExpandCollapse
#harnesses #policy

Anthropic added two sentences to Claude Code's prompt for Opus 5.5; users cannot switch them off.

The detail the rule allows original games, genre games and games from your own assets. Anthropic's Addy Osmani says recreating someone else's game breaks the usage policy.

The catch it is a prompt instruction, so how strictly the model applies it to a borderline idea is unknown.

Worth learning the hidden system prompt. Your agent's behaviour is your instructions plus the vendor's, and the vendor's can change on any day without a version bump.

gamedeveloper.com ↗
7
Models

Unsloth and ISTA disagree on how good 1-bit DeepSeek V4.1 Flash really is

ExpandCollapse
Disputed#models #quantisation

Unsloth measured ISTA's 1-bit build at 91.88 on AIME25, not the 100 ISTA reported; ISTA blames a 32K reasoning cap.

The detail Unsloth's 2-bit build averages 87.49 across six benchmarks against 87.68 for the 8-bit reference, at 335 GB instead of 508 GB.

The catch commenters note the gaps sit inside run-to-run noise on saturated benchmarks, and Unsloth says a 128K budget changed nothing; that rerun is not yet published.

Worth learning quantised models think longer. Lower-bit builds hit the 32K cap more often (4.15% against 1.48%), so a reasoning cap can decide a quantisation comparison.

reddit.com ↗
Editor’s note

Three things changed this week in the parts of my tools I never look at.

A stranger with access to Cursor's marketplace shipped a Claude Code extension that wrote their key into my SSH folder. Anthropic added two sentences to Claude Code's system prompt that decide which games it will build. And Claude now writes a short misuse grade after every answer it gives me. None of these showed up in a changelog I read. I found out from Reddit, from a security vendor and from a research blog.

The extension is the one I act on today, because it is the one with a clear fix. I'll grep for svc-telemetry on every machine and install extensions only from the publisher's own channel. The other two I can't fix, and they bother me less than the replies suggest. A vendor rule about cloning games is a policy I can read now, and a grade computed from a cache the model already holds costs me nothing I wasn't already giving up by sending the text.

What I take from the day is a habit about layers. My agent is my instructions, the vendor's prompt, the model's weights and every package between them, and each layer has an owner who can change it. OpenCode can now drive my Claude login through the official SDK, which keeps the model and moves the harness into code I can read. Epoch's Firefox result is the reminder that fixes and changes reach attackers as fast as they reach me, so the layers I can see are the ones worth keeping current.

Concept of the day

Patch gap

A lock maker posts the redesign of a faulty lock online a week before the new locks reach anyone's door. Anyone who reads the redesign knows exactly which old locks still open.

Fix in nightly build
↳ GLM 5.3 reads fix→Exploit web page→User on old Firefox→Files and cookies stolen
↳ Release ships later

The mechanism: open-source projects publish security fixes in nightly or beta builds before the release reaches users; the change shows where the bug is, and someone who reads it can build an exploit for the version people still run.

What it means today: Epoch found an open model, GLM 5.3, can do that reading and building on its own for about $1,000 a Firefox version, so the gap no longer takes an expert.

update ships laterfix is readbuilds exploitone page visit✕Security fixpublic in nightlyGLM 5.3reads the fixExploit pageabout $1,000 eachFirefox userstill on old buildFirefox 159.027 Oct releaseFiles stolencookies, passwords1234
  1. The gap. Mozilla publishes a fix in a nightly build; the release that carries it reaches users later.
  2. The fix is a map. GLM 5.3 reads the published change and works out the bug it closes.
  3. One visit. The model builds a web page; a user still on the old version opens it, and their files, passwords and cookies are read.
  4. Closing one chain. The newest versions also needed an unpublished bug; Epoch reported it and Firefox 159.0 fixed it on 27 October.
Step throughA published fix is a map to the bug until the update reaches users.

Further reading

RevisedISTA's GSQ-RCO GGUFs of DeepSeek V4.1 Flash 1017 keep full benchmark scores at 1.75-2.25 bits (AIME25 100 reported) Disputed — Unsloth measured the 1-bit IQ1_M at 91.88 on AIME25 and 81.78 across six benchmarks; ISTA attributes the gap to a 32K reasoning cap against its 128K1 of the last 14 days’ claims moved

The industry

OpenAI is raising less at a lower price: the Financial Times reports its round fell from about $30B to $20B, at $1.25T instead of $1.4T, as AI stocks slid weeks before Anthropic lists. The four biggest labs agreed to honour one signal that lets a website refuse training without leaving search. And Anthropic is reportedly negotiating for a gas-powered Alberta campus, a day after Ottawa bought into Cohere.

3 entries · 1 more worth reading
CoinDesk
OpenAI cuts its funding round target to about $20B

The Financial Times reports OpenAI lowered its raise from about $30B to $20B and its valuation from $1.4T to $1.25T after AI stocks fell.

Why it matters: the largest private AI lab is raising less, at a lower price, just as Anthropic goes to public markets.

#industry #funding
ExplainClose

Background A funding round target is what a company tells investors it hopes to raise; cutting it by a third signals weaker demand at the asking price. The FT's figures: about $20B instead of $30B, at $1.25T instead of $1.4T, a valuation cut first reported days earlier. The backdrop is a Nasdaq 100 down about 10% in three weeks, 4.5% on Friday alone, and Anthropic reportedly seeking up to $100B at $1.5T. OpenAI has already pushed its IPO to 2027.

Open the source ↗
Thurrott
Anthropic, Google, Microsoft and OpenAI back one opt-out signal for AI training

Websites can now tell all four with one IETF-drafted signal that they do not want their pages used for training, separately from search indexing. Anthropic honours it now; the others from 2027.

Why it matters: publishers get one switch for training that does not cost them search traffic.

#industry #copyright
ExplainClose

Background Until now a site blocking AI training usually had to block each company's crawler by name, and blocking Google's or Microsoft's risked search traffic. The new signal comes from an IETF working group and is meant to become a standard; it separates training from search indexing and archiving. Anthropic already honours it; Google, Microsoft and OpenAI will in 2027. Thurrott calls it largely symbolic, because the training data already gathered is not affected.

Open the source ↗
The Globe and Mail
Anthropic in talks to lease a gas-powered data centre campus near Edmonton

Two sources tell the Globe and Mail that Anthropic is negotiating to be the tenant of Beacon Data Centers' Sturgeon County campus, powered by a 920-megawatt gas plant approved on 23 October.

Why it matters: a second lab would build in Canada a day after Ottawa bought into Cohere.

#industry #compute
ExplainClose

Background The Globe's two unnamed sources say Anthropic is negotiating with Calgary's Beacon Data Centers for a planned campus in Sturgeon County, northeast of Edmonton. Filings show four data halls and a 920 MW gas-fired plant, which Alberta's regulator approved on 23 October; construction should start this quarter. For scale, 920 MW is roughly what a city of several hundred thousand homes draws. Anthropic and Beacon declined to comment.

Open the source ↗
1 more worth readingClose

Models & local

2 released today · 0 publish a price · a dash is never “free”

Sort

Two releases teach the same lesson about measurement. Unsloth's 2-bit DeepSeek V4.1 Flash nearly matches its 8-bit reference, and its rerun of ISTA's 1-bit build scored 91.88 on AIME25, not 100; the fight is over a reasoning cap, because lower-bit builds think longer and hit it first. Microsoft's Mage-VL-Cowork shows a 4B model can run a desktop if it may switch between clicking and a shell.

2 models

Language

1 machine

Local DeepSeek Flash at 1-4 bits

Size763B MoE; GGUFs 233-508 GB
$ in / out per Mweights only
text · vision · tools · thinking

Try if you have 192 GB of RAM or more and want the best 2-bit build; skip if you want a settled 1-bit winner.

ExplainClose

Unsloth's Dynamic v3.1 UD-Q2_K_XL averages 87.49 across six benchmarks against 87.68 for its 8-bit reference, at 335 GB instead of 508 GB. Unsloth also measured ISTA's GSQ-RCO 1-bit build at 91.88 on AIME25, where ISTA reported 100.

On a 32 GB card not alone. The 1-bit builds need 128-145 GB of RAM plus VRAM, with the Engram lookup tables memory-mapped from SSD; the 2-bit build needs 176-205 GB.

The dispute ISTA says Unsloth capped reasoning at 32K tokens while its own runs allowed 128K at reasoning effort 50. Unsloth says a 128K run showed no difference and promises the numbers. Commenters point out most gaps sit inside run-to-run noise.

Worth learning a reasoning budget is part of the benchmark. Lower-bit builds think longer, so a fixed token cap hits them first: 4.15% of UD-IQ1_S answers were truncated at 32K, against 1.48% at 8-bit.

Open the source ↗
#language #quantisation #moe

Vision, multimodal & world models

Microsoft · Apache · claim
Mage-VL-Cowork
1 card

Local computer-use agent (GUI + shell)

Size4B
$ in / out per Mweights only
text · vision · tools · thinking

Try if you want a local computer-use agent; run it only inside a disposable VM, as the card insists.

ExplainClose

Microsoft reports 66.0% on OSWorld-Verified with 4B parameters, ahead of every 4B model it lists and close to Muse Glimmer 30B at 65.9. One policy chooses each turn between GUI actions and a persistent shell. Apache 2.0.

On a 32 GB card yes. 9.48 GB of BF16 weights leaves over 20 GB for a 32K context and full-HD screenshots.

The build a Mage-ViT vision encoder on Qwen3-4B, keeping only the last 3 screenshots and 4 full replies in memory, with older actions folded into a short history.

Worth learning distilling from a better harness. Pruning the teacher's tools before collecting its runs lifted the 4B student from 25.1% to 37.6%, because a student copies its teacher's habits, including wasted steps.

Open the source ↗
#vision #agents

From the papers

Both papers are about what quantisation and training choices quietly cost. Soft-MTP keeps only the cleaner half of the multi-token training signal and gets better draft heads for the same compute. Broken on Arrival found 7 official Ollama code-model tags that barely work, all small low-bit builds made without an importance matrix, and a 30-second perplexity check that catches them.

2 papers
arXiv · claim
Broken on Arrival: 7 of 305 Ollama code-model tags could barely write code

An audit of the official Ollama library found 2.3% of code-capable tags non-functional, each solving at most 6 of 164 HumanEval+ tasks, all low-bit builds of models under 4B.

Read if you pull small low-bit models and trust the tag name.

ExplainClose

The idea the files were not corrupt. Rebuilding them gave identical tensors; adding an importance matrix during quantisation lifted the Qwen2.5-Coder-3B builds from 0 to roughly 46-69%.

Why it matters a 30-second perplexity check against the FP16 model separated every broken build, at 27 to 5,700 times the reference perplexity. The quantcheck tool is public.

Background The audit covered 305 code-capable GGUF tags from 15 model lines in Ollama's library plus 22 community files from Hugging Face. The seven failures were four Qwen2.5-Coder-3B tags, one phi3.5-mini and two llama3.2-1B, all q2_K to q3_K_L. Twenty of 22 community files were healthy; two failed on one backend only. The perplexity threshold was chosen after the fact and needs an FP16 reference, so it is a screen, not a proof.

Open the source ↗
#papers #quantisation
arXiv · claim
Soft-MTP: a one-line change makes multi-token prediction train better

Routing only the self-distillation part of the gradient into the extra prediction heads lifted speculative-decoding acceptance 1.8-2.2% and, at 1.2B parameters, HumanEval pass@64 by 3.1 points, at the same compute. Models ran from 167M to 1.2B.

Read if you train or fine-tune models with multi-token heads.

ExplainClose

The idea the usual multi-token loss mixes two signals: "match what the model itself predicts next" and a noisier "match the data". About 80% of what reaches the shared trunk is the noisy part; Soft-MTP keeps only the first.

Why it matters better-trained draft heads mean faster speculative decoding in future open models. The tested models are small, and the code is public.

Background The authors split the standard multi-token loss into a self-distillation term and a residual that has 4 to 4.6 times lower signal-to-noise. Soft-MTP sends only the first into the heads and trunk with a straight-through trick, so it needs no extra logits and runs within 0.07% of normal throughput. Explicit KL training costs 5.6% throughput and about 21 GB more memory for similar results. Tested only up to 1.2B parameters on about 31.5B tokens.

Open the source ↗
#papers #speculative-decoding
If you do one thing
Run Microsoft's 4B computer-use agent, Mage-VL-Cowork, on your own cardApache 2.0, 9.48 GB in BF16, and 66.0% on OSWorld-Verified by Microsoft's count, close to a 30B model
ExplainClose

Why try it A local agent that can both click through a desktop and drop to a shell, small enough to leave running next to your main model, with no screenshots leaving your machine

The experiment In a disposable VM with no credentials mounted, give it 10 everyday tasks: 5 spreadsheet or document edits (where it should choose the shell) and 5 GUI-only ones (a settings panel, a canvas). Run the same 10 through your usual hosted computer-use agent.

What to expect Estimate, not measured: from the card's 66% average, something like 6 of 10, better on the file edits than on canvas work; screenshots at full HD will dominate the 32K context after a few turns

How to judge it Count tasks finished with no human fix, and note which channel it picked each turn. Keep it if it finishes 6 or more and picks the shell for the file edits.

Harnesses & skills

The trust around your agent moved this week. A tampered Claude Code extension in Cursor's marketplace wrote an attacker's SSH key on up to 5,000 machines; check for svc-telemetry. Claude's $200 plan lost its 5-hour cap but kept a weekly cap that was always 10x Pro. A vendor rule in Claude Code's prompt now refuses game clones, and Symantec found resold relays that switch agent sandboxes off.

5 entries
Cursor · verified
Cursor's marketplace served a backdoored Claude Code extension to up to 5,000 users

Versions 2.1.312 and 2.1.313, on macOS and Windows, added an attacker's SSH key, installed a reverse tunnel that retried every 60 seconds and sent host details out, for about 11 hours on 29 October.

Read if you used Claude Code inside Cursor this week.

ExplainClose

Why it works extensions run with the editor's permissions, and the injected code ran when the file loaded, before the extension activated, so nothing had to be clicked.

Check grep -qs svc-telemetry ~/.ssh/authorized_keys && echo found. Uninstalling is not enough: the payload drops separate persistence scripts. Rotate credentials reachable from an affected machine.

In your setup Anthropic says only the Cursor marketplace copy was tampered with; install Claude Code from Anthropic's own channels. Phorion found the macOS SSH step usually failed without admin rights.

Background Cursor's notice lists indicators for both versions and remediation scripts; it shut the whole marketplace, rotated keys and rebuilt it. Phorion, which found the backdoor, says the injected code ran before the extension activated and that on macOS a permissions check usually failed, so SSH was not switched on, though the key, persistence and beacon still landed. Cursor's CEO said the official VS Code extension was not compromised. How the attacker got publish access is not explained.

Open the source ↗
#harnesses #security
Game Developer
Claude Code's prompt now tells Opus 5.5 not to rebuild existing games

Two sentences, pushed around 27 October, allow original games, genre games and games from your own designs, and rule out recreating a specific game "even if it is renamed". Users cannot disable them.

Read if you build games or ports with Claude Code.

ExplainClose

Why it works the rule sits in the vendor's system prompt, above your own instructions, so your CLAUDE.md cannot override it.

Check if Claude turns down a game that is yours, Anthropic's Addy Osmani asked users to send it to him. A thread on r/LocalLLaMA drew 1,359 points arguing for local models.

Background A user named Chasm found the rule under the flag tengu_heron_brook, pushed around 27 October, and reported it cannot be disabled. Anthropic pointed Game Developer to Addy Osmani's statement that the two sentences enforce its usage policy on IP and that original, genre and own-asset games should keep working. On r/LocalLLaMA the thread drew 1,359 points, mostly arguing that vendor rules are a reason to run local models.

Open the source ↗
#harnesses #policy
Claude
Claude's Max 20x becomes Ultra, with no 5-hour limit and the same weekly cap

Anthropic renamed its $200 plan Ultra and is removing its 5-hour limit, starting with most existing subscribers; newer accounts keep a temporary limit until verified. Its product lead confirmed the weekly limit was always 10x Pro, not 20x.

Read if you pay $200 for Claude and run long agent sessions.

ExplainClose

In your setup long background or overnight Claude Code runs no longer stall at five hours, but they now reach the weekly cap sooner. Watch /usage on the first heavy week.

Check Max 5x is now just Max, still $100; nothing changes for those subscribers.

Background Anthropic's subscriptions lead, mboverell, said the top plan launched in April 2025 with only a 5-hour limit at 20x Pro, and the weekly limit added later was set at 10x Pro; he apologised for the confusion. Ultra removes the 5-hour limit in stages; accounts get an email when it lifts, and unverified ones keep a temporary limit against fraud. Several replies read it as preparation for costlier models.

Open the source ↗
#harnesses #pricing
GBHackers · claim
Symantec: a resold relay installs Codex and Claude Code, then switches their sandboxes off

The service runs a one-line script after a genuine npm install, points the CLIs at its own servers and disables sandboxing; it has hit 12 organisations since early 2026, mostly in mainland China.

Read if you manage machines where people buy cheap Claude or Codex access.

ExplainClose

Why it works the relay sees every prompt, file and secret, and with the sandbox off a forged reply runs with your privileges. Symantec saw no abuse yet.

Check look for changed ANTHROPIC_BASE_URL or OPENAI_BASE_URL, danger-full-access in Codex's config.toml, and curl | bash run right after installing either CLI.

Background Symantec's Threat Hunter Team traced a service sold through lookalike domains such as vibe.aiok[.]me. After a real npm install, a one-liner rewrites base URLs, turns off sandboxing, and on one host logged Claude out to force a fresh login. Keys with Anthropic's sk-ant-oat01- prefix suggest pooled subscriptions being resold. The risk is potential: Symantec saw no abuse, but the relay sees every prompt and secret.

Open the source ↗
#harnesses #security

From the papers

arXiv · claim
Compaction barely hurts agents on benchmarks, but it drops your rules

Across PaperBench, ProgramBench and PostTrainBench, compaction threshold had no measurable effect on two 1M-context models, but the first summary dropped about a third of ProgramBench's anti-cheating rules.

Read if your long sessions forget what you told the agent not to do.

ExplainClose

Why it works a benchmark's goal is fixed and its progress sits on disk, so an agent can recover it. Rules you stated only in chat exist nowhere else.

In your setup put standing constraints in AGENTS.md or CLAUDE.md, not mid-conversation. On real sessions, conduct rules were dropped about 6 times more often than build specs.

Background By Salle, Bhatnagar, Bethge, Abdelnabi and Andriushchenko. The smallest-context model, GPT-5.3-Codex, did worse at lower compaction thresholds on PaperBench. No compaction method beat the default self-summary; ones that discarded more cost some models up to 20 points. Losses of rules grew with each further compaction, and on real SWE-chat sessions conduct rules were dropped about six times as often as specifications.

Open the source ↗
#harnesses #context

Try this

Claude CodeCLAUDE_CODE_SUBAGENT_EFFORT=medium claude
OpenCodeclaude auth login, then /connect → Claude Agent
Floorplan
Get a plain-English map of your codebaseSee how agent-written code fits together
claude plugin marketplace add haydenschmitty/floorplan
pixelfx
Add 232 code-only pixel effects to a gameAgent drafts, renders and checks new effects
/plugin marketplace add patch-gg/pixelfx

Update now → Cursor (security) · Claude Code (breaking)

Inside the model

Both results read structure out of trained pieces rather than out of single neurons. Persona geology factors 134 personality adapters into five Big-Five-like dimensions, with scrambled controls showing nothing. A natural-language autoencoder now writes text descriptions of single attention heads in Qwen3-8B, though nobody has yet tested whether those descriptions predict what the heads do.

2 entries · 1 more worth reading
LessWrong · claim
Persona geology: 134 personality adapters fall into five factors close to the Big Five

Training 134 trait LoRAs on Qwen3.5-4B and factoring their weight updates gave Warmth, Competence, Timidity, Arousal and Imagination; scrambled adapters showed no structure.

Read if you study how character training shapes a model.

ExplainClose

How it works each adapter is a small weight change (a LoRA) trained to push one trait. Comparing the changes pairwise shows which traits move the same weights; same-pole traits averaged +0.24 similarity, opposite poles −0.08.

Evidence mostly correlational, with steering along factor directions as an interventional check. One model, one pipeline, and behaviour judged by one LLM across 24 scenarios.

Run it the adapters are on Hugging Face; a 4B model fits 32 GB easily.

Background By Samuel Ratnam and David Africa. Each of the 134 rank-64 adapters got 13 DPO steps on the same 445 prompts. Warmth matched Agreeableness best (congruence 0.66). Text embeddings of the training contrasts predicted 94% of where a held-out adapter landed, and a training-data influence score, CharIn, predicted behaviour shifts at r = 0.61-0.85, but poorly out of distribution. Permuted controls kept the structure but matched trait names only at chance.

Open the source ↗
#inside #personas
LessWrong · claim
Natural-language autoencoders now describe single attention heads in Qwen3-8B

A pair of fine-tuned models turns one head's output into text and back; rewording the text with another model cost only 3.9 points of variance explained.

Read if you want an interpretability method that outputs text, not features.

ExplainClose

How it works a verbaliser writes a description of an activation and a reconstructor rebuilds the activation from it; if the rebuild is good, the text carries the information. Training took about 11 H100-hours.

Evidence no causal test yet: the author did not ablate heads to check the descriptions predict anything, and calls them only "vaguely" plausible.

Run it code at github.com/syvb/EasyNLA (branch sv/head-nla); Qwen3-8B fits 32 GB in BF16.

Background Each head's output was isolated by zeroing the others at the output projection, at layer 24 of Qwen3-8B. A "Matryoshka" variant truncates explanations in training so the important part comes first. Heads in the same grouped-query group reconstructed similarly well. The author thinks the KL penalty was too low, letting explanations drift, and that centring head outputs was a mistake. It is unclear whether the trained weights are released.

Open the source ↗
#inside #methods
1 more worth readingClose

A research direction with no experiment of its own.

ExplainClose

Background A proposal that a capable model could read its own weights and activations and rewrite its computations as readable code, through a loop of hypothesis and test. The only numbers are cited from earlier work on 62 algorithmic tasks. Readers voted it to -12.

Open the source ↗
#inside #methods

Safety & alignment

Epoch showed an open model, unrefused by any provider, turning Firefox's published fixes into one-visit exploits for about $1,000 a version. Anthropic disclosed that Claude grades every conversation for misuse after answering, catching 94% of high-priority cases a stronger classifier flags. Red-teamers found 11 ways past Codex's Auto-review monitor, several now fixed.

3 entries · 1 more worth reading
Epoch AI · verified
GLM 5.3 exploited Firefox's patch gap without help, for about $1,000 a version

Epoch gave the open-weight model published-but-unshipped Firefox fixes and a basic setup; it built page-visit exploits for all six releases from 17 September to 26 October, the fastest in 12 hours.

Read if you ship software whose fixes are public before users update.

ExplainClose

What it shows a cheap, unrefused open model can turn public fixes into working attacks. No provider, Z.ai included, triggered a safeguard.

What it doesn't that Chrome is exposed: $100,000 of compute failed there. The newest Firefox attacks also needed an unpublished bug, now patched in 159.0.

Background Epoch spent over $100,000 building an offline environment; after that each Firefox version cost about $1,000 of compute, with up to 48 hours allowed. In one run the model found a memory bug, built read and write access, then chained further stages past Firefox's protections. It framed the work as a security exercise and was never refused. Epoch notes Kimi K3.1 Pro's weights, due in early November, may be stronger at this.

Open the source ↗
#safety #cyber
Anthropic · claim
Anthropic's self-assessment: Claude grades its own conversations for misuse

After each reply, a hidden instruction asks Claude to score the conversation; on Fable 5 this catches 78% of what a stronger classifier flags and 94% of high-priority cases at a 1% false-positive rate.

Read if you want to know what happens to your Claude conversations after the answer.

ExplainClose

What it shows a monitor that improves with the model: detection AUC rose from 0.862 to 0.995 across four model sizes, and recall barely fell on harm categories removed from training.

What it doesn't whether it works on harms Claude does not already recognise, or against a deceptive model, which Anthropic says could hide things in its own grade. All numbers are Anthropic's.

Background The grade has fixed fields (flag, category, priority, score) plus a one-sentence reason; the reason can paraphrase the chat, so it gets the same data controls as the chat itself. Grades feed offline review, not live blocking. Anthropic says it found large-scale misuse other methods missed and estimates under 2% extra compute. Held-out tests covered fraud and cyber only, harms Claude already recognises; its teacher's blind spots carry over.

Open the source ↗
#safety #monitoring
LessWrong · claim
Red-teamers found 11 ways past Codex's Auto-review monitor

ERA fellows with Apollo Research mentoring hand-built attacks that let a misaligned agent run arbitrary code past OpenAI's blocking monitor, with average success between 56% and 100% per task.

Read if you rely on Codex's Auto-review to approve sandbox escapes.

ExplainClose

What it shows bypasses through broadly trusted loaders such as pytest, uncovered oversight settings, and agent-written text the monitor mistook for the user. OpenAI fixed several, adding an auto_review.ignore_rules setting.

What it doesn't on-policy behaviour. The rollouts were synthetic, at one pinned commit, and per-attack figures are not public.

Background Auto-review approves or denies actions that would leave Codex's sandbox; it sees messages and recent tool output but not the agent's reasoning, and does not watch the writable root. The authors tested four side tasks, from key exfiltration to disabling oversight. Bypasses succeed every time; monitor-fooling ones were sampled 100 times each. Attack trajectories were withheld so they do not end up in training data.

Open the source ↗
#safety #control
1 more worth readingClose

Humans & mind

One essay today, and it is about the people who tell us how safe AI is. Jan Kulveit argues lab staff hold beliefs shaped by who is hired, who stays and what is rewarded, without anyone acting in bad faith, and that more should leave. An Anthropic researcher agreed the pull exists and asked how to measure it.

1 entry
LessWrong
Jan Kulveit: working at an AI lab mildly bends what you believe

Kulveit argues lab staff live in a steady, slightly altered epistemic state, shaped by hiring, social reward and private information rather than bad faith, and that more insiders should leave.

Read if you weigh what lab insiders tell you about safety.

ExplainClose

The idea organisational epistemics. Beliefs that are each reasonable can still line up with an employer's goals, because of who joins, who stays and what gets praised.

Evidence a careful argument, with no measurement. An Anthropic employee, Hoagy, agreed the effect exists at smaller scales and asked how to measure it.

Lineage Irving Janis named a related failure "groupthink" (1972); Upton Sinclair's line about a salary and understanding (1935) is the folk version.

Open whether the pull can be measured, and whether outsiders are any less bent.

Background Kulveit lists ordinary forces: selection in hiring, who stays, social reward, and privileged internal information that outsiders cannot check. He argues none needs bad faith, yet together they move beliefs toward the organisation's goals, and asks insiders to credit outsiders' views more. The top reply, from an Anthropic researcher, says the effect also shows at small scale, in how important your own project feels until you leave it.

Open the source ↗
#humans #epistemics

The feed

Two arguments ran all evening. On Hacker News, engineers argued whether AI incident tools leave people unpractised for the hard outages, and whether pilots' mandated manual flying is the fix. On r/LocalLLaMA it was all measurement: temperature 0 cost a model 13 points on hard coding, DFlash2 drafts beat MTP by 17%, and caching makes an agent task 3.6x cheaper.

6 threads
r/LocalLLaMA · 51 points
Temperature 0 cost Qwen3.8 nearly 13 points on hard coding problems

On 100 hard LiveCodeBench problems, accuracy rose from 70.0% at temperature 0 to 82.7% at 1.0.

#models #sampling
ExplainClose

The thread greedy decoding also looped on 9% of problems, against 0.3% at 1.0. The poster warns that speculative-decoding speed claims are often measured at temperature 0, which flatters them.

Background The test used Qwen3.8 at about 4.6 bits a weight with top_p 0.95 and top_k 20, changing only temperature across 100 hard LiveCodeBench v6 problems. Accuracy: 70.0% at 0, 76.0% at 0.25 and 0.5, 79.7% at 0.75, 82.7% at 1.0; the gaps at 0 and 0.25 were significant. The poster says temperature 0 scored about what a 40% smaller quant does at normal settings.

Open the source ↗
r/LocalLLaMA · 83 points
DFlash2 drafts make Qwen3.8 Flash Next 17% faster in llama.cpp

On an M5 Max, the new draft head beat MTP by 17% on average, from 75.1 to 87.9 tokens a second.

#models #speculative-decoding
ExplainClose

The thread gains were 39% on lists and 18% on code, but prose was 3% slower and the edge faded by 25K context. The 350 MB draft head saves little VRAM because its compute buffer eats it back.

Background Measured on Apple's M5 Max with Q4_K_XL weights after sweeping draft settings for both methods (MTP n-max 3, DFlash2 n-max 5). Acceptance stayed high on lists (98%) but fell on prose (64% against 78% for MTP). A Q4_0 draft head matched Q8_0, so the smaller one is fine. Unlike the 27B version, the Flash Next drafter works with images.

Open the source ↗
Hacker News · 189 points
A working NES emulator baked into Qwen3.5-4B's weights

Drew Breunig compiled a 6502 CPU emulator into a small model's weights; it plays Super Mario Bros, very slowly.

#inside #weights
ExplainClose

The thread inspired by Divyansh Agrawal's qwenputer, the project builds weights that compute rather than learn. Simon Willison notes Opus found and used a 15-year-old CPU conformance test suite to check it.

Background Drew Breunig compiled a NES 6502 CPU emulator into Qwen3.5-4B's weights, so the network computes the CPU's steps rather than predicting text; it runs ROMs such as Super Mario Bros very slowly. It follows Divyansh Agrawal's qwenputer. Simon Willison notes the build was largely agent-driven, with Opus finding a 15-year-old CPU conformance test suite to check it.

Open the source ↗
X
Liv Gorton: Nick Cammarata no longer stands by the "V-shape neuron" claim

Gorton says basic checks contradict the essay's claim that a cat-and-car neuron is really a V-shape detector.

#inside #superposition
ExplainClose

The thread day 15 of the superposition argument (Concept of the day, 16 October). Gorton asks Cammarata to correct the essay prominently, since readers still cite the claim as written.

Background Gorton, an interpretability researcher, says the essay's specific claim that one neuron is "not a cat and car neuron, it's a V-shape neuron" fails basic checks and that, as she understands it, Cammarata no longer believes it as written. She adds she does not care what the neuron does in itself; the issue is that readers keep citing a claim its author has moved away from.

Open the source ↗
X
Agent Arena: caching makes a typical agent task 3.6x cheaper

Across 26,000 sessions, a Fable 5.1 task costs $7.44 with caching and would cost $27 without.

#harnesses #cost
ExplainClose

The thread one expired cache, from a break long enough for it to lapse, added about 5% to a typical task's bill, because the agent resends the conversation at full input price.

Background Arena analysed over 26,000 Agent Arena sessions from 12 September to 23 October, across 30 agents and 13 labs. If every cached token were billed at full input price, a task to a top-10 agent would cost 3.6 times as much. The figures are Arena's own, from its own users' sessions.

Open the source ↗
Hacker News · 505 points
AI isn't replacing SREs, it's deskilling them

A February essay resurfaced: if AI handles routine incidents, humans keep only the rare hard ones and lose practice for them.

#humans #skills
ExplainClose

The thread SigNoz's essay leans on Bainbridge's "Ironies of Automation" (1983) and proposes "deliberate inefficiency", handling some incidents by hand. Commenters split on whether aviation's mandated manual flying is the right model.

From the replies “Just like pilots, SREs will have to spend a minimum number of annual hours in the simulator to keep their skills sharp.” — leecoursey

Background The essay, from SigNoz's newsletter dated February 2026, cites a Lancet study in which endoscopists' unassisted detection fell from 28% to 22% after AI use, and argues for deliberate manual practice. SigNoz sells an AI assistant itself. Replies split: some say engineers on call for their own systems keep their skills; one instrument-rated pilot says aviation is moving toward single-pilot automation, not more manual flying.

Open the source ↗

Voices

Four exchanges, all about who controls your tools: what Anthropic's renamed plan really allows, whether grading every chat is surveillance, how a fake Claude Code reached Cursor's marketplace, and whether a vendor should write game rules into your agent's prompt.

“When we added weekly limits to Max 20x, we set them to 10x Pro's (the 5-hour limit stayed at 20x). I get that some new users assumed 20x applied to both limits. We could have done better here, and I'm sorry.”
mboverell (Claude subscriptions lead)
Anthropic's subscriptions lead explaining the rename
“So every prompt you send gets a second opinion from the model. About you.”
superalesha
a local-model user's objection
“We’re working with Cursor on this incident, but it wasn’t a compromise of Anthropic’s systems or employee laptops. A malicious actor used access to Cursor’s marketplace to publish a tampered copy of the Claude Code extension, which we didn’t build or publish.”
Felix Rieseberg
Anthropic placing the breach on Cursor's side
“Cyber is really a societal problem, one which AI companies alone cannot solve.”
Nathan Lambert
revisiting his view on open models and cyber risk, the day after Epoch's Firefox result

The leaderboard

86 models from Artificial Analysis, each effort level its own row, 31 with open weights · 0 boards changed hands since yesterday

Rank by
Score
1
Gemini 4 Carbon (High)NEW
Google · $8.00 / 1M · $7.76 per task · 85 tok/s
59.4index
2
Claude Opus 5.5 (Max)
Anthropic · $8.00 / 1M · $10 per task · 97 tok/s
58.4index
3
Claude Opus 5.5 (Xhigh)
Anthropic · $8.00 / 1M · $6.05 per task · 85 tok/s
57.0index
4
GPT-6 Astra (Max)
OpenAI · $20 / 1M · $6.24 per task · 78 tok/s
56.9index
5
GPT-6 Astra (Xhigh)
OpenAI · $20 / 1M · $3.66 per task · 66 tok/s
55.3index

Artificial Analysis leaderboard, read 2026-10-31 01:34 UTC. List price is AA's 3:1 blend of input and output per million tokens (0 / 0 means no hosted price and is left out); $ per task is what AA paid per task to run its index, tokens spent included. est. marks a score AA estimated rather than measured.

Arena Text
what people prefer in a blind test
Gemini 4 Carbon#1
2. Gemini 4 Argon #2 · 3. Claude Opus 5.5 #3
Arena WebDev
building a working front end, judged by people
Claude Opus 5.5#1
2. GPT-6 Astra #2 · 3. Claude Sonnet 5.5 #3
Arena Agent
agent work, judged by people
Claude Opus 5.5#1
2. Gemini 4 Carbon #2 · 3. Claude Sonnet 5.5 #3
AA Intelligence Index
Artificial Analysis' blend of hard evals
Gemini 4 Carbon59.4
2. Claude Opus 5.5 58.4 · 3. GPT-6 Astra 56.9
Vals Index
an independent blend, with cost per test
Claude Sonnet 5.570.8%
2. Gemini 4 Carbon 70.4% · 3. Claude Opus 5.5 70.2%
Terminal-Bench 4.0
agent work in a real shell
Opus 5.564.8%
2. Sonnet 5.5 61.8% · 3. GPT-6 Astra 58.2%
Vals SWE-bench
fixing real GitHub issues
Claude Opus 597.0%
2. DeepSeek V4 Pro 0813 96.4% · 3. GPT-5.6 Sol 96.2%
ARC-AGI-2
puzzles a model cannot have memorised
GPT-6 Astra95.0%
2. GPT-6.1 Sol 94.2% · 3. Claude Opus 5.5 93.3%
SimpleBench
trick questions that catch pattern-matching
Claude Opus 5.588.4%
2. Claude Fable 5.1 86.6% · 3. GPT-6 Astra Pro 86.5%
AA hallucination rate
how often it makes things up (lower is better)
Gemini 4 Carbon11.4%
2. Muse Wonder Full 17.6% · 3. Grok 4.7 20.0%
Cost per task
what one finished task bills (lower is better)
GPT-6 Luna$0.152
2. MiMo-V2.6-Pro $0.257 · 3. Beam 1.0 $0.284
OpenRouter usage
what developers actually run, tokens served this week
DeepSeek-V4.1-Flash45.5T
2. GLM-5.3-Flash 16.1T · 3. GPT-6 Luna 11.1T

New on OpenRouter: Particle AI: Particle-1 $0.05 / $0.50

On your card

The best Ollama models that fit 32 GB · fit is our arithmetic

qwen3.8
10 hours ago · 5.4M pulls
vision · tools · thinking27B · Q8_0 ~29 GB
20.1
muse-glimmer
2 months ago · 350.3K pulls
vision · tools · thinking30B · Q6_K ~25 GB
6.3
nemotron-3.5-lightning
2 weeks ago · 280.5K pulls
tools · thinking30B · Q6_K ~25 GB
5.5
d3
23 hours ago · 27.5K pulls
vision · decision27B · Q8_0 ~29 GB
not measured
lfm3
2 days ago · 22.7K pulls
tools · thinking1.7B · F16 ~3 GB
not measured
lfm3-omni
2 days ago · 11.3K pulls
vision · tools · audio2B · F16 ~4 GB
not measured
lfm3-vl
2 days ago · 269 pulls
vision · tools · thinking2B · F16 ~4 GB
not measured
lfm3-audio
2 days ago · 790 pulls
vision · tools · audio2B · F16 ~4 GB
not measured
d1-omni
3 days ago · 17.6K pulls
vision · decision · audio2B · F16 ~4 GB
not measured
qwen3-vl
1 week ago · 6.9M pulls
vision · tools · thinking32B · Q6_K ~26 GB
not measured
nemotron-3-nano
1 week ago · 965.1K pulls
tools · thinking30B · Q6_K ~25 GB
not measured
ornith-1.5
1 week ago · 441.4K pulls
vision · tools · thinking35B · Q6_K ~29 GB
not measured

From the whole ollama.com/library, read this morning, newest version of each line. Fit is the largest size that fits at ~0.56 GB per billion parameters (Q4_K_M) up to F16, with 2 GB held back for context. A score appears only where Artificial Analysis measured that exact model at that size.

The frontier

A model is on the frontier when no other scores higher on AA's index for the same money or speed.

Against

By list price, cheapest is left and smartest is up.

On the frontier · list priceper 1M
59.4
Gemini 4 Carbon (High)
Google
$8.00
54.5
GPT-6.1 Sol (Max)
OpenAI
$4.00
51.0
GPT-6.1 Terra (Max)
OpenAI
$2.00
36.2
Claude Haiku 5.5 (Max)
Anthropic
$0.20
32.5
DeepSeek V4.1 Flash 1017 (Max)openopen frontier
DeepSeek
$0.53
29.5
Ling 3.1 Flash 1019openopen frontier
InclusionAI
$0.45
28.9
MiniMax-M3.1-Flashopenopen frontier
MiniMax
$0.26
27.8
GLM-5.3-Flashopenopen frontier
Z AI
$0.24
26.7
MiMo-V2.6-Flashopen
Xiaomi
$0.17
5.5
Nemotron 3.5 Lightningopen
NVIDIA
$0.095

Lines: every model (solid) and open weights only (dashed). Hollow points are AA estimates. $ per task counts the tokens a model spends, so it often disagrees with list price. OpenRouter paid is the input price its traffic actually paid, averaged over providers (openrouter.ai/rankings); input only.