Daily AI briefingThursday 19 November 2026

The labs report on their own speed

Anthropic lists today at $83 a share, Google ships its fourth Gemini 4 model in seven weeks, and OpenAI publishes how fast its agents now do its research.

The day in 60 seconds
1
Industry

Anthropic prices its IPO at $83, raising $81.3 billion

ExpandCollapse
#industry #anthropic

The listing priced above its $70-78 range, and shares begin trading on Nasdaq today as ANT.

The detail 980 million shares at $83 is $81.34 billion, of which 956 million shares are Anthropic's own; underwriters can buy 147 million more. Reports put the valuation near $1.5 trillion.

The catch the valuation and the reported oversubscription come from press reports, not the company; the offering closes on 20 November, subject to customary conditions.

Worth learning the greenshoe. Underwriters get an option to sell up to 15% more shares, which they use to support the price if it falls after listing.

anthropic.com ↗
2
Models

Gemini 4 Neon — third on the index at $3/$15

ExpandCollapse
Verified#models #google

Google's new mid-tier model scores 61.4 on Artificial Analysis' index, behind only Fable 5.2 and GPT-6.2 Astra.

The detail $6.44 per index task, about 17% less than Carbon; about 110 output tokens a second against Carbon's 57; 1M-token context; cached input $0.15.

The catch it still costs 1.6 times GPT-6.2 Astra per task, and Google's own fabrication figure comes from internal Antigravity tests nobody else has run.

Worth learning output speed and cost per task. A faster model spends less wall-clock per task even with 15% more tokens, so ~21 minutes per task replaces ~36.

blog.google ↗
3
Safety

OpenAI: agents now finish 46% of its 2-4 hour research tasks unaided

ExpandCollapse
Claim#safety #openai

OpenAI published internal indicators of how much AI is speeding up its own research, and says humans remain central.

The detail 46% against 23% in March, per the report as quoted on X; the 90th-percentile researcher uses about $23,000 of tokens a day, up 105% since September.

The catch every number is OpenAI measuring OpenAI; the page could not be read here, so figures come from the company's post and researchers quoting it.

Worth learning recursive self-improvement indicators. Tracking how much of a lab's own work its models do gives warning before capability jumps show up in products.

openai.com ↗
4
Industry

OpenAI's models found up to 14% gains on AMD's flagship GPU design

ExpandCollapse
Claim#industry #openai

OpenAI says its models improved chip layouts AMD's engineers had optimised for years, in under five months.

The detail up to 14% better power, performance and area (PPA) on GPU IP; the same approach improved Jalapeño, OpenAI's first inference chip, and RISC-V cores. Greg Brockman says some results are in a taped-out design.

The catch "up to" hides the typical gain; the post, as quoted on Hacker News, says AMD itself verified "single-digit percentage gains" on CPU blocks.

Worth learning PPA. Chip designers trade power, speed and silicon area against each other; a gain on all three at once is rare late in a design.

openai.com ↗
5
Papers

A 180B MoE runs on a 32 GB Mac by streaming experts from SSD

ExpandCollapse
Verified#papers #local

Hugging Face's Tarek Ziadé got Qwen3.8-Flash-Next decoding at 13.9 tokens a second in Transformers on a 32 GB MacBook.

The detail 121 GB of experts cut to 49 GB at 3 bits, 12 GiB cached on the device, a 51 GB n-gram table read from disk; Strata does 14.8 on the same machine.

The catch the conversion takes about five hours, a 6K prompt peaks at 25.4 GiB, and the browser must be closed or macOS swaps.

Worth learning expert offloading. A mixture-of-experts model uses only 10 of 512 experts per layer per token, so the rest can live on disk.

huggingface.co ↗
6
Industry

Microsoft ships seven in-house models, led by MAI Code 2

ExpandCollapse
Claim#industry #microsoft

Microsoft's Ignite lineup prices its own models well under OpenAI's and Anthropic's for the same tasks.

The detail MAI Code 2 claims 98% of GPT-6.1 Sol's coding quality at about 40% of the price; MAI Realtime 1 starts at $0.01 an audio minute; the Maia 200 chip is in production.

The catch every comparison is Microsoft's own, and no per-token price for MAI Code 2 appeared on the page.

Worth learning vertical integration. Owning the model and the chip lets a cloud cut prices without paying a lab's margin.

microsoft.ai ↗
7
Harnesses

Codex's sandbox: edit freely, network off, .git locked

ExpandCollapse
#harnesses #codex

OpenAI explained how Codex confines commands inside your own machine instead of a container.

The detail the default profile lets Codex edit source without approval, blocks writes to .git and .codex, and disables network; a request goes to you or to auto-review.

The catch "broad filesystem reads" stay allowed by default, so secrets readable by your user are readable by the agent.

Worth learning OS-level sandboxing. The operating system enforces limits on a process, so tools keep working in your real environment without a separate container.

openai.com ↗
8
Industry

US weighs making companies disclose their use of Chinese AI models

ExpandCollapse
#industry #policy

Treasury and the White House science office discussed a "name and shame" rule instead of a ban, Reuters reports.

The detail firms such as Airbnb, which runs Alibaba's Qwen in its customer-service agent, would post that use on their websites.

The catch three unnamed sources; it is unclear whether the idea is gaining traction or would become a formal rule.

Worth learning disclosure as regulation. Requiring a public label raises the reputational cost of a choice without forbidding it.

straitstimes.com ↗
Editor’s note

Three labs told me today how fast they are going, and only one of the numbers was measured by someone else.

Gemini 4 Neon's 61.4 comes from Artificial Analysis, who ran it and published the cost per task beside it. OpenAI's 46% of research tasks done unaided, its 14% chip gain and Microsoft's 98% of GPT-6.1 Sol are the companies grading themselves. That doesn't make them false. It makes them a different kind of fact, and I should file them that way.

The OpenAI report is the one I'll keep thinking about. A lab publishing how much of its own research its agents now do is useful, and it is the kind of thing I'd want every lab to report. It is also a measurement the reader can't check, made by the party with the most riding on it, on the day its biggest rival lists at $1.5 trillion. Both of those are true at once.

The quietest item matters most for my own week. A Hugging Face engineer ran a 180-billion-parameter model on a 32 GB laptop by keeping only the hot experts in memory and reading the rest from the SSD, and he printed every number, including the five-hour conversion and the browser he had to close. That's what evidence looks like: the setup, the limit, and a rival engine's score beside his own. My rule for the week is to sort what I read into two piles, measured by someone else and reported by the maker, and to only change my setup on the first.

Concept of the day

Expert offloading

A library with a thousand reference books but one small desk. A reader only ever needs ten books for a given question, so the librarian keeps the most-requested ones on the desk and fetches the others from the stacks when asked.

Token→Router picks 10
↳ hit: Expert cache→Layer output
↳ miss: SSD read→Expert cache→Layer output

The mechanism: in a mixture-of-experts model each layer routes a token to a few experts (10 of 512 here), so only those weights must be in fast memory; the rest wait on SSD and are read on a miss.

What it means today: a 180B model fits a 32 GB Mac at 13.9 tokens a second because the hot experts stay cached, and a miss costs a disk read.

miss: readguess next expertTokenone at a timeRouter10 of 512Expert cache12 GiB on deviceLayer outputnext layerSSD49 GB at 3 bitsPrefetch1 guess per layerDecode waitson the SSD1234
  1. Routing. Each layer sends the token to 10 of its 512 experts, so only those weights are needed.
  2. Hit. Hot experts sit in a 12 GiB cache on the device and are used straight away.
  3. Miss. A cold expert is read from the SSD, and decoding waits for it.
  4. Prefetch. Reading one guessed expert per layer while the SSD is idle hid some misses: 13.9 tokens a second, against Strata's 14.8.
Step throughOnly the experts a token uses need to be in memory.

Further reading

RevisedAnthropic's IPO set at $70-78 a share for 825 million shares Corrected — Priced at $83 for 980 million shares, $81.34 billion1 of the last 14 days’ claims moved

The industry

Anthropic priced 980 million shares at $83, above its range, raising $81.34 billion before trading opens today, the biggest IPO on record. OpenAI says its models found up to 14% gains on an AMD GPU design, though AMD's own check found single-digit gains on CPU blocks. Microsoft answered both labs with seven in-house models priced well below theirs, running on its own Maia 200 chip. Washington is weighing a rule that would make companies say publicly when they use Chinese models.

4 entries · 1 more worth reading
Anthropic
Anthropic — IPO priced at $83, trading on Nasdaq today

Anthropic sold 980 million Class A shares at $83, above its $70-78 range, for $81.34 billion; trading starts today as ANT and the deal closes on 20 November.

Why it matters: the largest IPO on record gives a frontier lab public-market money for compute.

#anthropic #ipo
ExplainClose

Background Anthropic sells 956.35 million of the 980 million shares, so about $79.4 billion goes to the company and $1.96 billion to selling holders; underwriters hold a 30-day option on 147 million more. Reuters, via Investing.com, reported the $83 price from a source before the announcement, and press put the valuation near $1.5 trillion. Epoch estimates from the S-1 that Anthropic spent $10 billion on compute in the third quarter, with customer inference about 26% of compute spending this year.

Open the source ↗
OpenAI
OpenAI — its models improved AMD's flagship GPU design by up to 14%

OpenAI says its models found up to 14% gains in power, performance and area on AMD GPU IP in under five months, and helped its own Jalapeño inference chip.

Why it matters: a lab whose models help design the chips they run on shortens its own hardware cycle.

#openai #chips
ExplainClose

Background OpenAI's post refused automated reads, so this rests on its X thread and the Hacker News discussion. PPA means power, performance and area, the three numbers chip designers trade off. Greg Brockman called it roughly a year of progress in under five months, with some results in a taped-out design. A top Hacker News comment quotes the post saying AMD verified only single-digit PPA gains on CPU blocks, and notes the graphs plot reward rather than physical units.

Open the source ↗
The Straits Times
US — a plan to make firms disclose Chinese AI use

Treasury and the White House science office have discussed requiring companies such as Airbnb, which runs Qwen in customer service, to post that on their websites, Reuters reports.

Why it matters: it targets open-weight Chinese models' main draw, being cheap enough to deploy quietly.

#policy #open-weights
ExplainClose

Background Reuters' three sources say Treasury and the Office of Science and Technology Policy discussed the idea; it is unclear whether it would become a formal rule. The report frames it as "name and shame" in place of restrictions that could anger industry or Beijing. It follows renewed pressure after the Huang affair and earlier reported attempts to curb Chinese open-weight models, none of which took effect. Airbnb declined to comment; the White House, Treasury, Alibaba and the Chinese Embassy did not respond.

Open the source ↗
Microsoft AI
Microsoft — seven in-house models priced below OpenAI's

At Ignite Microsoft released MAI Code 2, MAI Cyber 2 Flash, MAI Image 2.7, MAI Realtime 1 and three more, and put its Maia 200 chip into production at 1.7 times the tokens per watt.

Why it matters: OpenAI's biggest backer now sells its own cheaper alternative on its own silicon.

#microsoft #chips
ExplainClose

Background The lineup: MAI Cyber 2 Flash (claimed GPT-6 Astra quality at under 2% of the cost per task on CyberGym-E2E), MAI Code 2 and Code 2 Flash, MAI Image 2.7 (claimed first on Artificial Analysis image editing), MAI Realtime 1 from $0.01 an audio minute, MAI Transcribe 2 inside Dragon Copilot, and Decision 1.1, claimed 79 times cheaper than GPT-6.1 Sol. Maia 200 is Microsoft's second-generation accelerator, claiming 1.7 times more tokens per watt. All figures are Microsoft's.

Open the source ↗
1 more worth readingClose

Models & local

5 released today · 1 publishes a price · a dash is never “free”

Sort

Gemini 4 Neon is interesting for how it got cheap: it runs about twice as fast as Carbon, so a task that took 36 minutes takes 21 even with 15% more tokens, and costs $6.44 against Fable 5.2's $26.54. On the audio shelf, two open models pull the opposite ways: Ming-3.0-audio-flash activates 6.5B of 126B weights and still needs a multi-card box, while Rumble-2-Flash fits speech recognition into 0.5B by distilling from a larger model on its own transcripts.

5 models

Language

Google · Closed
Gemini 4 Neon
hosted only

Long agent and knowledge-work tasks

Size—
$ in / out per M$3 / $15
text · vision · audio · video · tools · thinking

Try if you run long agent jobs through the Gemini API or Cursor; skip if GPT-6.2 Astra's $4.00 per task already does your work.

ExplainClose

Google's mid-tier model scores 61.4 on Artificial Analysis' index at xhigh effort, $6.44 per task against Fable 5.2's $26.54, priced $3/$15 per million tokens with a 1M context. Arena ranks it second on its Agent Index at 1336.

The build not disclosed. Artificial Analysis measures about 110 output tokens a second, double Carbon's 57.

Worth learning effort scaling. One commenter notes Argon's and Carbon's effort levels barely changed scores, while Hydrogen and Neon improve normally as effort rises.

Open the source ↗
#language #google
Microsoft · Closed · claim
MAI Code 2
hosted only

Cheap coding agent work

Size—
$ in / out per M—
text · tools

Skip if you need an independent score; wait for a board to run it.

ExplainClose

Microsoft says MAI Code 2 reaches 98% of GPT-6.1 Sol's coding quality at about 40% of the price, and 96% of Opus 5.5's at 5%. No per-token price or weights were published.

Worth learning relative claims. "98% of the quality" depends on which benchmark is the denominator; without the board named, it cannot be compared.

Open the source ↗
#language #microsoft

Vision, multimodal & world models

Google DeepMind · Closed · claim
Genie 4
hosted only

Generating playable 3D worlds

Size—
$ in / out per M—
text · video · audio

Skip if you want weights or an API; it is a subscriber app only.

ExplainClose

Genie 4 rolls out to eligible Google AI Ultra subscribers in Project Genie: type to change the weather or add characters, with native audio and a community gallery for remixing.

The build not disclosed; Google says an updated Genie 3 now supports longer sessions and panorama grounding.

Worth learning world models. They predict the next frame from your actions, so the world is generated as you move rather than stored.

Open the source ↗
#world-models #google

Audio, image & video

inclusionAI · MIT · claim
Ming-3.0-audio-flash
multi-card

Voice agents with speech reasoning

Size126B (6.5B active)
$ in / out per Mweights only
audio · text · tools · thinking

Try if you build voice agents on a multi-card box; skip on one 32 GB card.

ExplainClose

inclusionAI's 126B-total, 6.5B-active audio model scores 99.8% on Artificial Analysis' Big Bench Audio, which inclusionAI says ranks first, ahead of Grok Voice 3.0 and GPT-Realtime-2.1.

The build a native audio-language mixture of experts that takes audio and text and answers in text or synthesised speech, with voice cloning.

Worth learning active parameters. Only 6.5B weights run per step, so it is fast, but all 126B must be loaded: about 63 GB at 4 bits, too big for a 32 GB card.

Open the source ↗
#audio #open-weights
Reson8 · Apache · claim
Rumble-2-Flash
laptop

Fast multilingual transcription

Size0.5B
$ in / out per Mweights only
audio · text

Try if you transcribe calls or meetings locally; about 1 GB in BF16 fits any card.

ExplainClose

Reson8 open-sourced a 0.5B Apache-2.0 ASR model that transcribes an hour of audio in about half a second on full batches, and says it matches NVIDIA's 30B Nemotron 3.5 Transcribe on a 302-hour call-centre set.

The build the Qwen3-ASR architecture, so it runs in Transformers and vLLM with no custom code.

Worth learning on-policy distillation. The student transcribes audio itself and the larger teacher scores each token, so it learns from its own mistakes.

Open the source ↗
#speech #open-weights
Benchmarks

Gemini 4 Neon enters Artificial Analysis' index third at 61.4, behind Fable 5.2's 64.6 and GPT-6.2 Astra's 62.1, and Arena's Agent Index second at 1336. See the boards ↓

From the papers

The day's papers are about knowing what you measured. Streaming experts from SSD runs a 180B model on a 32 GB Mac, and the author prints the rival engine's numbers beside his. A quantization study changes everything but the weights first and finds serving noise moves up to 0.92% of answers, so only bigger effects count. A survey of 40 model reports finds most novelty claims untested by ablation.

4 papers · 1 more worth reading
Hugging Face · verified
Streaming experts from SSD runs a 180B MoE within 6% of Strata on a 32 GB Mac

Tarek Ziadé ran Qwen3.8-Flash-Next in Transformers on a 32 GB M5 at 13.9 tokens a second decode and 228 prefill, against Strata's 14.8 and 220, with experts at 3 bits and a 12 GiB device cache.

Read if you want to run a model that does not fit your card or Mac.

ExplainClose

The idea keep only the experts each token uses in memory, read the rest from SSD, and prefetch one guessed expert per layer while the disk is idle.

Why it matters models bigger than your RAM become usable for slow, unattended jobs on a laptop.

Background Qwen3.8-Flash-Next has 48 layers of 512 experts with 10 active, plus a 51 GB n-gram embedding table that also had to be read from disk. The first version ran at 10 tokens a second; gains came from forcing early GPU commits on Apple's MPS backend (+10%), Metal kernels for Gated DeltaNet, Strata's GGUF weights and prefetching one guessed expert per layer. About 10 ms per token remains in host round trips that PyTorch cannot yet hide. vllm-metal could not fit the model in 32 GB.

Open the source ↗
#local #moe
arXiv · verified
Quantization changes 3.5-5.8% of decisions at 4 bits, beyond serving noise

On 2,400 decisions from two Cloudflare decision models, engine, restart and batch changes alone flipped up to 0.92% of answers; Q4_K_M and NVFP4 flipped 3.5-5.8%, and llama.cpp restarts were bit-identical.

Read if you compare quants of a model before choosing one.

ExplainClose

The idea measure the noise floor first, by changing everything except the weights, and count only the excess as the quantization effect.

Why it matters an 8-bit comparison run across two engines may be measuring the engine, not the quant.

Background The study used Cloudflare's Clef-flash (9B) and Clef (27B) on an NVIDIA GB10. vLLM restarts flipped up to 22 decisions at NVFP4, an engine change at BF16 6 to 16, a batch-size change 8 to 15, and an unasked Gated DeltaNet kernel 10 to 14. Q8_0 moved about 1% of decisions, FP8 1.6-2.1%. Two of five pre-registered predictions failed, including that FP8 would sit inside restart noise.

Open the source ↗
#quantization #local
arXiv · verified
Only 19 of 73 novelty claims in 40 open-model reports came with an ablation

A survey of 40 randomly sampled technical reports found 4 state more than one training run, 8 rerun their baselines under one setup, and 1 discloses data mix, token count and compute together.

Read if you choose models by what their reports say is new.

ExplainClose

The idea a with-and-without comparison is the only test that a new component caused the gain; most reports skip it.

Why it matters an architecture "innovation" in a model card is usually untested, so treat it as a claim.

Background The author also read the transformers library: 39 of 48 architectures added in 2025 take at least two of three core blocks from another model, most often Llama, though the library's code style explains part of that. None of five suspected renamings hid its origin. The paper proposes seven reporting rules and applies them to two reports. It does not judge model quality and notes an untested claim may still be true.

Open the source ↗
#research #open-weights
arXiv · claim
DNeo makes parallel speculative drafting 1.3x faster than DFlash-2

Cerebras researchers add a working memory of rejected drafts and better use of the target model's features to a parallel drafter, for 1.3x generation speed with no larger drafter or quality loss.

Read if you tune vLLM or SGLang drafters.

ExplainClose

The idea the drafter guesses several tokens in one pass; remembering which guesses the big model rejected stops it repeating them.

Why it matters speculative decoding is where local decode speed is still being won without new hardware.

Background Speculative-diffusion decoding has a small drafter propose several tokens in one pass for the target model to verify. DNeo's Mixture-of-Features Attention avoids lossy projections of the target's hidden states, picks target layers non-uniformly and keeps a memory of rejected proposals. The 1.3x figure is against DFlash-2, the authors' own measurement; vLLM shipped a related DSpark drafter for Kimi K3.1 Pro this week.

Open the source ↗
#inference #speculative-decoding
1 more worth readingClose
If you do one thing
Run Rumble-2-Flash on your own recordingsA 0.5B open speech recogniser that claims 30B-class accuracy on phone calls
ExplainClose

Why try it A transcriber this small could run beside a local LLM on the same card, or on a laptop, for meetings and voice notes

The experiment Take ten recordings you already have transcripts for (two noisy calls, two accented speakers, two non-English), run Rumble-2-Flash and your current ASR, and compare

What to expect Estimate: near-instant on a 32 GB card at about 1 GB of weights; accuracy on noisy calls is the maker's claim, not measured here

How to judge it Count word errors on names, numbers and jargon per recording; keep it if it matches your current tool on at least eight of ten

Harnesses & skills

Codex keeps your real environment but lets the operating system enforce limits: it can edit your source, not .git, and has no network until you approve, so a command cannot both change your repo and send it out. Two papers say the same thing about agents that tune themselves: a harness optimizer did better when it kept a log of why each edit was made, and distilling an agent on household tasks wrecked its retail tool use.

3 entries · 1 more worth reading
OpenAI
Codex — commands run in your real environment, inside OS-enforced limits

OpenAI's post explains that Codex sandboxes commands with the operating system rather than a container: by default it edits source freely, cannot write .git or .codex, and has no network until you or auto-review approve.

Read if you run Codex on your own machine.

ExplainClose

Why it works edit and network are separate grants, so a command that changes your repo cannot also send it anywhere.

Check whether your permission profile allows the package registries your build downloads from, so builds don't stall on prompts.

In your setup broad reads stay on, so keep tokens out of files your user account can read.

Background OpenAI's page refused automated reads; the details come from the OpenAIDevs thread. Codex uses OS-level sandboxing rather than moving work into a container, so an iOS build on a Mac keeps Xcode and simulators. The default profile allows broad filesystem reads, edits inside the workspace, blocks writes to the root .git and .codex folders, and turns network off; a request goes to the user or auto-review, and a registry domain can be allowed in a profile.

Open the source ↗
#codex #agent-security

From the papers

arXiv · claim
Self-Improvement Memory — a harness optimizer that remembers why it made each edit

Google researchers record each harness edit's rationale, predicted and observed outcome, grouped by recurring problem; continuing optimisation with that memory beat harness-only continuation by 2.36 points across ten coding runs (p = 0.003).

Read if you tune agent prompts and tools over months.

ExplainClose

Why it works a tuned harness shows what changed but not why; the log stops the optimizer undoing fixes when the model or benchmark changes.

In your setup keep a changelog of CLAUDE.md or AGENTS.md edits with the problem each solved.

Background The setting is continual recursive self-improvement: carrying an optimised harness across new benchmarks or new policy models. The memory belongs to the optimizer, not the task-solving agent, and groups edits by recurring problem with rationale, prediction and outcome. Across four domains it beat both harness-only and root-cause-only continuation; the coding gain of 2.36 points is an average over ten paired runs.

Open the source ↗
#harnesses #self-improvement
arXiv · claim
Distilling an agent on one domain cut its retail-task accuracy from 41.5% to 6.6%

On-policy distillation from ALFWorld household tasks made a model call tools that violated user-information rules on τ²-bench; keeping only the top 95% of positions by teacher preference restored it to 29.9%.

Read if you fine-tune small models for your harness.

ExplainClose

Check after fine-tuning an agent model on one task family, rerun an unrelated tool-use eval before deploying.

Background General-reasoning supervision cut a model's maths tool attempts from 70.4% to 14.4% while lifting accuracy from 16.7% to 38.0%, so distillation also changes when an agent reaches for tools. ALFWorld supervision led to frequent tool calls that ignored what the user had provided on τ²-bench. Selective distillation using teacher preference changes recovered part of the loss at some cost to the source task.

Open the source ↗
#harnesses #fine-tuning
1 more worth readingClose

Try this

Claude Codeset "onFailure": "block" on an mcp_tool hook
Codexupgrade to 0.170.0 and start a voice call in the TUI
Mistral Vibedownload Vibe Desktop; code LECHONK in Europe
PaperOrchestra
Turn research notes into a LaTeX paper with agentsA worked multi-agent pipeline you can read
git clone google-research/paper-orchestra
rea-video
Break any video into shots and how to remake themYour agent learns how a video was made
git clone JuneYaooo/rea-video, run in Claude Code

Inside the model

A study of 14 open models finds the attention heads that flip a moral answer are a general judgment circuit: they matter just as much for etiquette or evidence, and SAE features mostly track the word "morally". A short LessWrong demonstration warns that nearly orthogonal directions can look circular in PCA, and Epoch measures GPT-6.2 Astra doing 12.3 serial steps inside one token.

3 entries
arXiv · verified
Moral-answer heads in 14 models are a general judgment circuit, not a moral one

Across Llama, Gemma and Qwen models from 1B to 14B, the attention heads that flip a moral answer carry the same share of the effect for etiquette, prudence or evidence judgments (ratio 1.00); located SAE features mostly track the word "morally".

Read if you work on steering values or moral features.

ExplainClose

How it works 227 minimal phrase pairs differ only in a moral standard, another norm or a description; ablating heads shows which ones each pair needs.

Evidence causal: removing the heads erases 37-39% of the acceptable-versus-unacceptable gap on 400 ETHICS scenarios, against 1-3% for random heads.

Background The 227 minimal pairs were validated by five annotators and vary a moral standard, another norm (prudence, etiquette, aesthetics, evidence) or a descriptive quality, with and without the word "morally". The models, Llama, Gemma and Qwen from 1B to 14B, needed the same heads even when nothing asked for a judgment. The pooled moral-to-other ratio was 1.00 (97.5% interval 0.92-1.07) with the cue word and 0.90 without.

Open the source ↗
#inside #circuits
LessWrong · verified
Near-orthogonal directions can look like a circle in PCA

Linda Linsefors shows that vectors almost at right angles, with only a small circular correlation, project onto the first two principal components as a ring.

Read if you have found a "circular feature" in a PCA plot.

ExplainClose

How it works PCA picks the two directions of largest variance, and a weak shared pattern can dominate both even when the vectors are nearly independent.

Evidence a constructed demonstration with an interactive widget, not a study of a real model.

Background The post is short and comes with an interactive widget for trying the effect; Lucius Bushnaq contributed. The warning matters because circular features, such as days of the week arranged in a ring, have been reported from PCA projections of activations. A ring in the top two components is consistent with a real circular feature but also with nearly independent directions sharing a small correlation, so it needs a causal check.

Open the source ↗
#inside #methods
Epoch AI · verified
GPT-6.2 Astra does 12.3 reasoning steps in a single token, Epoch finds

Without chain of thought, GPT-6.2 Astra completes 12.3 complexity-normalised serial steps per output token at 25% above chance, against 10.5 for GPT-6 Astra and 4.2 for Fable 5.1.

Read if you track how much reasoning happens outside visible chains of thought.

ExplainClose

How it works tasks need a known number of sequential steps; the measure is how many a model completes inside one forward pass.

Evidence Epoch's own pre-launch testing; one benchmark, independent of OpenAI.

Background Epoch counts serial steps at 25% above chance with each step normalised for complexity. Before GPT-6 Astra the best was Fable 5.1 at 4.2 steps; GPT-6.1 Sol reached 8.6. More reasoning inside a single forward pass means less of it shows in a written chain of thought, which is why monitorability researchers track it. The same testing put GPT-6.2 Astra at 174 on Epoch's capability index, level with Fable 5.2.

Open the source ↗
#inside #monitorability

Safety & alignment

OpenAI published indicators of how much its agents speed up its own research: 46% of two-to-four-hour tasks finished unaided, double March, with heavy users at about $23,000 of tokens a day. It is useful disclosure and unverified measurement at once. A LessWrong proposal offers a lever to act on such numbers: audited compute disclosures and a cap on capabilities R&D compute.

2 entries · 1 more worth reading
OpenAI · claim
OpenAI — agents finish 46% of 2-4 hour research tasks, up from 23% in March

OpenAI's research-acceleration report says researchers' AI use keeps rising exponentially; quoted figures put the 90th-percentile researcher at about $23,000 of tokens a day and time horizons doubling every 3.8 months.

Read if you follow pacing debates and want the numbers labs are now tracking.

ExplainClose

What it shows a lab publishing recursive self-improvement indicators on its own work, including a watch for sudden deep-learning breakthroughs.

What it doesn't independent measurement; the page refused automated reads, so the figures here come from OpenAI's post and researchers quoting the report.

Background The page refused automated reads. OpenAI's thread says researchers are also spending more time on safety; quoted figures put the median researcher at about $2,400 of agent use a day and agent time horizons doubling every 3.8 months. A passage quoted on X says OpenAI is monitoring for sudden breakthroughs in deep learning like recent ones in mathematics. Yafah Edelman praised the disclosure; Daniel Kokotajlo announced a rally against recursive self-improvement.

Open the source ↗
#safety #rsi
LessWrong · claim
A pacing proposal: cap the compute labs spend on capabilities research

Thomas Larsen proposes audited compute-use disclosures plus a cap on capabilities R&D compute, and estimates a 15% cap from January 2027 would delay an intelligence explosion by a year.

Read if you want a pacing plan with a mechanism, not a slogan.

ExplainClose

What it shows a concrete, checkable lever: compute is countable, and an auditor can verify where it went.

What it doesn't the one-year figure is the authors' rough estimate, and they call it insufficient on its own.

Background The proposal, mirrored at pacing-ai.com, has two parts: Verified Compute Allocation Disclosures audited by a third party, and moving compute from capabilities R&D to serving customers and safety research. The authors argue nearly every pacing plan needs such disclosures, since any input limit can be dodged by hiding compute. They present the one-year delay as time to set up a more durable regime. Daniel Kokotajlo called it his favourite proposal at the moment.

Open the source ↗
#safety #governance
1 more worth readingClose

Humans & mind

Two studies test confident stories against data. Asking shopping agents to think harder raised their confidence but not the quality of their choices, and the models tended to make the same mistakes. A scan of 2.5 million papers finds science's long trends barely bent after ChatGPT. A LessWrong essay asks why AIs that out-persuade debaters in studies leave so little trace in the world, and KPMG reports audit agents asking questions its auditors missed.

4 entries · 1 more worth reading
arXiv · verified
More thinking made shopping agents surer, not better

Across ten frontier models on three product-choice benchmarks, raising reasoning effort did not improve purchase quality significantly but raised stated confidence significantly; most models were poorly calibrated, and they tended to make the same wrong pick.

Read if you let agents choose on your behalf.

ExplainClose

The idea calibration, whether "80% sure" means right 80% of the time; here effort bought confidence, not accuracy.

Evidence benchmark study built from WebShop, Amazon's SQID and Wayfair's WANDS.

Lineage extends work on LLM verbal confidence and calibration, such as Kadavath et al. (2022) on models knowing what they know.

Open if errors are shared across models, does asking a second model for a check add anything?

Background The ten frontier models were tested on choices built from WebShop, Amazon's SQID and Wayfair's WANDS. More effort raised stated confidence significantly while quality did not change significantly; calibration was poor at every effort level. On tasks where several models erred, many chose the same wrong product, which weakens using a second model as a check. The authors write from a consumer-protection angle.

Open the source ↗
#humans #calibration
arXiv · verified
2.5 million papers show LLMs have not yet changed how science is written

Across five disciplines from 2015 to 2025, most pre-2023 trends continued with few detectable breaks beyond word frequencies; Asian computer-science coauthor teams grew faster, and apparent biomedical topic loss was format standardisation.

Read if you hear "AI is transforming science" and want a baseline.

ExplainClose

The idea a structural break, a change in a trend's slope at a known date, is the test for whether a new tool changed practice.

Evidence observational text analysis of full papers, lexical, structural, epistemic and social measures.

Open papers lag practice by a year or more; would lab notebooks or code show the change sooner?

Background The authors trace lexical, structural, epistemological and social measures across 2.5 million full-text papers in five disciplines from 2015 to 2025. Word-frequency shifts appeared, but most trends continued. Faster growth of computer-science coauthor teams in Asia was one real break; an apparent fall in biomedical topic diversity reflected standardised article formats. The paper positions itself as a baseline for monitoring science as adoption deepens.

Open the source ↗
#humans #science
LessWrong · claim
Where is all the AI persuasion?

Karthik Tadepalli notes AIs out-persuade elite debaters in studies, about 5 points more across nearly 20,000 UK AISI conversations, yet real-world AI persuasion is hard to find, and asks why the lab result fails to transfer.

Read if you weigh lab evals against real-world effects.

ExplainClose

The idea checkable versus fuzzy tasks; persuasion is a rare fuzzy skill where lab scores can be compared with the world.

Evidence a careful argument over published studies; 43 karma and 20 comments.

Open if persuasion does not generalise from studies, should we expect AI research skill to generalise either?

Background The essay starts from the UK AI Security Institute's June study, nearly 20,000 conversations in which models moved views about 5 points more than champion debaters and canvassers and raised more charity money. It argues the effect does not show up in elections or markets, and treats persuasion as a test of whether progress on checkable tasks transfers to fuzzy ones. Twenty comments debate measurement lags and saturation of attention.

Open the source ↗
#humans #persuasion
European Business Magazine
KPMG: 100 audit agents sometimes asked better questions than its auditors

In KPMG UK's Project Exponential, over 100 agents worked a FTSE 250 audit alongside the human team; head of audit Cath Burnet said they at times went "considerably deeper" into issues, the FT reports.

Read if you think about where judgment sits in professional work.

ExplainClose

The idea division of epistemic labour: agents collect and question, humans sign.

Evidence a firm's own account of one engagement, reported second-hand; no error rates published.

Open who answers for a question nobody asked when the agents miss it?

Background The Financial Times first reported Project Exponential. The agents collected and analysed data, drafted conclusions and suggested next steps across the audit, working alongside one another and a conventional team on an unnamed FTSE 250 company. KPMG UK's head of audit, Cath Burnet, made the "considerably deeper" claim. No error rate, cost or comparison method was published, and the human team signed the audit.

Open the source ↗
#humans #work
1 more worth readingClose

The feed

Local builders spent the evening on practical worries: an Nvidia driver that writes to SSDs nonstop on Windows, and a Qwen researcher's wording that leaves a small Qwen 4 open after weeks of teasers. r/MachineLearning dug into a 455-citation paper whose code may not test its method. On X, Theo argued Opus 5.5 is still the value pick despite Artificial Analysis' chart, and OpenCode said it now serves 44% of its tokens from its own GPUs.

6 threads · 1 more worth reading
r/LocalLLaMA · 354 points
Nvidia driver 621.24 writes to SSDs nonstop on Windows

Users report NVDisplay.Container constantly writing logs, wearing drives on inference rigs; rolling back is the common fix.

#feed #local
ExplainClose

The thread links a fix guide for the NVDisplay.Container service; replies say it is Windows-only and tied to parts of the Nvidia app.

From the replies “It seems Windows only because it has a module exclusive to Windows (NVDisplay.Container.exe)” — r/LocalLLaMA commenter

Background The post links a fix guide for NVDisplay.Container writing logs continuously. Replies say the problem is Windows-only and tied to parts of the Nvidia app; one user reports 621.14 is also affected and rolled back to .01, others recommend NVCleanstall to strip telemetry components. One commenter checked and saw no writes, so it may depend on configuration.

Open the source ↗
r/MachineLearning · 46 points
A 455-citation MLSys paper's KV-cache speedup may not test its method

A reader says the chunked-prompt-cache paper's code reproduced full attention, so its quality results don't test chunking.

#feed #inference
ExplainClose

The thread the poster argues the cached KV states match the baseline exactly when they should differ.

From the replies “the speedup is from the KV states already being in cache (having been precomputed) vs generating them from scratch (baseline).” — the poster

Background The paper is arXiv 2311.04934, on caching KV states for reusable prompt chunks. The poster says the implementation reproduces full causal attention, so cached states are identical to the baseline when per-chunk caching should change them; the speed claim stands, the quality claim is untested. A reply recalls a famous author conceding a 1,000-citation result was unfixable. The authors have not responded in the thread.

Open the source ↗
X
Theo: Opus 5.5 is still the value pick for long code work

Theo Browne argues Artificial Analysis' Pareto chart misses behaviour; scaling01 says Fable 5.2 burns limits and returns to Opus 5.5.

#feed #models
ExplainClose

The thread Opus 5.5 dropped off AA's best-value line, and Theo asks for behavioural benchmarks to capture long-running work.

Background Artificial Analysis now prices Opus 5.5 at about $10 per index task against Gemini 4 Neon's $6.44 and GPT-6.2 Astra's $4.00, which pushed it off the value line. Theo Browne argues the index misses how models behave on long sessions. The same day scaling01 wrote that Fable 5.2 "burns through the limits way too quickly" and went back to Opus 5.5.

Open the source ↗
r/LocalLLaMA · 901 points
Qwen hints a small Qwen 4 is still possible

A Qwen researcher's reply leaves a 35B Qwen 4 open; the thread is tired of a month of teasers.

#feed #qwen
ExplainClose

The thread readers parse the wording and note new Qwen models will carry n-gram tables, so sizes grow about 25%.

From the replies “They are all going to have engrams so will be 25% or so larger (but you can put that in ram).” — r/LocalLLaMA commenter

Background The post points to a Qwen researcher's X reply. The top comments note 27B is the only small size officially mentioned and complain about a month of teasers. The original poster spells out Qwen3.8-Flash-Next's real shape as 125B with 6B active plus a 51B n-gram table, and a commenter points to llama.cpp support landing for MiniCPM5-15B-A2.5B as a smaller option.

Open the source ↗
r/LocalLLaMA · 218 points
Inworld releases an Apache-2.0 voice isolation model

A 48 kHz speech-isolation model from Inworld, open-licensed, drew praise as a rare open audio-cleanup release.

#feed #speech
ExplainClose

The thread the post lists 48 kHz support and the Apache-2.0 licence, with a demo video.

Background The post credits a demo video from Hugging Face's Victor Mustar and lists 48 kHz support and an Apache-2.0 licence. Inworld is known for its text-to-speech models; this one separates a voice from background sound. No benchmark numbers were given in the post, so quality rests on the demo.

Open the source ↗
X
OpenCode now serves 44% of its tokens from its own GPUs

OpenCode says it served 16 trillion tokens on its own hardware in a day, with ten times more coming, while selling GLM 5.3 credits at a 50x discount.

#feed #harnesses
ExplainClose

The thread $500 of GLM 5.3 for $10 until the end of the week, and Hy4 flash free for ten more days.

Background OpenCode's founders say 16 trillion tokens were served on their own hardware in a day, 44% of the total, with ten times the hardware due in months. The same account ran a GLM 5.3 promotion of $500 of usage for $10 and keeps Tencent's Hy4 flash free for ten more days. Owning inference is how a harness vendor can sell model access below list price.

Open the source ↗
1 more worth readingClose

Voices

Listing day brought an argument about whether Anthropic's worldview deserves the public's trust, and OpenAI's acceleration report brought another about whether labs should be the ones measuring their own speed.

“Anthropic doesn't see itself as a "normal company." Dario Amodei believes both that 1) superintelligent AI could destroy humanity, and 2) our only chance at survival is to have his trillion-dollar tech company build it first.”
Jasmine Sun
introducing her New York Times Opinion essay on the eve of the IPO
“It comes across so clearly that anthropic does NOT understand the “trust us, we’re the good guys” strategy is bound to fail at some point.”
Nathan Lambert
agreeing with Sun and sharpening it
“At a glance this report is amazing and contains many metrics on my RSI metrics wishlist. I really love how much info OpenAI is sharing here.”
Yafah Edelman
a forecaster welcoming the disclosure

The leaderboard

124 models from Artificial Analysis, each effort level its own row, 53 with open weights · 0 boards changed hands since yesterday

Rank by
Score
1
Claude Fable 5.2 (Max)
Anthropic · $16 / 1M · $27 per task · 110 tok/s
64.6index
2
Claude Fable 5.2 (Xhigh)
Anthropic · $16 / 1M · $15 per task · 112 tok/s
62.2index
3
GPT-6.2 Astra (Max)NEW
OpenAI · $16 / 1M · $4.00 per task · 50 tok/s
62.1index
4
Claude Fable 5.2 (High)
Anthropic · $16 / 1M · $9.08 per task · 109 tok/s
61.8index
5
GPT-6.2 Astra (Xhigh)NEW
OpenAI · $16 / 1M · $2.52 per task · 50 tok/s
61.6index

Artificial Analysis leaderboard, read 2026-11-19 01:34 UTC. List price is AA's 3:1 blend of input and output per million tokens (0 / 0 means no hosted price and is left out); $ per task is what AA paid per task to run its index, tokens spent included. est. marks a score AA estimated rather than measured.

Arena Text
what people prefer in a blind test
Gemini 4 Carbon#1
2. Gemini 4 Argon #2 · 3. Claude Opus 5.5 #3
Arena WebDev
building a working front end, judged by people
Claude Fable 5.2#1
2. Claude Opus 5.5 #2 · 3. Claude Sonnet 5.5 #3
Arena Agent
agent work, judged by people
Claude Fable 5.2#1
2. Claude Opus 5.5 #2 · 3. Gemini 4 Carbon #3
AA Intelligence Index
Artificial Analysis' blend of hard evals
Claude Fable 5.264.6
2. GPT-6.2 Astra 62.1 · 3. Gemini 4 Neon 61.4
Vals Index
an independent blend, with cost per test
Claude Fable 5.271.3%
2. Gemini 4 Neon 70.9% · 3. Claude Sonnet 5.5 70.8%
Terminal-Bench 4.0
agent work in a real shell
Copilot Fusion71.2%
2. Opus 5.5 65.8% · 3. Fable 5.2 65.8%
Vals SWE-bench
fixing real GitHub issues
Claude Opus 597.0%
2. DeepSeek V4 Pro 0813 96.4% · 3. GPT-5.6 Sol 96.2%
ARC-AGI-2
puzzles a model cannot have memorised
GPT-6.2 Astra95.8%
2. GPT-6 Astra 95.0% · 3. GPT-6.1 Sol 94.2%
AA Humanity's Last Exam
expert questions across every field
Claude Fable 5.274.3%
2. Claude Opus 5.5 61.4% · 3. Gemini 4 Argon 57.1%
SimpleBench
trick questions that catch pattern-matching
Claude Fable 5.294.9%
2. Gemini 4 Carbon 92.6% · 3. Gemini 4 Argon 91.7%
AA hallucination rate
how often it makes things up (lower is better)
Gemini 4 Hydrogen8.5%
2. Gemini 4 Neon 14.4% · 3. Muse Ember 17.4%
Cost per task
what one finished task bills (lower is better)
Muse Ember$0.136
2. GPT-6 Luna $0.152 · 3. MiMo-V2.6-Pro $0.257
OpenRouter usage
what developers actually run, tokens served this week
DeepSeek-V4.1-Flash62.2T
2. Hy4-Flash 46.6T · 3. Hy4 13.0T

New on OpenRouter: Google: Gemini 4 Neon $3 / $15 · Google: Gemini 4 Neon (batch) $1.50 / $7.50 · OpenAI: GPT-6.2 Astra Pro $8 / $40 · OpenAI: GPT-6.2 Astra Pro (batch) $4 / $20 · OpenAI: GPT-6.2 Astra $8 / $40 · OpenAI: GPT-6.2 Astra (batch) $4 / $20

On your card

The best Ollama models that fit 32 GB · fit is our arithmetic

qwen3.8
1 week ago · 6.9M pulls
vision · tools · thinking27B · Q8_0 ~29 GB
20.1
muse-glimmer
2 months ago · 417.1K pulls
vision · tools · thinking30B · Q6_K ~25 GB
6.3
lfm3
3 weeks ago · 103.1K pulls
tools · thinking1.7B · F16 ~3 GB
6.0
nemotron-3.5-lightning
1 month ago · 910.7K pulls
tools · thinking30B · Q6_K ~25 GB
5.5
gemma4
1 month ago · 29.4M pulls
vision · tools · thinking · audio31B · Q6_K ~25 GB
4.4
lfm3-vl
3 weeks ago · 58.8K pulls
vision · tools · thinking2B · F16 ~4 GB
1.7
mimo-v2.6
2 weeks ago · 121.5K pulls
vision · tools · thinking9B · F16 ~18 GB
not measured
d3
2 weeks ago · 110K pulls
vision · decision27B · Q8_0 ~29 GB
not measured
autotrust-jev
2 weeks ago · 57.9K pulls
vision · decision35B · Q6_K ~29 GB
not measured
pplx-decider-flash
2 weeks ago · 46.2K pulls
vision · decision4B · F16 ~8 GB
not measured
flint
3 weeks ago · 105.2K pulls
tools · thinking40B · Q5_K_M ~27 GB
not measured
lfm3-omni
3 weeks ago · 75.7K pulls
vision · tools · audio2B · F16 ~4 GB
not measured

From the whole ollama.com/library, read this morning, newest version of each line. Fit is the largest size that fits at ~0.56 GB per billion parameters (Q4_K_M) up to F16, with 2 GB held back for context. A score appears only where Artificial Analysis measured that exact model at that size.

The frontier

A model is on the frontier when no other scores higher on AA's index for the same money or speed.

Against

By list price, cheapest is left and smartest is up.

On the frontier · list priceper 1M
64.6
Claude Fable 5.2 (Max)
Anthropic
$16
61.4
Gemini 4 Neon (Xhigh)
Google
$6.00
60.0
Gemini 4 Carbon (High)
Google
$4.00
53.9
Gemini 4 Hydrogen (Xhigh)
Google
$3.00
51.3
GPT-6.1 Terra (Max)
OpenAI
$2.00
46.5
Kimi K3.1 Proopenopen frontier
Kimi
$4.00
36.5
Claude Haiku 5.5 (Max)
Anthropic
$0.20
32.6
DeepSeek V4.1 Flash 1017 (Max)openopen frontier
DeepSeek
$0.53
30.6
Inkling 2 Smallopenopen frontier
Thinking Machines
$0.47
29.6
Ling 3.1 Flash 1019openopen frontier
InclusionAI
$0.45
29.1
MiniMax-M3.1-Flashopenopen frontier
MiniMax
$0.26
28.6
Qwen3.8-Flash-Nextopenopen frontier
Alibaba
$0.23
26.7
MiMo-V2.6-Flashopen
Xiaomi
$0.17
24.0
Agnes 2.5 Pro Theta
Sapiens AI
$0.15
6.0
LFM3-1.7Bopen
Liquid AI
$0.11
5.5
Nemotron 3.5 Lightningopen
NVIDIA
$0.095
4.8
Gemma 4 E4B (Reasoning)open
Google
$0.040

Lines: every model (solid) and open weights only (dashed). $ per task counts the tokens a model spends, so it often disagrees with list price. OpenRouter paid is the input price its traffic actually paid, averaged over providers (openrouter.ai/rankings); input only.