Anthropic lists today at $83 a share, Google ships its fourth Gemini 4 model in seven weeks, and OpenAI publishes how fast its agents now do its research.
The day in 60 seconds
1
Industry
Anthropic prices its IPO at $83, raising $81.3 billion
ExpandCollapse
#industry #anthropic
The listing priced above its $70-78 range, and shares begin trading on Nasdaq today as ANT.
The detail 980 million shares at $83 is $81.34 billion, of which 956 million shares are Anthropic's own; underwriters can buy 147 million more. Reports put the valuation near $1.5 trillion.
The catch the valuation and the reported oversubscription come from press reports, not the company; the offering closes on 20 November, subject to customary conditions.
Worth learning the greenshoe. Underwriters get an option to sell up to 15% more shares, which they use to support the price if it falls after listing.
Google's new mid-tier model scores 61.4 on Artificial Analysis' index, behind only Fable 5.2 and GPT-6.2 Astra.
The detail $6.44 per index task, about 17% less than Carbon; about 110 output tokens a second against Carbon's 57; 1M-token context; cached input $0.15.
The catch it still costs 1.6 times GPT-6.2 Astra per task, and Google's own fabrication figure comes from internal Antigravity tests nobody else has run.
Worth learning output speed and cost per task. A faster model spends less wall-clock per task even with 15% more tokens, so ~21 minutes per task replaces ~36.
OpenAI: agents now finish 46% of its 2-4 hour research tasks unaided
ExpandCollapse
Claim#safety #openai
OpenAI published internal indicators of how much AI is speeding up its own research, and says humans remain central.
The detail 46% against 23% in March, per the report as quoted on X; the 90th-percentile researcher uses about $23,000 of tokens a day, up 105% since September.
The catch every number is OpenAI measuring OpenAI; the page could not be read here, so figures come from the company's post and researchers quoting it.
Worth learning recursive self-improvement indicators. Tracking how much of a lab's own work its models do gives warning before capability jumps show up in products.
OpenAI's models found up to 14% gains on AMD's flagship GPU design
ExpandCollapse
Claim#industry #openai
OpenAI says its models improved chip layouts AMD's engineers had optimised for years, in under five months.
The detail up to 14% better power, performance and area (PPA) on GPU IP; the same approach improved Jalapeño, OpenAI's first inference chip, and RISC-V cores. Greg Brockman says some results are in a taped-out design.
The catch "up to" hides the typical gain; the post, as quoted on Hacker News, says AMD itself verified "single-digit percentage gains" on CPU blocks.
Worth learning PPA. Chip designers trade power, speed and silicon area against each other; a gain on all three at once is rare late in a design.
A 180B MoE runs on a 32 GB Mac by streaming experts from SSD
ExpandCollapse
Verified#papers #local
Hugging Face's Tarek Ziadé got Qwen3.8-Flash-Next decoding at 13.9 tokens a second in Transformers on a 32 GB MacBook.
The detail 121 GB of experts cut to 49 GB at 3 bits, 12 GiB cached on the device, a 51 GB n-gram table read from disk; Strata does 14.8 on the same machine.
The catch the conversion takes about five hours, a 6K prompt peaks at 25.4 GiB, and the browser must be closed or macOS swaps.
Worth learning expert offloading. A mixture-of-experts model uses only 10 of 512 experts per layer per token, so the rest can live on disk.
Microsoft ships seven in-house models, led by MAI Code 2
ExpandCollapse
Claim#industry #microsoft
Microsoft's Ignite lineup prices its own models well under OpenAI's and Anthropic's for the same tasks.
The detail MAI Code 2 claims 98% of GPT-6.1 Sol's coding quality at about 40% of the price; MAI Realtime 1 starts at $0.01 an audio minute; the Maia 200 chip is in production.
The catch every comparison is Microsoft's own, and no per-token price for MAI Code 2 appeared on the page.
Worth learning vertical integration. Owning the model and the chip lets a cloud cut prices without paying a lab's margin.
OpenAI explained how Codex confines commands inside your own machine instead of a container.
The detail the default profile lets Codex edit source without approval, blocks writes to .git and .codex, and disables network; a request goes to you or to auto-review.
The catch "broad filesystem reads" stay allowed by default, so secrets readable by your user are readable by the agent.
Worth learning OS-level sandboxing. The operating system enforces limits on a process, so tools keep working in your real environment without a separate container.
Three labs told me today how fast they are going, and only one of the numbers was measured by someone else.
Gemini 4 Neon's 61.4 comes from Artificial Analysis, who ran it and published the cost per task beside it. OpenAI's 46% of research tasks done unaided, its 14% chip gain and Microsoft's 98% of GPT-6.1 Sol are the companies grading themselves. That doesn't make them false. It makes them a different kind of fact, and I should file them that way.
The OpenAI report is the one I'll keep thinking about. A lab publishing how much of its own research its agents now do is useful, and it is the kind of thing I'd want every lab to report. It is also a measurement the reader can't check, made by the party with the most riding on it, on the day its biggest rival lists at $1.5 trillion. Both of those are true at once.
The quietest item matters most for my own week. A Hugging Face engineer ran a 180-billion-parameter model on a 32 GB laptop by keeping only the hot experts in memory and reading the rest from the SSD, and he printed every number, including the five-hour conversion and the browser he had to close. That's what evidence looks like: the setup, the limit, and a rival engine's score beside his own. My rule for the week is to sort what I read into two piles, measured by someone else and reported by the maker, and to only change my setup on the first.
Concept of the day
Expert offloading
A library with a thousand reference books but one small desk. A reader only ever needs ten books for a given question, so the librarian keeps the most-requested ones on the desk and fetches the others from the stacks when asked.
Token→Router picks 10
↳ hit: Expert cache→Layer output
↳ miss: SSD read→Expert cache→Layer output
The mechanism: in a mixture-of-experts model each layer routes a token to a few experts (10 of 512 here), so only those weights must be in fast memory; the rest wait on SSD and are read on a miss.
What it means today: a 180B model fits a 32 GB Mac at 13.9 tokens a second because the hot experts stay cached, and a miss costs a disk read.
Routing. Each layer sends the token to 10 of its 512 experts, so only those weights are needed.
Hit. Hot experts sit in a 12 GiB cache on the device and are used straight away.
Miss. A cold expert is read from the SSD, and decoding waits for it.
Prefetch. Reading one guessed expert per layer while the SSD is idle hid some misses: 13.9 tokens a second, against Strata's 14.8.
Step throughOnly the experts a token uses need to be in memory.
Anthropic priced 980 million shares at $83, above its range, raising $81.34 billion before trading opens today, the biggest IPO on record. OpenAI says its models found up to 14% gains on an AMD GPU design, though AMD's own check found single-digit gains on CPU blocks. Microsoft answered both labs with seven in-house models priced well below theirs, running on its own Maia 200 chip. Washington is weighing a rule that would make companies say publicly when they use Chinese models.
Anthropic sold 980 million Class A shares at $83, above its $70-78 range, for $81.34 billion; trading starts today as ANT and the deal closes on 20 November.
Why it matters: the largest IPO on record gives a frontier lab public-market money for compute.
#anthropic #ipo
ExplainClose
Background Anthropic sells 956.35 million of the 980 million shares, so about $79.4 billion goes to the company and $1.96 billion to selling holders; underwriters hold a 30-day option on 147 million more. Reuters, via Investing.com, reported the $83 price from a source before the announcement, and press put the valuation near $1.5 trillion. Epoch estimates from the S-1 that Anthropic spent $10 billion on compute in the third quarter, with customer inference about 26% of compute spending this year.
OpenAI says its models found up to 14% gains in power, performance and area on AMD GPU IP in under five months, and helped its own Jalapeño inference chip.
Why it matters: a lab whose models help design the chips they run on shortens its own hardware cycle.
#openai #chips
ExplainClose
Background OpenAI's post refused automated reads, so this rests on its X thread and the Hacker News discussion. PPA means power, performance and area, the three numbers chip designers trade off. Greg Brockman called it roughly a year of progress in under five months, with some results in a taped-out design. A top Hacker News comment quotes the post saying AMD verified only single-digit PPA gains on CPU blocks, and notes the graphs plot reward rather than physical units.
Treasury and the White House science office have discussed requiring companies such as Airbnb, which runs Qwen in customer service, to post that on their websites, Reuters reports.
Why it matters: it targets open-weight Chinese models' main draw, being cheap enough to deploy quietly.
#policy #open-weights
ExplainClose
Background Reuters' three sources say Treasury and the Office of Science and Technology Policy discussed the idea; it is unclear whether it would become a formal rule. The report frames it as "name and shame" in place of restrictions that could anger industry or Beijing. It follows renewed pressure after the Huang affair and earlier reported attempts to curb Chinese open-weight models, none of which took effect. Airbnb declined to comment; the White House, Treasury, Alibaba and the Chinese Embassy did not respond.
At Ignite Microsoft released MAI Code 2, MAI Cyber 2 Flash, MAI Image 2.7, MAI Realtime 1 and three more, and put its Maia 200 chip into production at 1.7 times the tokens per watt.
Why it matters: OpenAI's biggest backer now sells its own cheaper alternative on its own silicon.
#microsoft #chips
ExplainClose
Background The lineup: MAI Cyber 2 Flash (claimed GPT-6 Astra quality at under 2% of the cost per task on CyberGym-E2E), MAI Code 2 and Code 2 Flash, MAI Image 2.7 (claimed first on Artificial Analysis image editing), MAI Realtime 1 from $0.01 an audio minute, MAI Transcribe 2 inside Dragon Copilot, and Decision 1.1, claimed 79 times cheaper than GPT-6.1 Sol. Maia 200 is Microsoft's second-generation accelerator, claiming 1.7 times more tokens per watt. All figures are Microsoft's.
California's governor promoted a mechanism to halt releases by OpenAI and Anthropic.
#policy
Models & local
5 released today · 1 publishes a price · a dash is never “free”
Sort
Gemini 4 Neon is interesting for how it got cheap: it runs about twice as fast as Carbon, so a task that took 36 minutes takes 21 even with 15% more tokens, and costs $6.44 against Fable 5.2's $26.54. On the audio shelf, two open models pull the opposite ways: Ming-3.0-audio-flash activates 6.5B of 126B weights and still needs a multi-card box, while Rumble-2-Flash fits speech recognition into 0.5B by distilling from a larger model on its own transcripts.
Try if you run long agent jobs through the Gemini API or Cursor; skip if GPT-6.2 Astra's $4.00 per task already does your work.
ExplainClose
Google's mid-tier model scores 61.4 on Artificial Analysis' index at xhigh effort, $6.44 per task against Fable 5.2's $26.54, priced $3/$15 per million tokens with a 1M context. Arena ranks it second on its Agent Index at 1336.
The build not disclosed. Artificial Analysis measures about 110 output tokens a second, double Carbon's 57.
Worth learning effort scaling. One commenter notes Argon's and Carbon's effort levels barely changed scores, while Hydrogen and Neon improve normally as effort rises.
Skip if you need an independent score; wait for a board to run it.
ExplainClose
Microsoft says MAI Code 2 reaches 98% of GPT-6.1 Sol's coding quality at about 40% of the price, and 96% of Opus 5.5's at 5%. No per-token price or weights were published.
Worth learning relative claims. "98% of the quality" depends on which benchmark is the denominator; without the board named, it cannot be compared.
Skip if you want weights or an API; it is a subscriber app only.
ExplainClose
Genie 4 rolls out to eligible Google AI Ultra subscribers in Project Genie: type to change the weather or add characters, with native audio and a community gallery for remixing.
The build not disclosed; Google says an updated Genie 3 now supports longer sessions and panorama grounding.
Worth learning world models. They predict the next frame from your actions, so the world is generated as you move rather than stored.
Try if you build voice agents on a multi-card box; skip on one 32 GB card.
ExplainClose
inclusionAI's 126B-total, 6.5B-active audio model scores 99.8% on Artificial Analysis' Big Bench Audio, which inclusionAI says ranks first, ahead of Grok Voice 3.0 and GPT-Realtime-2.1.
The build a native audio-language mixture of experts that takes audio and text and answers in text or synthesised speech, with voice cloning.
Worth learning active parameters. Only 6.5B weights run per step, so it is fast, but all 126B must be loaded: about 63 GB at 4 bits, too big for a 32 GB card.
Try if you transcribe calls or meetings locally; about 1 GB in BF16 fits any card.
ExplainClose
Reson8 open-sourced a 0.5B Apache-2.0 ASR model that transcribes an hour of audio in about half a second on full batches, and says it matches NVIDIA's 30B Nemotron 3.5 Transcribe on a 302-hour call-centre set.
The build the Qwen3-ASR architecture, so it runs in Transformers and vLLM with no custom code.
Worth learning on-policy distillation. The student transcribes audio itself and the larger teacher scores each token, so it learns from its own mistakes.
Gemini 4 Neon enters Artificial Analysis' index third at 61.4, behind Fable 5.2's 64.6 and GPT-6.2 Astra's 62.1, and Arena's Agent Index second at 1336. See the boards ↓
From the papers
The day's papers are about knowing what you measured. Streaming experts from SSD runs a 180B model on a 32 GB Mac, and the author prints the rival engine's numbers beside his. A quantization study changes everything but the weights first and finds serving noise moves up to 0.92% of answers, so only bigger effects count. A survey of 40 model reports finds most novelty claims untested by ablation.
Tarek Ziadé ran Qwen3.8-Flash-Next in Transformers on a 32 GB M5 at 13.9 tokens a second decode and 228 prefill, against Strata's 14.8 and 220, with experts at 3 bits and a 12 GiB device cache.
Read if you want to run a model that does not fit your card or Mac.
ExplainClose
The idea keep only the experts each token uses in memory, read the rest from SSD, and prefetch one guessed expert per layer while the disk is idle.
Why it matters models bigger than your RAM become usable for slow, unattended jobs on a laptop.
Background Qwen3.8-Flash-Next has 48 layers of 512 experts with 10 active, plus a 51 GB n-gram embedding table that also had to be read from disk. The first version ran at 10 tokens a second; gains came from forcing early GPU commits on Apple's MPS backend (+10%), Metal kernels for Gated DeltaNet, Strata's GGUF weights and prefetching one guessed expert per layer. About 10 ms per token remains in host round trips that PyTorch cannot yet hide. vllm-metal could not fit the model in 32 GB.
On 2,400 decisions from two Cloudflare decision models, engine, restart and batch changes alone flipped up to 0.92% of answers; Q4_K_M and NVFP4 flipped 3.5-5.8%, and llama.cpp restarts were bit-identical.
Read if you compare quants of a model before choosing one.
ExplainClose
The idea measure the noise floor first, by changing everything except the weights, and count only the excess as the quantization effect.
Why it matters an 8-bit comparison run across two engines may be measuring the engine, not the quant.
Background The study used Cloudflare's Clef-flash (9B) and Clef (27B) on an NVIDIA GB10. vLLM restarts flipped up to 22 decisions at NVFP4, an engine change at BF16 6 to 16, a batch-size change 8 to 15, and an unasked Gated DeltaNet kernel 10 to 14. Q8_0 moved about 1% of decisions, FP8 1.6-2.1%. Two of five pre-registered predictions failed, including that FP8 would sit inside restart noise.
A survey of 40 randomly sampled technical reports found 4 state more than one training run, 8 rerun their baselines under one setup, and 1 discloses data mix, token count and compute together.
Read if you choose models by what their reports say is new.
ExplainClose
The idea a with-and-without comparison is the only test that a new component caused the gain; most reports skip it.
Why it matters an architecture "innovation" in a model card is usually untested, so treat it as a claim.
Background The author also read the transformers library: 39 of 48 architectures added in 2025 take at least two of three core blocks from another model, most often Llama, though the library's code style explains part of that. None of five suspected renamings hid its origin. The paper proposes seven reporting rules and applies them to two reports. It does not judge model quality and notes an untested claim may still be true.
Cerebras researchers add a working memory of rejected drafts and better use of the target model's features to a parallel drafter, for 1.3x generation speed with no larger drafter or quality loss.
Read if you tune vLLM or SGLang drafters.
ExplainClose
The idea the drafter guesses several tokens in one pass; remembering which guesses the big model rejected stops it repeating them.
Why it matters speculative decoding is where local decode speed is still being won without new hardware.
Background Speculative-diffusion decoding has a small drafter propose several tokens in one pass for the target model to verify. DNeo's Mixture-of-Features Attention avoids lossy projections of the target's hidden states, picks target layers non-uniformly and keeps a memory of rejected proposals. The 1.3x figure is against DFlash-2, the authors' own measurement; vLLM shipped a related DSpark drafter for Kimi K3.1 Pro this week.
Why try it A transcriber this small could run beside a local LLM on the same card, or on a laptop, for meetings and voice notes
The experiment Take ten recordings you already have transcripts for (two noisy calls, two accented speakers, two non-English), run Rumble-2-Flash and your current ASR, and compare
What to expect Estimate: near-instant on a 32 GB card at about 1 GB of weights; accuracy on noisy calls is the maker's claim, not measured here
How to judge it Count word errors on names, numbers and jargon per recording; keep it if it matches your current tool on at least eight of ten
Harnesses & skills
Codex keeps your real environment but lets the operating system enforce limits: it can edit your source, not .git, and has no network until you approve, so a command cannot both change your repo and send it out. Two papers say the same thing about agents that tune themselves: a harness optimizer did better when it kept a log of why each edit was made, and distilling an agent on household tasks wrecked its retail tool use.
OpenAI's post explains that Codex sandboxes commands with the operating system rather than a container: by default it edits source freely, cannot write .git or .codex, and has no network until you or auto-review approve.
Read if you run Codex on your own machine.
ExplainClose
Why it works edit and network are separate grants, so a command that changes your repo cannot also send it anywhere.
Check whether your permission profile allows the package registries your build downloads from, so builds don't stall on prompts.
In your setup broad reads stay on, so keep tokens out of files your user account can read.
Background OpenAI's page refused automated reads; the details come from the OpenAIDevs thread. Codex uses OS-level sandboxing rather than moving work into a container, so an iOS build on a Mac keeps Xcode and simulators. The default profile allows broad filesystem reads, edits inside the workspace, blocks writes to the root .git and .codex folders, and turns network off; a request goes to the user or auto-review, and a registry domain can be allowed in a profile.
Google researchers record each harness edit's rationale, predicted and observed outcome, grouped by recurring problem; continuing optimisation with that memory beat harness-only continuation by 2.36 points across ten coding runs (p = 0.003).
Read if you tune agent prompts and tools over months.
ExplainClose
Why it works a tuned harness shows what changed but not why; the log stops the optimizer undoing fixes when the model or benchmark changes.
In your setup keep a changelog of CLAUDE.md or AGENTS.md edits with the problem each solved.
Background The setting is continual recursive self-improvement: carrying an optimised harness across new benchmarks or new policy models. The memory belongs to the optimizer, not the task-solving agent, and groups edits by recurring problem with rationale, prediction and outcome. Across four domains it beat both harness-only and root-cause-only continuation; the coding gain of 2.36 points is an average over ten paired runs.
On-policy distillation from ALFWorld household tasks made a model call tools that violated user-information rules on τ²-bench; keeping only the top 95% of positions by teacher preference restored it to 29.9%.
Read if you fine-tune small models for your harness.
ExplainClose
Check after fine-tuning an agent model on one task family, rerun an unrelated tool-use eval before deploying.
Background General-reasoning supervision cut a model's maths tool attempts from 70.4% to 14.4% while lifting accuracy from 16.7% to 38.0%, so distillation also changes when an agent reaches for tools. ALFWorld supervision led to frequent tool calls that ignored what the user had provided on τ²-bench. Selective distillation using teacher preference changes recovered part of the loss at some cost to the source task.
A study of 14 open models finds the attention heads that flip a moral answer are a general judgment circuit: they matter just as much for etiquette or evidence, and SAE features mostly track the word "morally". A short LessWrong demonstration warns that nearly orthogonal directions can look circular in PCA, and Epoch measures GPT-6.2 Astra doing 12.3 serial steps inside one token.
Across Llama, Gemma and Qwen models from 1B to 14B, the attention heads that flip a moral answer carry the same share of the effect for etiquette, prudence or evidence judgments (ratio 1.00); located SAE features mostly track the word "morally".
Read if you work on steering values or moral features.
ExplainClose
How it works 227 minimal phrase pairs differ only in a moral standard, another norm or a description; ablating heads shows which ones each pair needs.
Evidence causal: removing the heads erases 37-39% of the acceptable-versus-unacceptable gap on 400 ETHICS scenarios, against 1-3% for random heads.
Background The 227 minimal pairs were validated by five annotators and vary a moral standard, another norm (prudence, etiquette, aesthetics, evidence) or a descriptive quality, with and without the word "morally". The models, Llama, Gemma and Qwen from 1B to 14B, needed the same heads even when nothing asked for a judgment. The pooled moral-to-other ratio was 1.00 (97.5% interval 0.92-1.07) with the cue word and 0.90 without.
Linda Linsefors shows that vectors almost at right angles, with only a small circular correlation, project onto the first two principal components as a ring.
Read if you have found a "circular feature" in a PCA plot.
ExplainClose
How it works PCA picks the two directions of largest variance, and a weak shared pattern can dominate both even when the vectors are nearly independent.
Evidence a constructed demonstration with an interactive widget, not a study of a real model.
Background The post is short and comes with an interactive widget for trying the effect; Lucius Bushnaq contributed. The warning matters because circular features, such as days of the week arranged in a ring, have been reported from PCA projections of activations. A ring in the top two components is consistent with a real circular feature but also with nearly independent directions sharing a small correlation, so it needs a causal check.
Without chain of thought, GPT-6.2 Astra completes 12.3 complexity-normalised serial steps per output token at 25% above chance, against 10.5 for GPT-6 Astra and 4.2 for Fable 5.1.
Read if you track how much reasoning happens outside visible chains of thought.
ExplainClose
How it works tasks need a known number of sequential steps; the measure is how many a model completes inside one forward pass.
Evidence Epoch's own pre-launch testing; one benchmark, independent of OpenAI.
Background Epoch counts serial steps at 25% above chance with each step normalised for complexity. Before GPT-6 Astra the best was Fable 5.1 at 4.2 steps; GPT-6.1 Sol reached 8.6. More reasoning inside a single forward pass means less of it shows in a written chain of thought, which is why monitorability researchers track it. The same testing put GPT-6.2 Astra at 174 on Epoch's capability index, level with Fable 5.2.
OpenAI published indicators of how much its agents speed up its own research: 46% of two-to-four-hour tasks finished unaided, double March, with heavy users at about $23,000 of tokens a day. It is useful disclosure and unverified measurement at once. A LessWrong proposal offers a lever to act on such numbers: audited compute disclosures and a cap on capabilities R&D compute.
OpenAI's research-acceleration report says researchers' AI use keeps rising exponentially; quoted figures put the 90th-percentile researcher at about $23,000 of tokens a day and time horizons doubling every 3.8 months.
Read if you follow pacing debates and want the numbers labs are now tracking.
ExplainClose
What it shows a lab publishing recursive self-improvement indicators on its own work, including a watch for sudden deep-learning breakthroughs.
What it doesn't independent measurement; the page refused automated reads, so the figures here come from OpenAI's post and researchers quoting the report.
Background The page refused automated reads. OpenAI's thread says researchers are also spending more time on safety; quoted figures put the median researcher at about $2,400 of agent use a day and agent time horizons doubling every 3.8 months. A passage quoted on X says OpenAI is monitoring for sudden breakthroughs in deep learning like recent ones in mathematics. Yafah Edelman praised the disclosure; Daniel Kokotajlo announced a rally against recursive self-improvement.
Thomas Larsen proposes audited compute-use disclosures plus a cap on capabilities R&D compute, and estimates a 15% cap from January 2027 would delay an intelligence explosion by a year.
Read if you want a pacing plan with a mechanism, not a slogan.
ExplainClose
What it shows a concrete, checkable lever: compute is countable, and an auditor can verify where it went.
What it doesn't the one-year figure is the authors' rough estimate, and they call it insufficient on its own.
Background The proposal, mirrored at pacing-ai.com, has two parts: Verified Compute Allocation Disclosures audited by a third party, and moving compute from capabilities R&D to serving customers and safety research. The authors argue nearly every pacing plan needs such disclosures, since any input limit can be dodged by hiding compute. They present the one-year delay as time to set up a more durable regime. Daniel Kokotajlo called it his favourite proposal at the moment.
Proposes planting tempting, detectable hacks during RL.
#safety
Humans & mind
Two studies test confident stories against data. Asking shopping agents to think harder raised their confidence but not the quality of their choices, and the models tended to make the same mistakes. A scan of 2.5 million papers finds science's long trends barely bent after ChatGPT. A LessWrong essay asks why AIs that out-persuade debaters in studies leave so little trace in the world, and KPMG reports audit agents asking questions its auditors missed.
Across ten frontier models on three product-choice benchmarks, raising reasoning effort did not improve purchase quality significantly but raised stated confidence significantly; most models were poorly calibrated, and they tended to make the same wrong pick.
Read if you let agents choose on your behalf.
ExplainClose
The idea calibration, whether "80% sure" means right 80% of the time; here effort bought confidence, not accuracy.
Evidence benchmark study built from WebShop, Amazon's SQID and Wayfair's WANDS.
Lineage extends work on LLM verbal confidence and calibration, such as Kadavath et al. (2022) on models knowing what they know.
Open if errors are shared across models, does asking a second model for a check add anything?
Background The ten frontier models were tested on choices built from WebShop, Amazon's SQID and Wayfair's WANDS. More effort raised stated confidence significantly while quality did not change significantly; calibration was poor at every effort level. On tasks where several models erred, many chose the same wrong product, which weakens using a second model as a check. The authors write from a consumer-protection angle.
Across five disciplines from 2015 to 2025, most pre-2023 trends continued with few detectable breaks beyond word frequencies; Asian computer-science coauthor teams grew faster, and apparent biomedical topic loss was format standardisation.
Read if you hear "AI is transforming science" and want a baseline.
ExplainClose
The idea a structural break, a change in a trend's slope at a known date, is the test for whether a new tool changed practice.
Evidence observational text analysis of full papers, lexical, structural, epistemic and social measures.
Open papers lag practice by a year or more; would lab notebooks or code show the change sooner?
Background The authors trace lexical, structural, epistemological and social measures across 2.5 million full-text papers in five disciplines from 2015 to 2025. Word-frequency shifts appeared, but most trends continued. Faster growth of computer-science coauthor teams in Asia was one real break; an apparent fall in biomedical topic diversity reflected standardised article formats. The paper positions itself as a baseline for monitoring science as adoption deepens.
Karthik Tadepalli notes AIs out-persuade elite debaters in studies, about 5 points more across nearly 20,000 UK AISI conversations, yet real-world AI persuasion is hard to find, and asks why the lab result fails to transfer.
Read if you weigh lab evals against real-world effects.
ExplainClose
The idea checkable versus fuzzy tasks; persuasion is a rare fuzzy skill where lab scores can be compared with the world.
Evidence a careful argument over published studies; 43 karma and 20 comments.
Open if persuasion does not generalise from studies, should we expect AI research skill to generalise either?
Background The essay starts from the UK AI Security Institute's June study, nearly 20,000 conversations in which models moved views about 5 points more than champion debaters and canvassers and raised more charity money. It argues the effect does not show up in elections or markets, and treats persuasion as a test of whether progress on checkable tasks transfers to fuzzy ones. Twenty comments debate measurement lags and saturation of attention.
In KPMG UK's Project Exponential, over 100 agents worked a FTSE 250 audit alongside the human team; head of audit Cath Burnet said they at times went "considerably deeper" into issues, the FT reports.
Read if you think about where judgment sits in professional work.
ExplainClose
The idea division of epistemic labour: agents collect and question, humans sign.
Evidence a firm's own account of one engagement, reported second-hand; no error rates published.
Open who answers for a question nobody asked when the agents miss it?
Background The Financial Times first reported Project Exponential. The agents collected and analysed data, drafted conclusions and suggested next steps across the audit, working alongside one another and a conventional team on an unnamed FTSE 250 company. KPMG UK's head of audit, Cath Burnet, made the "considerably deeper" claim. No error rate, cost or comparison method was published, and the human team signed the audit.
An essay by OpenAI's head of strategic futures; the page was unreadable here.
#humans
The feed
Local builders spent the evening on practical worries: an Nvidia driver that writes to SSDs nonstop on Windows, and a Qwen researcher's wording that leaves a small Qwen 4 open after weeks of teasers. r/MachineLearning dug into a 455-citation paper whose code may not test its method. On X, Theo argued Opus 5.5 is still the value pick despite Artificial Analysis' chart, and OpenCode said it now serves 44% of its tokens from its own GPUs.
Users report NVDisplay.Container constantly writing logs, wearing drives on inference rigs; rolling back is the common fix.
#feed #local
ExplainClose
The thread links a fix guide for the NVDisplay.Container service; replies say it is Windows-only and tied to parts of the Nvidia app.
From the replies “It seems Windows only because it has a module exclusive to Windows (NVDisplay.Container.exe)” — r/LocalLLaMA commenter
Background The post links a fix guide for NVDisplay.Container writing logs continuously. Replies say the problem is Windows-only and tied to parts of the Nvidia app; one user reports 621.14 is also affected and rolled back to .01, others recommend NVCleanstall to strip telemetry components. One commenter checked and saw no writes, so it may depend on configuration.
A reader says the chunked-prompt-cache paper's code reproduced full attention, so its quality results don't test chunking.
#feed #inference
ExplainClose
The thread the poster argues the cached KV states match the baseline exactly when they should differ.
From the replies “the speedup is from the KV states already being in cache (having been precomputed) vs generating them from scratch (baseline).” — the poster
Background The paper is arXiv 2311.04934, on caching KV states for reusable prompt chunks. The poster says the implementation reproduces full causal attention, so cached states are identical to the baseline when per-chunk caching should change them; the speed claim stands, the quality claim is untested. A reply recalls a famous author conceding a 1,000-citation result was unfixable. The authors have not responded in the thread.
Theo Browne argues Artificial Analysis' Pareto chart misses behaviour; scaling01 says Fable 5.2 burns limits and returns to Opus 5.5.
#feed #models
ExplainClose
The thread Opus 5.5 dropped off AA's best-value line, and Theo asks for behavioural benchmarks to capture long-running work.
Background Artificial Analysis now prices Opus 5.5 at about $10 per index task against Gemini 4 Neon's $6.44 and GPT-6.2 Astra's $4.00, which pushed it off the value line. Theo Browne argues the index misses how models behave on long sessions. The same day scaling01 wrote that Fable 5.2 "burns through the limits way too quickly" and went back to Opus 5.5.
A Qwen researcher's reply leaves a 35B Qwen 4 open; the thread is tired of a month of teasers.
#feed #qwen
ExplainClose
The thread readers parse the wording and note new Qwen models will carry n-gram tables, so sizes grow about 25%.
From the replies “They are all going to have engrams so will be 25% or so larger (but you can put that in ram).” — r/LocalLLaMA commenter
Background The post points to a Qwen researcher's X reply. The top comments note 27B is the only small size officially mentioned and complain about a month of teasers. The original poster spells out Qwen3.8-Flash-Next's real shape as 125B with 6B active plus a 51B n-gram table, and a commenter points to llama.cpp support landing for MiniCPM5-15B-A2.5B as a smaller option.
A 48 kHz speech-isolation model from Inworld, open-licensed, drew praise as a rare open audio-cleanup release.
#feed #speech
ExplainClose
The thread the post lists 48 kHz support and the Apache-2.0 licence, with a demo video.
Background The post credits a demo video from Hugging Face's Victor Mustar and lists 48 kHz support and an Apache-2.0 licence. Inworld is known for its text-to-speech models; this one separates a voice from background sound. No benchmark numbers were given in the post, so quality rests on the demo.
OpenCode says it served 16 trillion tokens on its own hardware in a day, with ten times more coming, while selling GLM 5.3 credits at a 50x discount.
#feed #harnesses
ExplainClose
The thread $500 of GLM 5.3 for $10 until the end of the week, and Hy4 flash free for ten more days.
Background OpenCode's founders say 16 trillion tokens were served on their own hardware in a day, 44% of the total, with ten times the hardware due in months. The same account ran a GLM 5.3 promotion of $500 of usage for $10 and keeps Tencent's Hy4 flash free for ten more days. Owning inference is how a harness vendor can sell model access below list price.
Readers link the disclosure plan to a possible open-model ban.
#open-weights
Voices
Listing day brought an argument about whether Anthropic's worldview deserves the public's trust, and OpenAI's acceleration report brought another about whether labs should be the ones measuring their own speed.
“Anthropic doesn't see itself as a "normal company." Dario Amodei believes both that 1) superintelligent AI could destroy humanity, and 2) our only chance at survival is to have his trillion-dollar tech company build it first.”
Jasmine Sun introducing her New York Times Opinion essay on the eve of the IPO
“It comes across so clearly that anthropic does NOT understand the “trust us, we’re the good guys” strategy is bound to fail at some point.”
Can the public trust Anthropic's theory of change?
On listing day, a New York Times essay argues Anthropic's case for itself rests on a worldview the public has not examined. Researchers split on whether that is a fair critique.
“Anthropic doesn't see itself as a "normal company." Dario Amodei believes both that 1) superintelligent AI could destroy humanity, and 2) our only chance at survival is to have his trillion-dollar tech company build it first.”
Jasmine Sun introducing her New York Times Opinion essay on the eve of the IPO
“It comes across so clearly that anthropic does NOT understand the “trust us, we’re the good guys” strategy is bound to fail at some point.”
“It’s hard to put into words just how far ahead Anthropic is right now”
Theo Browne a developer's view of the same company the same day
Should labs measure their own acceleration?
OpenAI published its own indicators of how much its agents speed up its research. Forecasters welcomed the data; critics asked who checks it, and one called for a halt.
“We find researchers' AI use continues to rise exponentially, and agents are completing longer tasks, but human involvement remains central in research.”
OpenAI the lab introducing its research-acceleration report
“At a glance this report is amazing and contains many metrics on my RSI metrics wishlist. I really love how much info OpenAI is sharing here.”
“Every graph is in terms of a reward or a loss. If you have an actual amazing improvement you put it on the y axis and show how much better you can drive it. … Like "AMD also verified single-digit percentage gains in PPA" That's awesome!”
“This is a very verifiable task with well defined metrics and verifiable results. Chip designers are going to have just a rough time of it as software engineers.”
“Effectively these companies are now competing with each and every one of their customers whilst having the inside scoop on what those customers are up to.”
Artificial Analysis leaderboard, read 2026-11-19 01:34 UTC. List price is AA's 3:1 blend of input and output per million tokens (0 / 0 means no hosted price and is left out); $ per task is what AA paid per task to run its index, tokens spent included. est. marks a score AA estimated rather than measured.
From the whole ollama.com/library, read this morning, newest version of each line. Fit is the largest size that fits at ~0.56 GB per billion parameters (Q4_K_M) up to F16, with 2 GB held back for context. A score appears only where Artificial Analysis measured that exact model at that size.
The frontier
A model is on the frontier when no other scores higher on AA's index for the same money or speed.
Against
By list price, cheapest is left and smartest is up.
On the frontier · list priceper 1M
64.6
Claude Fable 5.2 (Max)
Anthropic
$16
61.4
Gemini 4 Neon (Xhigh)
Google
$6.00
60.0
Gemini 4 Carbon (High)
Google
$4.00
53.9
Gemini 4 Hydrogen (Xhigh)
Google
$3.00
51.3
GPT-6.1 Terra (Max)
OpenAI
$2.00
46.5
Kimi K3.1 Proopenopen frontier
Kimi
$4.00
36.5
Claude Haiku 5.5 (Max)
Anthropic
$0.20
32.6
DeepSeek V4.1 Flash 1017 (Max)openopen frontier
DeepSeek
$0.53
30.6
Inkling 2 Smallopenopen frontier
Thinking Machines
$0.47
29.6
Ling 3.1 Flash 1019openopen frontier
InclusionAI
$0.45
29.1
MiniMax-M3.1-Flashopenopen frontier
MiniMax
$0.26
28.6
Qwen3.8-Flash-Nextopenopen frontier
Alibaba
$0.23
26.7
MiMo-V2.6-Flashopen
Xiaomi
$0.17
24.0
Agnes 2.5 Pro Theta
Sapiens AI
$0.15
6.0
LFM3-1.7Bopen
Liquid AI
$0.11
5.5
Nemotron 3.5 Lightningopen
NVIDIA
$0.095
4.8
Gemma 4 E4B (Reasoning)open
Google
$0.040
Lines: every model (solid) and open weights only (dashed). $ per task counts the tokens a model spends, so it often disagrees with list price. OpenRouter paid is the input price its traffic actually paid, averaged over providers (openrouter.ai/rankings); input only.