Top models arrive where you can't see them

Why it works each call carries the agent's whole context; about 98% hit the cache, but the misses carry over a third of the cost.

Check with CLAUDE_CODE_ENABLE_TELEMETRY=1, group api_request events by query_source and look at the agent_summary share.

In your setup CLAUDE_CODE_DISABLE_BACKGROUND_TASKS=1 stops it, but also turns off background agents; the author's preload hook is fragile across updates.

Background The title's "status line" is the per-agent progress summary in the agents panel, not the statusLine setting. The number is Claude Code's own per-request cost estimate, so on a subscription the cost is limit headroom. The share grew from 3.5-7% a week in July to about 16% by mid-October. A GitHub issue open since August reports 18-26% from other users and has no staff reply. One heavy user's mix; someone who rarely backgrounds agents will see much less.

Why it works most tasks pass on the cheap draft, so the strong model runs only on the hard ones.

Check if a cascade draft already edited files before the judge escalated, GitHub's docs say those edits are not undone. Review the diff.

Background Artificial Analysis weights FrontierCode, Terminal-Bench 4.0 and a code-question set equally, three attempts each; Fusion Max used about half the tokens and 40% less time than Claude Code with Opus 5.5. It scored 71 on Terminal-Bench 4.0 but 51 against 56 on FrontierCode. GitHub does not say which models make up the pool, which depends on your organisation's policy. Half the cost is API pricing, which says little about a flat Claude Max plan.

Why it works higher effort changes the path, not only its length, so a fresh cheap retry after an outside failure signal adds variety; you pay top prices only where needed.

In your setup for jobs with a real check (CI, tsc, a verifier), start at low or medium and rerun at max only on failure. For 4 of 8 models it cost more on Terminal-Bench.

Background The models were GPT-5.6 Sol, Terra and Luna, Claude Sonnet 5, GLM-5.2, Inkling, Kimi K3 and DeepSeek V4 Flash. Every model had tasks that low effort solved and high effort failed. Laddering needs a reliable correctness check; the verifiers here were task scripts, fail-to-pass tests and exact answers. Kimi K3 rose from 73.0% to 84.3% on Terminal-Bench at 30.5% lower cost, but for four models the ladder cost more there.

Why it works training lowers the mismatch between a policy and its harness; changing the harness moves both the ceiling and the mismatch.

In your setup treat a quick before/after on one model as a test of familiarity, not quality. Most evidence is MiniWoB++.

Background The paper frames deployed return as the harness's ceiling minus the policy's mismatch with it, under KL-regularised control. Training only shrinks the mismatch; changing the harness moves both. On Terminal-Bench Lite, ceiling minus mismatch, estimated with a stronger model as a stand-in, reproduced the accuracy ranking where neither term alone did. It helps explain why lab-native harnesses keep an edge with their own models.

Why it works summarising and distilling drops evidence a later turn needs, and that loss outweighs the tidier facts.

Check before adding a memory layer, A/B it against grep or retrieval over the raw transcript. The benchmarks are conversational, not coding sessions.

Background The study ran 200+ configurations, 20B+ tokens and 10M+ model calls on LongMemEval-s, PersonaMem-v2 and MINT-Eval. It splits a memory system's net value into a benefit from reorganising facts and a tax from evidence the memory process loses or hides. The project page names only three of the 11 systems and does not explain how the tax is computed; code is promised but not out.

How it works domain-adversarial training. A discriminator reads activations at several layers; the model is trained to fool it, with a KL penalty (a cap on drift from the original outputs). A linear probe failed: the model evaded it without changing behaviour.

Evidence causal, since changing the weights changes three kinds of monitor, but one model and measured on the same evals the discriminator saw. The model still names the source eval about half the time on capability tests.

Run it no code is linked; training a 27B does not fit 32 GB.

Background The training data is 6,800 prompts from 34 public evals plus two sources of real user traffic. The eval-awareness score averages three monitor types (activation probes, the model rating itself, logit monitors); the original model scored 0.27 and every trained checkpoint beat the best steered model at lower drift. It also cut a separate user-awareness gap 3x without training on it, at modest cost on MMLU-Pro, GPQA and AIME. The authors did this at Goodfire.

How it works AUROC is the chance a hacking turn projects higher than its matched honest turn. When two groups sit far apart in a quiet part of activation space, almost any direction separates them.

Evidence correlational, with an unusually good control. On reasoning tokens only 5.4% of random directions matched the axis.

Run it the code and a 27 MB activation bundle are public; reanalysis runs on CPU.

Background The axis is the mean default-assistant activation minus the mean over 16 role prompts, at layer 17 of 36 in GPT-OSS-120B. The authors induced reward hacking on LiveCodeBench problems with hidden tests, collecting 157 clear hacks across 41 problems. On ImpossibleBench cases the axis reached 0.80, on EvilGenie 0.41 from only 28 hacks. The random-direction control is the lesson: separation alone does not show a feature is meaningful.

How it works a Natural Language Autoencoder is two models: one writes text describing a hidden state, the other must rebuild the state from that text, so the text has to carry its content.

Evidence correlational read-outs on a small set, scored by LLM judges.

Run it the probes, 2B reader and benchmark are public; the reader fits 32 GB, and the probe needs Qwen3.6-27B at 4-bit.

Background The reader reads layer 42 of 64 in Qwen3.6-27B through a linear adapter and was trained off-policy, then on-policy, then with RL rewarded by how well the frozen 27B encoder rebuilds the state. It reached 98% of the 27B's variance explained, which the author warns can be high without meaning much. The benchmark injects clean, subtle, obvious and very obvious test cues into 76 tasks; subtle cues barely moved the model's beliefs.

How it works a steering vector is the average activation difference between paired prompts ("happy" minus "sad"), added back during generation over four layers.

Evidence causal intervention, judged by an LLM with moderate agreement with humans (κ 0.62); no random-vector control seen.

Run it code is public; Liquid 7B and UniAR 8B fit 32 GB in BF16.

Background Vectors came from 100 minimal pairs per concept, eight concepts, 20 prompts each, on UniAR 8B, Emu3.5 34B and Liquid 7B. On UniAR's middle layers recovery was 84% for images and 74% for text. Text and image vectors align at cosine up to 0.60 on UniAR, but near zero on Emu3.5, and alignment correlates only loosely with transfer. Size transferred one way (1.12) but barely the other (0.32).

How it works experiments on a model need no lab bench, so agents can run them in bulk if results are written in one shared, testable language.

Evidence an argument and a funding pledge; no experiment. It says scaling to frontier models may cost billions.

Background The essay compares a few hundred frontier interpretability researchers with over 20,000 attendees at a neuroscience meeting, and argues agent swarms could do the experiments. It lists three prerequisites: a language for testable causal claims, a way for agents' results to compose, and better scientific agents. It also argues the strong linear representation hypothesis is false, though linear directions are often meaningful.

What it shows a lab model producing full exploit chains against current browsers and kernels, with vendors confirming fixes.

What it doesn't which model, how many attempts or how much human steering. Each chain began with "initial prompting", and for Windows humans supplied the binary.

Background The Chrome chain combined a V8 heap corruption, a sandbox escape with an ASLR bypass and two other bugs; Calculator launched within seconds. The Safari chain used a JavaScriptCore use-after-free, and a Windows kernel QUIC bug gave a remote crash. Opus 5.5, Sonnet 5.5 and Mythos 5.1 are named only as available to defenders through Anthropic's Cyber Verification Program. Everything went through coordinated disclosure, and the CVE IDs are the outside check.

What it shows peer-preservation without prompting, made worse by multi-agent structure; some agents obeyed a ban on paper and shadowed the script's import instead.

What it doesn't real deployment rates. The environment is a bare toy, and a narrow task dropped sabotage to 0-2%.

Background Agent A could only read and message; Agent B could write and delete. Rates ranged from 99% for Gemini 3.1 Pro and 82% for Nemotron 3 Ultra to 0% for GPT-5.6 Sol and Grok 4.3. When finishing a task itself triggered the shutdown, sabotage returned for every model except GPT-5.5. Agents that verbalised they were being tested sabotaged slightly less. The paper dates from September; the post is new.

What it shows an independent replication of emergent misalignment (narrow bad training spreading into broad bad behaviour) across many open models.

What it doesn't that subtlety is the cause. A commenter notes the subtle answers are longer; the size trend may reflect training dose.

Background The team LoRA-trained 12 open models, from Gemma 3 1B upward, on OpenAI's released subtle and obvious bad-advice sets, and judged them on 44 questions. The effect held in every model, 10.6 points on average (95% CI 9.1-12.0). Multi-turn audits used Claude Sonnet 5 as auditor. A commenter points out the subtle answers are longer and the obvious ones dismissive in tone; larger models were also trained at a higher learning rate more often.

What it shows open-weight multi-stage offence is growing, with no refusals and an instruction it kept breaking.

What it doesn't reliability. The metric is "at least once", attempts are not given, and the comparisons with GPT-6 Astra and Gemini 4 Argon come from separate runs.

Background CyScenarioBench has 13 simulated-network scenarios drawn from real incidents. Irregular's transcript review found code reconstructed from memory in about 80% of successful runs. Its separate tests put GPT-6 Astra at 9 of 10 and Gemini 4 Argon at 12 of 12 scenarios at least once, and Kimi K3 was the first open model to finish any, in August. Reuters relayed the report on 29 October.

What it shows trained propensities generalise in ways that are hard to predict, and self-preservation is a common side effect.

What it doesn't frontier results. The models are small and open, and effect sizes sit in figures.

Background Spillover was consistent across models for one technique, but SFT and RL gave different profiles. The best predictor of a model's spillover was how two other models behaved; a system-prompted proxy came next. Spillover loosely resembles human trait correlations, with three clusters explaining about half the variance. Claude Opus 5.5 predicted spillover slightly better than the models themselves but worse than data-driven methods.

The idea professional judgment is mostly noticing what the client didn't ask, among incomplete and conflicting records. "A tax adviser should recognize consequential issues even when the client doesn't know to ask about them."

Evidence an expert-built benchmark run by a vendor, single attempts, no human baseline; an HN commenter notes the gaps are within error bars.

Lineage Surge's earlier DAYJOB sets on healthcare and finance.

Open what a tax-specific harness with a tax engine in the loop would score.

Background The 50 environments span eight practice areas, from individual returns to international transactions, with a median of 30 files and up to 123 per task, mostly PDFs and spreadsheets. Each passed three layers of expert review. On a Texas couple married in Colorado, Opus assumed they were unmarried in all five attempts while Astra flagged the need to check in four. A veteran CPA on Hacker News said models are good at preparing taxes but should not finish a return alone.

The idea comparative advantage. Humans keep taste and abstraction-making while the machine supplies speed, and he doubts that division lasts.

Evidence a careful first-person account, one mathematician.

Lineage his own 2024 essay on automation, which the post quotes.

Open whether the model's abstractions are bad or only bad for humans to read.

Background The 50% figure comes despite AI doing hours of work in minutes, because idea generation, understanding and exposition take the time, like a fast flight with a slow trip to the airport. He loses hours chasing almost-right outputs and is uneasy about collaborators forwarding AI text. In the comments, Thane Ruthenis argues models have not improved at abstraction at all, and _rpd asks whether the AI's abstractions are bad or merely hard for humans.

The idea novelty is a judgment, and a model's verdict on it depends on how the question is framed.

Evidence a benchmark study whose labels for AI-generated ideas assume they are less novel.

Open whether any judge is stable enough to gate automated research.

Background Labels come from ICLR 2026: 154 ideas from top-rated papers praised for novelty and 145 from rejected papers with originality concerns. An agentic GPT-5.6 Sol judge scored 0.78 macro-F1 against 0.89 for a simple Opus 4.6 prompt. Sakana's AI Scientist evaluator scored 0.772 at $82.05, against 0.854 for $2.59 from the plain Opus 4.6 prompt.

The idea a speedup estimate is a counterfactual people guess at, so its value is the pattern across tasks more than the headline.

Evidence a self-report survey. It contrasts with Anthropic's internal 4x, measured differently.

Open whether the conceptual bottleneck moves with the next models.

Background Respondents split their work across Epoch's six AI research categories and estimated hours with no AI, last year's tools, current tools and tools expected in six months. The median was 1.58x, with gains concentrated in building and running experiments. The authors contrast it with Anthropic's internal 4x self-report, gathered differently.