The Sequence Knowledge - Issue 937: RSI in Post-Training: The Loop That Already Shipped
Inside the RSI post-training pipeline
thesequence.substack.com·platform·103 items·last fetched
Inside the RSI post-training pipeline
Google tackles real-time interaction, OpenAI targets legal workflows, Figure tests unfamiliar homes, and investors double down on compute.
How Chinese and American labs pursue the next generation of intelligence
How architecture and system design turn model capability into useful work
Three frontier labs have now said out loud that their models help build their models. The interesting part is not the percentage. It is which half of the job got automated, and why.
Faster models, nine billion genetic predictions, personal agents, and a proof that could make mathematical history.
Generalist models are expanding what robots can do. The real breakthrough will be how easily we can teach them something new.
From Berkeley’s Chatbot Arena to Agent Arena: preference rankings, cost-per-task frontiers, and the hard problems in measuring real-world AI utility.
Three releases that deserve your attention.
Distillation can make models smaller, faster, and cheaper. The difficult part is deciding what the student cannot afford to forget.
Every lab decided to release models last week.
Capital, compute, process, distribution, and the search for durable Power
Three releases, three different bets. Let’s dive in.
From DistilBERT and Gemini Flash to Gemma, Llama, Qwen, DeepSeek, Phi, Ministral, and PrismML’s Bonsai 27B.
NVIDIA, Anthropic, NScale, and a16z show how the AI race is moving from models to infrastructure.
Robotics Gets Its PyTorch Stack.
Jensen Huang’s five-layer cake explains how intelligence is manufactured. The missing layer explains how quickly - and by whom - it can scale.
Distilling three major AI releases to keep you current.
The Sequence — Distillation Series
OpenRouter, Ramp, Etched, and DeepSeek reveal the emerging economic stack beneath modern intelligence.
Why the next frontier in intelligence will be constrained not only by algorithms and chips, but by megawatts, transmission lines, and the physics of heat.
A mini deep dive into some of the most important AI releases of last week.
Why test-time compute distillation could turn inference-time reasoning into permanent model capability.
New models, major acquisitions, and a new generation of AI companies are reshaping where the real competitive advantage lives.
A field guide to prefill, decode, KV caches, and the systems that turn model weights into a responsive product.
Deep diving into three major AI releases.
NVIDIA’s new Nemotron 3.5 Lightning, other Nemotron models, architectures and more.
Compressing Time, Space, and Alignment
Jeff Dean leaves, Demis Hassabis moves upstream, and Muse Code turns software development into an orchestration problem.
Token maxing was the adoption phase. Intelligence resource planning is what comes next.
Google put a walking humanoid inside a single policy, published the reasoning half as an API, and kept the motor half behind a partner gate. The numbers explain why.
Weird but more common than you think. The type of distillation you were not thinking about.
NVIDIA's letter, Gemini Robotics, Kimi release and more.
Frontier Labs, Startups, and the Race for Physical Intelligence
Why AI’s next breakthroughs may come from the learning loop around the Transformer—not from replacing it.
Poolside’s 118B coding model beats systems ten times its size. The interesting part is not the architecture.
Once models can generate their own curricula, data stops being a static resource and becomes a transmission medium for intelligence.
Opus 5 pushed the intelligence frontier forward, Atoms brought AI deeper into the physical world, and the rest of the week revealed the infrastructure, capital, and security challenges forming around
A thesis about the biggest AI rivarly nobody is talking about.
Thinking Machine's new model revitalizes America's open source AI approach.
From the release of DeepSeek R1, distillation in reasoning models have become one of the most common techniques in frontier AI.
Next Week in The Sequence:
Can Meta compete with frontier AI labs.
A visual explanation for OpenAI's new science for coding evaluations and benchmarks.
A joiurney through the evolution of distillation for frontier models.
Next Week in The Sequence:
What properties make certain domains suitable for AI.
Addressing one of the biggest use cases in enterprise AI.
The papers and techniques that laid out the ground work to evolve distillation to this level.
New models, agents and the evolution of the FDE landscape as the new battle field in AI.