shipfeedAI news, curated daily

18:54:51 CET
26 JUL18:54:51shipfeed
pull to refreshlast sync
Just in — 30 new
§ tools · storyline

Model Runner V2 is now the default for all dense models

vLLM v0.25.0 releases with Model Runner V2 as the default for all dense models, removes PagedAttention, and adds new model support including GLM-5, DeepSeek-V3.2, and LLaVA-OneVision-2.

Jul 11 · · primary fetch1 sourceupdated Jul 11 ·

vLLM v0.25.0 Release Notes Highlights This release features 558 commits from 232 contributors (64 new)! Model Runner V2 is now the default for all dense models (#44443). Building on quantized-model support from the previous release, MRv2 is now the standard execution path, with new support for EVS (#46535), realtime embeddings (#46762), prefix caching for Mamba hybrid models (#42406), multimodal-prefix bidirectional attention (#46942), and dynamic speculative decoding compatible with full CUDA graphs (#45953). PagedAttention has been removed (#47361). The legacy attention implementation is deleted now that V1/MRv2 backends are the standard path.

The Transformers modeling backend is now as fast as native vLLM (#47187), and gained FP8 MoE support (#46820), CUDA graph + embed scaling fixes (#48010), and migration of GPTBigCode/Starcoder2 (#30966) and RoBERTa (#47452). New models: LLaVA-OneVision-2 (#44785), Unlimited OCR (#46564, #47102), MOSS-Transcribe-Diarize (#47729), openai/privacy-filter (#41026), and Hy3 (#47192). GLM-5 / DeepSeek-V3.2 landed in the model zoo (#46808) with GLM-5.2 tuning, and MiniMax-M3 gained pipeline parallelism (#45810) and NVFP4 support (#46756). New…

read full article on github.com
§ sources1 publication · timeline below
  1. github.comvLLM v0.25.0primary