shipfeedAI news, curated daily

10:49:32 CET
11 JUL10:49:32shipfeed
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

DeepSeek-V4 and Model Runner V2 mature across backends with attention

vLLM v0.23.0 releases with DeepSeek-V4 backend hardening, Model Runner V2 expansion to Llama and Mistral, and new Rust frontend endpoints across 408 commits from 200 contributors.

Jun 13 · · primary fetch1 sourceupdated Jun 13 ·

vLLM v0.23.0 Release Notes Please note that Minimax M3 is not yet supported in this version. Please follow vLLM recipe for usage guides for M3. Highlights This release features 408 commits from 200 contributors (63 new)! DeepSeek-V4 matures across backends: Following its introduction in v0.22.0, DeepSeek-V4 received another large hardening and optimization pass. Its sparse MLA metadata is now decoupled from DeepSeek-V3.2 (#44699), it gained a TRTLLM-gen attention kernel (#43827), EPLB support for the Mega-MoE (#43339), selective prefix-cache retention for sliding-window KV cache (#43447), and an index-share feature for DSA MTP (#44420).

The model was also detached from `torch.compile` (#43746, #43891), its attention and RoPE paths were refactored (#44569, #44262, #43926), and an XPU attention decode path was added (#42953). Model Runner V2 expands to more dense models: MRv2 is now selected by default for Llama and Mistral dense models (#43458) in addition to Qwen3. It gained a FlashInfer sampler (#42472), breakable CUDA graphs (#44050), pipeline-parallel bubble elimination (#42187), kernel block-size support for hybrid models (#38831), and Gemma 4 MTP (#43241). Rust frontend…

read full article on github.com
§ sources1 publication · timeline below
  1. github.comvLLM v0.23.0primary