shipfeedAI news, curated daily

01:19:42 CET
21 MAY01:19:42shipfeed
pull to refreshlast sync
Just in — 30 new
§ feed · storyline

vLLM v0.20.2

vLLM releases v0.20.2, a patch fixing DeepSeek V4 sparse attention hangs and KV cache errors, gpt-oss MXFP4 torch.compile support, and a Qwen3-VL load issue.

May 10 · · primary fetch1 sourceupdated May 10 ·

vLLM v0.20.2 Highlights This release features 6 commits from 6 contributors (0 new)! This is a small patch release with bug fixes for DeepSeek V4, gpt-oss, and Qwen3-VL Bug Fixes DeepSeek V4 sparse attention: Re-enable the persistent topk path on Hopper and ensure the memset kernel runs at CUDA graph capture time regardless of `max_seq_len`, fixing the MTP=1 hang on DeepSeek V4 (#41665, revert of #41605). DeepSeek V4 KV cache: Fixed a "failure to allocate KV blocks" error in the V1 engine KV cache manager (#41282).

gpt-oss MXFP4 + torch.compile: Plumbed `hidden_dim_unpadded` through the `moe_forward` fake op so MXFP4 works under `torch.compile` on v0.20.x (#42002, backport of #41646). Qwen3-VL: Removed an invalid deepstack boundary check that could fail under heavy load (#40932). Contributors @ywang96, @zyongye, @stecasta, @wzhao18, @Isotr0py, @khluu

read full article on github.com
§ sources1 publication · timeline below
  1. github.comvllm v0.20.2primary