08:17 CETWednesday · May 13, 2026

shipfeed

⌘K SEARCHJK NAVO OPEN
on the wire
arXiv — cs.AIMedHopQA benchmark tests LLM reasoning in biomedical Q&A◆arXiv — cs.CLRouters learn geometry of sparse mixture-of-experts◆arXiv — cs.AIStudy audits how LLMs generate political discourse during crises◆arXiv — cs.AIClassifier Context Rot: Monitor Performance Degrades with Context◆arXiv — cs.AIExecutable Agentic Memory for GUI Agent◆arXiv — cs.CLLongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced◆arXiv — cs.AISparse-to-dense rewards improve language model post-training◆arXiv — cs.AIAI-native mobility dataset advances 6G handover and beam management◆arXiv — cs.AIMedHopQA benchmark tests LLM reasoning in biomedical Q&A◆arXiv — cs.CLRouters learn geometry of sparse mixture-of-experts◆arXiv — cs.AIStudy audits how LLMs generate political discourse during crises◆arXiv — cs.AIClassifier Context Rot: Monitor Performance Degrades with Context◆arXiv — cs.AIExecutable Agentic Memory for GUI Agent◆arXiv — cs.CLLongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced◆arXiv — cs.AISparse-to-dense rewards improve language model post-training◆arXiv — cs.AIAI-native mobility dataset advances 6G handover and beam management◆
home/§ local-llm/cluster
ad slot opena single understated line lives here — sponsor wordmark + a short line.advertise on shipfeed →
§ local-llm · cluster

vLLM v0.16.0

Feb 25 · · primary fetch1 sourcecluster 1d4c91c5updated Feb 25 ·

vLLM v0.16.0 Please note that this release was branch cut on Feb 8, so any features added to vLLM after that date is not included. Highlights This release features 440 commits from 203 contributors (7 new)! Async scheduling + Pipeline Parallelism is now fully supported, delivering 30.8% E2E throughput improvement and 31.8% TPOT improvement (#32618). Realtime API: A new WebSocket-based Realtime API enables streaming audio interactions (#33187), building on the Voxtral realtime infrastructure. RLHF workflow improvements: Native NCCL-based weight syncing API (#31943), layerwise weight reloading for QeRL (#32133), and engine pause/resume with request preservation (#32351).

Unified Parallel Drafting for speculative decoding (#32887), plus spec decode now works with structured outputs (#33374) and penalty application in Model Runner V2 (#33251). Major XPU platform overhaul: Deprecated IPEX in favor of vllm-xpu-kernels (#33379), adding MoE (#33659), MXFP4 MoE (#33679), WNA16 (#33973), scaled_mm (#34117), and FP8 MoE (#34202) support. Model Support New architectures: GLM-OCR with MTP (#33005), Qwen3-ASR (#33312), DeepSeek-OCR-2 (#33165), Intern-S1-Pro (#33636), MiniCPM-o 4.5 (#33431)…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comvllm v0.16.0primary