shipfeedAI news, curated daily

09:04:14 CET
27 JUL09:04:14shipfeed
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Adds Vision Support for Minimax-M3

llama.cpp adds preliminary vision support for Minimax-M3

today · · primary fetch1 sourceupdated today ·

mtmd: Add Vision Support for Minimax-M3 (#25113) Add preliminary MiniMax-M3 support Text-only port that re-uses existing components: MiniMax-M2 style GQA with per-head QK-norm and partial rotary, DeepSeek-V3 style leading-dense and routed/shared experts, and swigluoai activation. Sparse attention is not yet supported (dense fallback); vision tower and MTP heads are dropped. MiniMax-M3 vision tower (mmproj + clip graph) Delete m3_vision_ref.py Update clip.cpp MSA Update constants.py Update minimax.py Cache creation. Working withotu flash attention Added flash attention for sparse layers Decomposed slow cpu OP into GPU + CPU ops.

Massive speedup over long ctx Rewrote indexer op to be cuda native. Modified flash attention to match per group block picking Implement sparse attention calc out of stock ops. Fix a cache allocation and cont issue Fixed -fa auto crash, flagged debug spots Delete vocab.json Delete model.safetensors.index.json Delete generation_config.json Delete Minimax directory Handled multi stream case to fall back on Dense Attention Development scaffolding cleanup. No functional change to the decode or 4-way paths. Full debug harness remains at for reproducing the…

read full article on github.com
§ sources1 publication · timeline below
  1. github.comllama.cpp b10142primary