shipfeedAI news, curated daily

02:54:36 CET
12 OCT02:54:36shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Adds Vision Support for Minimax-M3

llama.cpp adds preliminary vision support for Minimax-M3

Jul 27 · · primary fetch1 sourceupdated Jul 27 ·

mtmd: Add Vision Support for Minimax-M3 (#25113) Add preliminary MiniMax-M3 support Text-only port that re-uses existing components: MiniMax-M2 style GQA with per-head QK-norm and partial rotary, DeepSeek-V3 style leading-dense and routed/shared experts, and swigluoai activation. Sparse attention is not yet supported (dense fallback); vision tower and MTP heads are dropped. MiniMax-M3 vision tower (mmproj + clip graph) Delete m3_vision_ref.py Update clip.cpp MSA Update constants.py Update minimax.py Cache creation. Working withotu flash attention Added flash attention for sparse layers Decomposed slow cpu OP into GPU + CPU ops.

Massive speedup over long ctx Rewrote indexer op to be cuda native. Modified flash attention to match per group block picking Implement sparse attention calc out of stock ops. Fix a cache allocation and cont issue Fixed -fa auto crash, flagged debug spots Delete vocab.json Delete model.safetensors.index.json Delete generation_config.json Delete Minimax directory Handled multi stream case to fall back on Dense Attention Development scaffolding cleanup. No functional change to the decode or 4-way paths. Full debug harness remains at for reproducing the…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comllama.cpp b10142primary