shipfeedAI news, curated daily

00:09:18 CET
25 AUG00:09:18shipfeed
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Adds support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM

A framework adds support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM models with optimizations.

Aug 15 · · primary fetch1 sourceupdated Aug 15 ·

model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018) llama : support for MiniMax-Text-01 model chore : renames to match the other MiniMax models model : add logits mask as MiniMax-Text-01 embeddings tensor has zero-valued embeddings for tokens >= 200032 that produce zero logits disrupting the token sampling process llama : replace hardcoded conditions with hparams.is_recr() model : used build_rs() for recurrent state management chore : code cleanup model : optimized MiniMax-Text-01 by removing the state tranpose operations chore : removed unnecessary ggml_cont() in MiniMax-Text-01 implementation llama : add generic logits mask graph input model : permuted diag_decay dimensions to avoid doing it inside MiniMax-Text-01 graph chore : code cleanup chore : code cleanup model : use token positions when calculating MiniMax-Text-01 decay tensors convert : add support for MiniMaxM1ForCausalLM as it seems to be the same as MiniMaxText01ForCausalLM chat : add jinja template for MiniMax-M1 Co-authored-by: QscQ chore : code cleanup tests : MINIMAX_01-related fixes chore : silence Python lint errors vocab : remove unnecessary vocab type convert : update…

read full article on github.com
§ sources1 publication · timeline below
  1. github.comllama.cpp b10437primary