Adds ET backend for GGML with kernels for MUL_MAT, ROPE, RMS_NORM
GGML adds ExecuTorch backend with kernels for matrix multiplication, rotary position embeddings, and normalization operations.
ggml-et: Initial ET backend (#24179) ggml-et: Add performance logging ggml-et: Quants helpers ggml-et: Add MUL_MAT kernel ggml-et: Add ROPE kernel ggml-et: Add RMS_NORM kernel ggml-et: Add GLU kernel ggml-et: Add SOFT_MAX kernel ggml-et: Add GET_ROWS kernel ggml-et: Add CONT kernel ggml-et: Add SET_ROWS kernel ggml-et: Add MUL_MAT_ID kernel ggml-et: Build et kernels as part of ggml ggml-et: Embed kernels with fs fallback ggml-et: Build fixes ggml-et: Add MUL_MAT F32xF32 op ggml_et: Add MUL_MAT_ID op ggml-et: Disable offloading for debug ggml-et: Refactor out block ops ggml-et: ggml backend API changes ggml-et: Add RESHAPE/TRANSPOSE to supported ggml-et: Add CONT_F16 ggml-et: Add supported ops doc gglm-et: Initial doc ggml-et: Remove runtime import hacks We can now import the runtime by a simple find_package(), so we can cleanup the CMakeLists.txt.
ggml-et: Fix GET_ROWS kernel Fix lost batch dimension. Also clean vibe-comments. ggml-et: Fix SET_ROWS kernel Remove incorrect broadcasting guard. ggml-et: Use custom instruction for fp32->fp16 ggml-et: Vectorize set_rows fp32->fp16 ggml-et: Fix ROPE kernel (yarn) ggml-et: fix et_logf WIP: Fix ramp WIP: fix ROPE! ggml-et: Better sinf…
- github.comllama.cpp b9951primary
- github.comllama.cpp b9957
- github.comllama.cpp b9956
§ how this story moved
- primary — llama.cpp — Releases publishes the launch post.
- llama.cpp — Releases picks up coverage.
- llama.cpp — Releases picks up coverage.