shipfeedAI news, curated daily

04:41:50 CET
12 OCT04:41:50shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Bumps ggml to 0.26.0 and llama.cpp to 0.6.0

ggml releases 0.26.0 and llama.cpp releases 0.6.0 with GPU kernel optimizations.

Oct 6 · · primary fetch1 sourceupdated Oct 6 ·

Overview New version has been released. Nightly build: b5454 More info: dist : releases and versioning of ggml-org projects Changelog since v1.9.4 d1be6fde whisper : bump version to 1.9.5 (#4102) 4afec37b talk-llama : update llama.cpp to v0.6.0 3d451abe sync : ggml 47f1c7dc ggml : bump version to 0.26.0 (ggml/1652) e71b7844 CUDA: make the alloc_deps check batch independent (llama/29986) cdc87302 vulkan: fix Flash Attention shmem write out of bounds (llama/29988) 563a9f7a vulkan: revert mul_mat_id tile selection PR #29182 (llama/29936) ebb8a170 cuda: use the vector lightning indexer kernel on MUSA (llama/29990) 8c6ca4ab CUDA: Optimize accumulation in mmq for NVFP4 type (llama/29857) 82fa9df7 vulkan: fix stale prealloc_y reuse across flash attention and soft_max (llama/29591) f6915422 vulkan: sparse flash attention for quantized K/V (llama/29639) d477de3c llama : fix unexpected graph reallocation in the k-pool models (llama/29958) 95283ca7 ggml-cpu : add Q8_0 IME1 matrix kernel for SpacemiT X60 (llama/28479) 155c5c28 vulkan : Fix undeclared identifiers when -DGGML_VULKAN_RUN_TESTS=ON (llama/29912) 7091d4a2 webgpu: add MMVQ support for Q1_0/Q5_0/Q5_1/Q3_K/Q5_K/Q6_K/MXFP4…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comwhisper.cpp v1.9.5primary