shipfeedAI news, curated daily

23:03:57 CET
20 MAY23:03:57shipfeed
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

whisper.cpp v1.7.5

whisper.cpp v1.7.5 releases with Metal and Arm performance gains, refreshed iOS examples via a new XCFramework workflow, and auto-updated WASM demos hosted on GitHub Pages.

Apr 2 · · primary fetch1 sourceupdated Apr 2 ·

Overview This is a relatively big update with various build and CI improvements especially for iOS and WASM. There are also some performance gains, especially for the Metal backend and probably for Arm-based devices. Big shoutout to @danbev for stepping up and completing the maintenance roadmap for this release! Mobile examples All mobile examples have been refreshed. The iOS examples specifically are now much easier to build thanks to the new XCFramework workflow. This should simplify significantly integration of `whisper.cpp` in 3rd party iOS and macOS apps. CoreML build and convert instructions have also been updated.

WASM examples The WASM examples are now automatically updated on each new commit and hosted in Github Pages at https://ggml.ai/whisper.cpp/ Problems with CORS rules should be resolved. --- Some performance numbers for this release: M2 Ultra Flash Attention ON: | CPU | Config | Model | Th | FA | Enc. | Dec. | Bch5 | PP | Commit | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | M2 ULTRA | METAL | tiny | 1 | 1 | 7.82 | 1.31 | 0.35 | 0.01 | ad4e350 | | M2 ULTRA | METAL | tiny-q5_0 | 1 | 1 | 8.32 | 1.28 | 0.37 | 0.01 | ad4e350 | | M2 ULTRA | METAL |…

read full article on github.com
§ sources1 publication · timeline below
  1. github.comwhisper.cpp v1.7.5primary