whisper.cpp v1.7.5
whisper.cpp v1.7.5 releases with Metal and Arm performance gains, refreshed iOS examples via a new XCFramework workflow, and auto-updated WASM demos hosted on GitHub Pages.
Overview This is a relatively big update with various build and CI improvements especially for iOS and WASM. There are also some performance gains, especially for the Metal backend and probably for Arm-based devices. Big shoutout to @danbev for stepping up and completing the maintenance roadmap for this release! Mobile examples All mobile examples have been refreshed. The iOS examples specifically are now much easier to build thanks to the new XCFramework workflow. This should simplify significantly integration of `whisper.cpp` in 3rd party iOS and macOS apps. CoreML build and convert instructions have also been updated.
WASM examples The WASM examples are now automatically updated on each new commit and hosted in Github Pages at https://ggml.ai/whisper.cpp/ Problems with CORS rules should be resolved. --- Some performance numbers for this release: M2 Ultra Flash Attention ON: | CPU | Config | Model | Th | FA | Enc. | Dec. | Bch5 | PP | Commit | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | M2 ULTRA | METAL | tiny | 1 | 1 | 7.82 | 1.31 | 0.35 | 0.01 | ad4e350 | | M2 ULTRA | METAL | tiny-q5_0 | 1 | 1 | 8.32 | 1.28 | 0.37 | 0.01 | ad4e350 | | M2 ULTRA | METAL |…
- github.comwhisper.cpp v1.7.5primary