Ollama v0.30.0-rc15
Ollama releases v0.30.0-rc15, a pre-release that shifts architecture to use llama.cpp directly with GGUF support and adds MLX-based inference acceleration on Apple Silicon.
This version of Ollama will change the architecture to directly support llama.cpp instead of building on top of GGML, and allows for compatibility with GGUF file format. MLX is used to accelerate model inference on Apple Silicon. While in pre-release we'd love feedback on: Performance improvements or degradation Errors or crashes that did not previously occur Memory utilization improvements or degradation Known issues: `laguna-xs.2` is not supported yet on this pre-release `llama3.2-vision` is not supported yet on this pre-release Installing: Mac/Linux ``` curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.30.0-rc15 sh ``` Windows ``` $env:OLLAMA_VERSION="0.30.0-rc15"; irm https://ollama.com/install.ps1 | iex ```
- github.comOllama v0.30.0-rc15primary