shipfeedAI news, curated daily

23:56:30 CET
20 MAY23:56:30shipfeed
pull to refreshlast sync
Just in — 30 new
§ tools · storyline

Ollama v0.30.0-rc21

Ollama releases v0.30.0-rc21, shifting its architecture to support llama.cpp directly, adding GGUF compatibility, and using MLX to accelerate inference on Apple Silicon.

May 13 · · primary fetch1 sourceupdated May 13 ·

This version of Ollama will change the architecture to directly support llama.cpp instead of building on top of GGML, and allows for compatibility with GGUF file format. MLX is used to accelerate model inference on Apple Silicon. While in pre-release we'd love feedback on: Performance improvements or degradation Errors or crashes that did not previously occur Memory utilization improvements or degradation Known issues: `laguna-xs.2` is not supported yet on this pre-release `llama3.2-vision` is not supported yet on this pre-release Installing: Mac/Linux ``` curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.30.0-rc20 sh ``` Windows ``` $env:OLLAMA_VERSION="0.30.0-rc20"; irm https://ollama.com/install.ps1 | iex ```

read full article on github.com
§ sources1 publication · timeline below
  1. github.comOllama v0.30.0-rc21primary