shipfeedAI news, curated daily

02:55:22 CET
12 OCT02:55:22shipfeed⋯
pull to refreshlast sync
Just in — 30 new
§ local-llm · storyline

Adds decision models for ticket triage and classification

Ollama adds decision models via a new `/v1/systemone` endpoint, returning choices, probabilities, and scores for tasks such as ticket triage and content classification, with models from Bespoke Labs and Together AI.

Sep 28 · · primary fetch1 sourceupdated Sep 28 ·

Decision models Ollama now supports decision models through `/v1/systemone`, based on TypeSafe’s Jev API. Decision models return choices, probabilities, and scores instead of text. Use them for tasks such as ticket triage, model routing, and content classification. Available models: Nimble from Bespoke Labs Tev1 from Together AI ```sh ollama pull nimble ``` Send context and one or more questions: ```sh curl http://localhost:11434/v1/systemone \ -H 'Content-Type: application/json' \ -d '{ "model": "nimble", "state": "Our checkout has returned 500 errors since 9am.", "questions": { "label": { "type": "choice", "instructions": "Which label fits this ticket?", "criteria": { "billing": "Payments and refunds", "bug": "Software errors", "account": "Login and account access" } } } }' ``` Example response: ```json { "model": "nimble", "answers": { "label": { "type": "choice", "choice": "bug", "probabilities": { "billing": 0.0125, "bug": 0.9781, "account": 0.0093 }, "confidence": 0.8906 } }, "usage": { "input_tokens": 174, "output_tokens": 1 } } ``` The API supports three question types: `choice`: Select an option and return probabilities for each. `noul`: Return the probability that a…

read full article on github.com ↗
§ sources1 publication · timeline below
  1. github.comOllama v0.35.0primary