Adds decision models for ticket triage and classification
Ollama adds decision models via a new `/v1/systemone` endpoint, returning choices, probabilities, and scores for tasks such as ticket triage and content classification, with models from Bespoke Labs and Together AI.
Decision models Ollama now supports decision models through `/v1/systemone`, based on TypeSafe’s Jev API. Decision models return choices, probabilities, and scores instead of text. Use them for tasks such as ticket triage, model routing, and content classification. Available models: Nimble from Bespoke Labs Tev1 from Together AI ```sh ollama pull nimble ``` Send context and one or more questions: ```sh curl http://localhost:11434/v1/systemone \ -H 'Content-Type: application/json' \ -d '{ "model": "nimble", "state": "Our checkout has returned 500 errors since 9am.", "questions": { "label": { "type": "choice", "instructions": "Which label fits this ticket?", "criteria": { "billing": "Payments and refunds", "bug": "Software errors", "account": "Login and account access" } } } }' ``` Example response: ```json { "model": "nimble", "answers": { "label": { "type": "choice", "choice": "bug", "probabilities": { "billing": 0.0125, "bug": 0.9781, "account": 0.0093 }, "confidence": 0.8906 } }, "usage": { "input_tokens": 174, "output_tokens": 1 } } ``` The API supports three question types: `choice`: Select an option and return probabilities for each. `noul`: Return the probability that a…
- github.comOllama v0.35.0primary