is now available on AI Gateway.Jev from TypeSafe AI Jev is a probabilistic decision model for software: state goes in, typed Choice, Score, and Boolean answers come out. Regular language models generate text one token at a time, which the application then parses and validates. Jev evaluates all declared questions in parallel and returns typed answers plus probabilities directly. That removes unnecessary text generation and makes it straightforward to automate clear cases while routing uncertain ones to review. TypeSafe reports Jev was up to 193.6x faster and 444.6x cheaper than LLMs on its workflow evaluations.

Example use cases include: AI SDK 7 exposes Jev through the experimental . Choice selects an option, Score grades an ordered rubric, and Boolean estimates the probability of . Install the current AI SDK (AI SDK 7.0.105 onwards supports the API):evaluatetrueevaluateAPI Each evaluation specifies: Call the model with . This example turns one support case into a queue, priority, and refund-review decision, with uncertain routing sent for manual review:typesafe-ai/jev The result preserves question IDs and Choice keys. TypeSafe reports separate Choice and Score confidence in…