Friday, September 18, 2026

AI model: Jev: super fast; RLCD no LLM

Here are the links for TypeSafe AI and their new model, Jev:

Additionally, Jev is accessible for developers via API platforms like OpenRouter and Cloudflare.



We need to talk about Jev... - YouTube by Matthew Berman - YouTube

This video introduces Jev, a high-speed, cost-effective AI architecture focused on decision-making rather than traditional chat interactions.

Key Takeaways About Jev:

  • Speed and Efficiency: It operates up to 200x faster and 400x cheaper than standard large language models and features free output tokens.

  • Architecture: It utilizes RLCD (Reinforcement Learning for Calibrated Decisions) rather than standard chat model structures, optimizing it for real-time task execution like gaming or routing support tickets.

  • Reliability: The developers state it produces zero hallucinations, making it viable for critical infrastructure.

Demo Highlights:

  • Real-Time Control: Showcases include controlling the game Doom, navigating a browser-based wiki race, and sorting 150,000 Skittles robotically.

  • Specialized Use: It excels as an autonomous decision-maker in simulations and as a rapid router for other AI models, rather than serving as a general chat interface.

  • Experimental Applications: The model is demonstrated controlling a simulated Tesla self-driving system and playing Super Smash Bros. Melee.



The embedded agent captured the core concepts of Maximilian Schwarzmüller's video well, but it made one funny transcription error: the new AI model from Typesafe AI is actually named Jev, not "Jeff". (The name is a nod to the economist William Stanley Jevons).

  • Purpose-Built for Decisions: Jev is a "System One" model designed for rapid, structured decision-making rather than open-ended text generation. It takes in unstructured data and returns typed, probabilistic decisions in a single parallel pass rather than predicting words token-by-token.

  • Core Functionality: As seen in the code snippets on screen, Jev evaluates state against three specific query types: Choice (categorical classification), Score (numeric grading), and Noul (boolean yes/no probabilities).

  • Speed and Efficiency: Because it skips autoregressive generation entirely, Jev operates with extremely low latency—typically 70 to 500 milliseconds. The agent was spot-on with the pricing math: it costs $0.042 per million input tokens (which scales exactly to $42 per billion), and output tokens are provided entirely for free.

  • Guaranteed Schema (Zero Hallucinations): Because Jev's outputs are strictly constrained to the developer's pre-defined schema, it mathematically cannot hallucinate random text, invent non-existent tools, or return malformed data types. While it can still make an incorrect judgment from the available options, every answer includes a calibrated confidence score so uncertain edge-cases can be routed for human review.

  • Architectural Integration: Jev is meant to complement, not replace, generative LLMs. It acts as an ultra-fast triage layer—instantly evaluating inputs and deciding which tools to trigger—while standard models like Claude or ChatGPT are reserved for tasks that actually require drafting text or deep reasoning.

  • Current Limitations: As the agent correctly noted, the model is highly specialized. It currently has a context limit of around 32,000 tokens and is not built for raw mathematical calculations or complex logic comparisons.


No comments: