Here are the links for TypeSafe AI and their new model, Jev:
Additionally, Jev is accessible for developers via API platforms like OpenRouter and Cloudflare .
We need to talk about Jev... - YouTube by Matthew Berman - YouTube
This video introduces Jev , a high-speed, cost-effective AI architecture focused on decision-making rather than traditional chat interactions.
Key Takeaways About Jev:
- Speed and Efficiency: It operates up to 200x faster and 400x cheaper than standard large language models and features free output tokens.
- Architecture: It utilizes RLCD (Reinforcement Learning for Calibrated Decisions) rather than standard chat model structures, optimizing it for real-time task execution like gaming or routing support tickets.
- Reliability: The developers state it produces zero hallucinations, making it viable for critical infrastructure.
Demo Highlights:
- Real-Time Control: Showcases include controlling the game Doom, navigating a browser-based wiki race, and sorting 150,000 Skittles robotically.
- Specialized Use: It excels as an autonomous decision-maker in simulations and as a rapid router for other AI models, rather than serving as a general chat interface.
- Experimental Applications: The model is demonstrated controlling a simulated Tesla self-driving system and playing Super Smash Bros. Melee.
The embedded agent captured the core concepts of Maximilian Schwarzmüller's video well, but it made one funny transcription error: the new AI model from Typesafe AI is actually named Jev, not "Jeff". (The name is a nod to the economist William Stanley Jevons).
- Purpose-Built for Decisions: Jev is a "System One" model designed for rapid, structured decision-making rather than open-ended text generation.
It takes in unstructured data and returns typed, probabilistic decisions in a single parallel pass rather than predicting words token-by-token. - Core Functionality: As seen in the code snippets on screen, Jev evaluates state against three specific query types: Choice (categorical classification), Score (numeric grading), and Noul (boolean yes/no probabilities).
- Speed and Efficiency: Because it skips autoregressive generation entirely, Jev operates with extremely low latency—typically 70 to 500 milliseconds.
The agent was spot-on with the pricing math: it costs $0.042 per million input tokens (which scales exactly to $42 per billion), and output tokens are provided entirely for free. - Guaranteed Schema (Zero Hallucinations): Because Jev's outputs are strictly constrained to the developer's pre-defined schema, it mathematically cannot hallucinate random text, invent non-existent tools, or return malformed data types.
While it can still make an incorrect judgment from the available options, every answer includes a calibrated confidence score so uncertain edge-cases can be routed for human review. - Architectural Integration: Jev is meant to complement, not replace, generative LLMs. It acts as an ultra-fast triage layer—instantly evaluating inputs and deciding which tools to trigger—while standard models like Claude or ChatGPT are reserved for tasks that actually require drafting text or deep reasoning.
- Current Limitations: As the agent correctly noted, the model is highly specialized. It currently has a context limit of around 32,000 tokens and is not built for raw mathematical calculations or complex logic comparisons.
No comments:
Post a Comment