Introducing System One Models & Jev - TypeSafe AI Blog
TypeSafe AI has introduced Jev, their first System One Model, designed specifically for fast, structured decision-making in software rather than text-based chat generation.
Here is a summary of the announcement from the TypeSafe AI Blog :
Core Concept & Features
- System One Architecture: Inspired by Daniel Kahneman’s Thinking, Fast and Slow, Jev is built for fast, intuitive, structured outputs rather than token-by-token string generation.
- RLCD Training: Trained using Reinforcement Learning for Calibrated Decisions (RLCD) to output epistemically honest probabilities alongside decisions.
- Type Safety & Zero Hallucinations: Because possible outputs and schemas are
, the model cannot make type errors or hallucinate values.defined in advance - Parallel Sampling: Generates all outputs in a single query rather than sequentially token by token.
Performance & Cost Benefits
- Speed: Delivers end-to-end response times of 70ms–500ms (roughly 40x to 200x faster than traditional frontier LLMs for System One tasks).
- Cost: Pricing is $0.042 per million input tokens ($42 per billion), with free output tokens.
- Confidence Scoring: Outputs include calibrated confidence scores to ensure reliable, automated branching in code.
Ideal Use Cases & Demos
- Smart Logic & Workflows: Replaces brittle conditional logic with fuzzy decision rules (classifying, scoring, routing, and guardrailing).
- Data Processing: Map-reducing over large datasets to extract features and insights.
- Real-Time Applications: Tested on real-time tasks, including a live
driven by state text and aDoom bot demo handling high-cardinality link navigation.Wikiracing demo
Jev is currently available in early access through TypeSafe AI .
This video introduces Jev, a new, highly efficient, and cost-effective AI model developed by a co-inventor of ChatGPT. Unlike traditional large language models (System 2), Jev is a System 1 model designed for rapid, snap-decision-making (0:00 - 2:45).
Key Characteristics of Jev:
- Speed and Cost: It is 20-200x faster and 40-400x cheaper than other frontier models because output tokens are free, charging only for input tokens (0:50 - 1:20).
- Limited Response Shapes: Jev only answers in three ways: binary (true/false), menu selection, or scale (0-10), which allows for its high performance (1:21 - 1:45).
- Integration Strategy: The creator emphasizes combining Jev with System 2 models (like Claude) to optimize workflows (2:46 - 3:00).
Three Levels of Using Jev:
- Level 1 (Operating System Integration): Enhances agentic systems by automating model routing (choosing the best model for a specific task) and speeding up skill discovery (4:43 - 8:01).
- Level 2 (Business Automation): Leverages Jev's speed for high-volume tasks such as email classification, lead scoring, and customer support triaging (8:01 - 9:51).
- Level 3 (Application Building): Enables new capabilities like semantic image search (searching by meaning instead of filename) and web browser clean-up tools (9:51 - 11:18).
To get started, the creator recommends signing up via Typesafe or accessing it through OpenRouter (3:00 - 4:00).


No comments:
Post a Comment