Jev and System One models: a plain guide
Jev is a hosted model from TypeSafe AI that answers fixed questions about a piece of text with calibrated probabilities instead of writing a reply. TypeSafe calls this a System One model. It returns a choice, a score or a yes/no probability in well under a second, and TypeSafe prices it at $0.042 per million input tokens with output free. This guide explains what that buys you, where the model is known to fail, and how to decide between Jev and a language model for each decision in your software.
Published September 22, 2026. Editorial.
Key takeaways
- A System One model returns a decision, never text: you write the questions in advance and the model returns a probability for each answer, so the output is something code can act on directly.
- Jev offers three question types, Choice (up to 255 options), Score (2 to 10 ordered levels) and Noul (one yes/no probability), and each carries the probabilities that let you set a threshold per decision.
- TypeSafe prices Jev at $0.042 per million input tokens with output tokens free, inside a 64k-token request with a 32k-token limit on the state, and TypeSafe itself says it cannot prove the price is unsubsidised.
- The model reads questions literally, cannot count or compare numbers reliably, and can be moved by hostile text in the input. Every one of those is on TypeSafe's own jaggedness page, and each has a mitigation.
- Reveneau uses Jev as the grader in its eval suite for the checks that used to need a language model judge, and on our own suite the run is ten times faster than with the previous grader.
Jev landed on 15 September 2026 with a claim that sounded like marketing and turned out to be a definition. TypeSafe AI called it the first public System One model, "a new class of frontier models built to make fast, structured decisions that software can use directly" [1]. The waitlist came off five days later, on 20 September, and anyone can now create a key at console.typesafe.ai [11]. We had been grading part of our eval suite with a language model, and within the week we had moved that grading to Jev. This guide is what we learned while doing it, with every figure attributed to whoever measured it.
Here is the short version. A language model writes text, and if you want a decision you have to ask it to write the decision and then parse what it wrote. A System One model skips the writing. You send it a piece of text, which TypeSafe calls the state, and a set of named questions. It returns an answer for each question with a probability attached, and the answer always fits the shape you asked for [2]. That single change is what makes it faster, cheaper, and more predictable than a language model for the class of decisions where the possible answers are known in advance. It is also what makes it useless for anything that needs a sentence written.
What a System One model is
The name comes from Daniel Kahneman's description of two kinds of thinking: fast, automatic judgment, and slow, deliberate reasoning. TypeSafe borrowed the label for a model that does the first kind only. It classifies, routes, scores, extracts a label, or picks a branch [2]. Chat, code and explanations are language model work.
That sounds like a limitation, and it is one. It is also the point. Most of the decisions inside a software product are of the fast kind: is this message spam, which team should get this ticket, does this response follow the instruction, is this tool call inside the plan. Teams have been paying for a slow, expensive model to answer fast, cheap questions because until this month there was no public model built for the fast kind. We wrote a full definition, including what fits and what does not, in what is a System One model.
What Jev returns
Jev has three question types, which the docs call primitives.
A Choice question picks one option from a list of up to 255. It returns the chosen option, a probability for every option, and a confidence number [13]. A Score question places the state on an ordered scale of 2 to 10 levels that you describe in words. The score is each level number multiplied by its probability, added up, so it can land between levels. The docs' own example returns a score of 1.43 with a confidence of 0.35 and probabilities of 0.0, 0.57 and 0.43 across levels 0, 1 and 2. A Noul question is a yes/no statement and returns one probability from 0 to 1, with no separate confidence number [2].
Each maps to a decision your code already makes. Choice is a switch statement. Score is a threshold on an ordered scale. Noul is an if. The mapping, the limits, and how to name the questions are in what Jev returns: Choice, Score and Noul.
Calibrated probabilities and what confidence means
A calibrated probability is one you can trust as a frequency. If the model says 0.8, then across many such answers it should be right 8 times in 10. TypeSafe trains for this with a method it calls Reinforcement Learning for Calibrated Decisions, or RLCD, and has not disclosed the architecture behind it [1] [7].
Confidence is a separate number, for Choice and Score only, computed from how spread out the probabilities are. For three options the docs give the formula (3 x largest probability - 1) / 2. The docs then suggest bands: 0.9 and above, act automatically; below 0.5, route to a person, ask for clarification, or fall back to another system; the middle, proceed with caution. They add a line we think every team should copy: "Different actions within the same system should be gated at different levels depending on the consequences" [4]. Refunding $5 and deleting an account deserve different thresholds. The full explanation is in calibrated probabilities and confidence, explained.
How to write the state and the questions
The state can be a string, a JSON object, or an array of text values, and it is text only, with no images or audio. It is capped at 32k tokens, inside a 64k limit for the whole request [3]. The questions are written in plain language, and the model answers exactly the question you wrote. TypeSafe's design guidance says to break a broad judgment into atomic questions and combine them in code with weighted arithmetic, and it names "Is this spam?" as the anti-pattern: too broad for one question, and better served by several narrow ones about what the message actually contains [14].
The reason this matters is on TypeSafe's own list of known weaknesses: Jev "answers the question you wrote, not the one you meant. Scoping words, negations, and implied conditions are read at face value" [6]. So a question with a negation in it, or a question that assumes context that is only in your head, will be answered literally. How to write the state and the questions is the practical page.
Many questions in one call
Every question in a request is evaluated in parallel. The docs put it as "Adding questions barely changes the response time" [15]. TypeSafe's batching cookbook measured it on jev-1.12: 13 questions against the 53,777-character Wikipedia article on the GDPR, five repeats each way. One batched request cost $0.000497 and took 0.27 seconds. Thirteen single requests cost $0.006090 and took 2.71 seconds. TypeSafe reports that as 12.2 times cheaper and 10.0 times faster, and notes that answers did not depend on what else was in the request, with a standard deviation of 0.0 across repeats for 11 of the 13 questions [5].
That is the vendor measuring its own product on a workload it chose, so read it as an upper bound on what batching can do rather than a promise. The pattern it supports, which TypeSafe calls speculative fan-out, is to ask every question you might need in one request and let code decide which answers matter. Many questions in one call covers when that is worth doing and when it wastes tokens.
What it costs and where the limits are
TypeSafe prices Jev at $0.042 per million input tokens, which is $42 per billion, and output tokens are free. The current model is jev-1.13.0, released 15 September 2026; the aliases jev-latest and jev-preview both point to it. A request may carry 64k tokens, of which the state plus the longest question may use 32k. Rate limits are 250,000 tokens per second and 1,200 requests per minute. English is the primary training language [3].
One caveat comes from TypeSafe itself. As MarkTechPost reported on 19 September, TypeSafe says it cannot prove the price is unsubsidised [7]. A launch price for a model whose architecture is undisclosed may change. Plan for the number to go up and treat any saving you compute as the saving at today's price. The arithmetic, the error codes, and the SDKs are in Jev pricing, rate limits and context window.
Where Jev is weak
TypeSafe publishes a page for jev-1.13 called model jaggedness, and it is the most useful page in the docs. In plain words, the model: reads questions literally; does not count reliably, with error growing as the count grows; cannot reliably judge whether two numbers are near each other; is weak at numerical calibration on Score levels; reads dates as text rather than as ordered quantities; answers double negatives and indirect questions less reliably; loses accuracy as the state grows with content unrelated to the decision; can be moved by adversarial content placed in the state; and is not trained to generate text [6].
Each of those has a mitigation, and most of them are the same mitigation: do the counting, the comparing and the date arithmetic in code, put the result in the state as a plain fact, and ask Jev only the judgment that code cannot make. Where Jev is weak: the jaggedness list goes through all nine.
Jev vs a language model
The decision rule we use is short. If the set of possible answers is known before the request is made, and the decision repeats at volume, it is a Jev question. If the answer needs a written reason, a new option that was not on the list, or any generated text, it is a language model task. Many features need both: Jev decides, the language model writes. TypeSafe's own coding-agents page says the same thing from the other side, that Jev "is not a drop-in replacement" for the language model running an agent, and is used inside the application for routing, rubric scoring and statement verification [16].
On speed and cost, TypeSafe reports 70 to 500 milliseconds end to end against 3 to 329 seconds for the frontier language models in its comparison, and states "40x-200x faster" [1]. Its headline benchmark has Jev finishing one workflow decision in 0.114 seconds for $0.000081, against GPT-5.6 Terra at 8.566 seconds for $0.013880, which TypeSafe reports as "193.6x faster and 444.6x cheaper" [7]. TypeSafe's own capabilities team wrote those workflows. On accuracy, DataCamp reports a TypeSafe workflow evaluation in which Jev agreed with the reference answer 67.8 percent of the time, against 67.9 percent for GPT-5.6 Terra, 74.1 percent for GPT-5.6 Sol and 73.1 percent for Claude Opus 5, with 0 percent structured-output errors for Jev against 45.5 percent for Claude Haiku 4.5 [8]. Those are TypeSafe's workflows too. Read together, the honest summary is: on TypeSafe's own tasks, Jev is close in accuracy to the mid-range language models, less accurate than the best ones, and far faster and cheaper than all of them. Jev vs a language model goes through the rule and the figures.
Jev vs a classifier you train yourself
Before Jev, the standard answer to a repeated classification problem was to train a small model on your own labelled data. That is still the right answer in several cases: when you have a large volume of labelled examples, when the data cannot leave your network, when the system has to work offline, when the text is mostly outside English, or when the decision is numeric. Jev is a hosted API with English as its primary language, and every one of those conditions works against it [3].
The one comparison figure available is from the jevals README, which cites JevBench (a benchmark whose owner we have not verified) at 83 to 87 percent on Banking77 and CLINC150 [10]. Both are intent-classification benchmarks, which is the task a trained classifier does, and the figure is TypeSafe's own. Jev vs a fine-tuned classifier or a small model sets out when to train instead.
What third parties found
Three teams built on Jev in its first week and published what they measured. LangChain ran five weather-agent cases, 100 repetitions per judge per case, against a human-labelled reference. On the binary pass question, Jev agreed with the reference 100 percent of the time, GPT-5.6 Terra 99.8 percent, GPT-5.6 Luna 96.4 percent and Claude Sonnet 4.6 80.0 percent. Jev's mean per-case variance on the quality score was 0.0000149; Luna's was 433 times higher, Terra's 913 times higher, and Claude's 92 times higher. The full run cost $0.34 with Jev and $28.17 with Claude Sonnet 4.6. The authors call the results "promising, but early" and "observational, not evidence", say the experiment "cannot tell us why Jev's scores varied less", and warn that "low cost can amplify mistakes" [9]. Five cases is a small set, and they say so.
Openlayer released jevals, an MIT-licensed library in alpha, which runs agent evals and guardrails as one Jev request per trace. On Openlayer's own benchmark, Ragas on GPT-4.1-mini used 6 language model calls plus embeddings per sample at $2.60 per 1,000 samples and 22 to 35 seconds for 20 samples; jevals on Jev used 1 request per sample at $0.03 per 1,000 and 0.8 seconds for 20 samples, with Jev latency at a median of 244 milliseconds and a 95th percentile of 371 milliseconds [10]. Browser-use built a browser agent on Jev that reads a structured element table instead of screenshots and decides the action and target in one request; on six alternating runs of one Google Flights task, the median fell from 9.45 seconds to 7.09 seconds and browser protocol calls from 1,092 to 101. Browser-use says that is three repeats of one task and no general benchmark. We covered both in AI News: jevals and Jev Ultrafast.
Where Reveneau fits
We generate all of our code, and a large eval suite written from the specification has to prove every change before it is released. Some of those checks have a deterministic answer: a test passes, a schema validates, a migration holds. Those never touch a model and never will. The rest used to need a language model as judge: does this change match the acceptance criterion as written, does this diff stay in scope, did the agent's trace follow the plan, does this generated text follow the instruction. Each of those is now a Noul or a Score question to Jev, with the rubric written into the criteria. A grade below the threshold fails the change. A grade in the uncertain band goes to a person, and that person's label is kept so we can re-check the grader later.
On our own suite, measured against our previous grader, the run is ten times faster. We will not attach a dollar figure or a defect rate to that, because we have not run the experiment that would let us say it, and a consultancy whose whole pitch is verification should not publish numbers it cannot show the working for. What we will say is what changed in practice: the grading step used to be the slowest part of the suite, and it is now one of the fastest, which means the suite runs more often and a failing change is caught sooner. How Reveneau uses Jev describes the setup in detail, evals with Jev is the how-to for your own suite, and eval-driven development is the practice it sits inside. If you are deciding whether a decision model belongs in your product, Jev in production covers the engineering and decision models for product teams covers the product side. If you want to talk it through, contact us.
The one-paragraph summary
Jev is a hosted model that answers fixed questions about text with calibrated probabilities, at $0.042 per million input tokens, in under half a second on TypeSafe's figures. It fits decisions whose answers are known in advance and repeat at volume, and it fails, in ways TypeSafe documents, at counting, comparing numbers, reading dates, handling negations, and anything that needs a sentence written. Use it for the fast decisions, keep a language model for the slow ones, keep deterministic checks deterministic, and set a different threshold for every action according to what a wrong answer costs.
Explore the guide
Start here
What is a System One model?
A System One model is a model that answers questions you wrote in advance and returns a probability for each possible answer, without generating any text. TypeSafe AI launched the first public one, Jev, on 15 September 2026 and opened access to everyone on 20 September. It fits tasks such as classifying, routing, scoring, extracting a label and choosing a branch. It cannot chat, write code or explain a decision. The output shape is what makes it faster and cheaper than a language model for the decisions it fits.
How Reveneau uses Jev
Reveneau writes 100 percent of its code with AI, and every change has to pass a large eval suite, written from the specification, before it is released. This month we moved the grader for the checks that need a judgment from a language model to Jev. Checks with a deterministic answer stay deterministic and never touch a model. Each judgment check is a Noul or Score question with the rubric written into the criteria. A grade below the threshold fails the change, the uncertain band goes to a person, and on our own suite the run is ten times faster than with the previous grader.
How it works
What Jev returns: Choice, Score and Noul
Jev answers three kinds of question. Choice picks one option from a list of up to 255 and returns a probability per option plus a confidence number. Score places the text on an ordered scale of 2 to 10 levels you describe in words and returns a probability-weighted value that can land between levels. Noul is a yes/no statement that returns a single probability from 0 to 1 with no separate confidence number. Each maps to a structure your code already has: a switch, a threshold, an if.
Calibrated probabilities and confidence, explained
A calibrated probability is one you can read as a frequency: when the model says 0.8, it should be right 8 times in 10 across many such answers. TypeSafe trains Jev for this with a method it calls Reinforcement Learning for Calibrated Decisions. Confidence is a separate number, for Choice and Score only, computed from how spread out the probabilities are. TypeSafe suggests acting automatically at 0.9 and above and routing to a person below 0.5, and says different actions in the same system should be gated at different levels depending on the consequences.
How to write the state and the questions
A Jev request has two parts: the state, which is the text the model reads, and the questions, which are what you ask about it. The state can be a string, a JSON object, or an array of text values, text only, up to 32k tokens inside a 64k-token request. The questions should each ask one thing, in one clause, with no negation, because TypeSafe documents that Jev answers the question you wrote rather than the one you meant. This page is the practical guide to both.
Many questions in one call: speculative fan-out
Every question in a Jev request is evaluated in parallel, and TypeSafe's docs state that adding questions barely changes the response time. Its batching cookbook measured 13 questions against the Wikipedia GDPR article on jev-1.12: one batched request cost $0.000497 and took 0.27 seconds, while 13 single requests cost $0.006090 and took 2.71 seconds. TypeSafe reports that as 12.2 times cheaper and 10.0 times faster, and says the answers did not depend on what else was in the request. This page explains the pattern, called speculative fan-out, and when it wastes tokens.
Limits and cost
Jev pricing, rate limits and context window
TypeSafe prices Jev at $0.042 per million input tokens, which is $42 per billion, and output tokens are free. A request may carry 64k tokens, of which the state plus the longest question may use 32k. Rate limits are 250,000 tokens per second and 1,200 requests per minute. The current model is jev-1.13.0, with jev-latest and jev-preview both pointing to it. TypeSafe itself says it cannot prove the price is unsubsidised, so compute any saving at today's price and plan for it to change.
Where Jev is weak: the jaggedness list
TypeSafe publishes a page for jev-1.13 listing where the model is unreliable, and it is the most useful page in the docs. In plain words: Jev answers the question you wrote rather than the one you meant; does not count reliably; cannot reliably compare two numbers; is weak at numerical calibration on Score levels; reads dates as text; handles double negatives less reliably; loses accuracy as the state fills with unrelated content; can be moved by hostile text in the state; and cannot generate text. This page gives each one and its mitigation.
Compared
Jev vs a language model: when to use which
Use Jev when the possible answers are known before the request is made and the decision repeats at volume. Use a language model when the answer needs a written reason, an option nobody listed, or any generated text. Most products need both, with Jev deciding and the language model writing. On TypeSafe's own workflows, Jev was 193.6 times faster and 444.6 times cheaper than GPT-5.6 Terra, and its accuracy was close to the mid-range language models and below the best ones. TypeSafe wrote those workflows, and this page says so each time it cites them.
Jev vs a fine-tuned classifier or a small model
Before Jev, the standard answer to a repeated classification problem was to train a small model on your own labelled data, and that is still the right answer in five cases: when you have a large volume of labelled examples, when the data may not leave your network, when the system must work offline, when the text is mostly outside English, and when the decision is numeric. Jev is a hosted API with English as its primary training language. The one comparison figure available is JevBench, cited in the jevals README at 83 to 87 percent on two intent-classification benchmarks.
Common questions
What is Jev in one sentence?
Jev is a hosted model from TypeSafe AI, launched 15 September 2026, that takes a piece of text plus a set of named questions and returns a probability for each possible answer instead of writing a reply. TypeSafe calls this a System One model. It fits decisions whose answers are known in advance, such as routing, classifying and scoring, and it cannot write text at all.
How is a System One model different from a language model?
A language model generates text one token at a time, so a decision has to be written out and then parsed, which takes seconds and can come back in the wrong shape. A System One model returns a typed answer with probabilities for a question you wrote in advance. TypeSafe reports 70 to 500 milliseconds end to end and 0 percent structured-output errors on its own workflows, against 3 to 329 seconds for the language models it compared.
What does Jev cost?
TypeSafe prices Jev at $0.042 per million input tokens, and output tokens are free. A request of 10,000 tokens therefore costs $0.00042, and a million such requests cost $420. TypeSafe itself says it cannot prove the price is unsubsidised, as MarkTechPost reported on 19 September 2026, so compute any saving at today's price and plan for the number to move.
What are the three question types?
Choice picks one of up to 255 options and returns a probability per option plus a confidence number. Score places the text on an ordered scale of 2 to 10 levels you describe in words, and returns an expected value that can land between levels. Noul is a yes/no statement that returns one probability from 0 to 1 with no separate confidence number. Each maps to a switch, a threshold, or an if in your code.
What does calibrated mean for a probability?
A calibrated probability is one you can read as a frequency: when the model says 0.8, it should be right 8 times in 10 across many such answers. TypeSafe trains for this with a method it names Reinforcement Learning for Calibrated Decisions. The practical use is a threshold: act automatically above one value, send to a person below another, and set a stricter value for any action that is expensive to undo.
Can Jev hallucinate?
TypeSafe's phrase is that Jev cannot hallucinate, and what it means is that the answer always matches the schema you asked for, with 0 percent structured-output errors on TypeSafe's own evaluation. The answer can still be wrong. On the same evaluation, as DataCamp reports, Jev agreed with the reference answer 67.8 percent of the time, so a well-formed answer and a correct answer are different things, and a threshold is still needed.
Where does Jev fail?
TypeSafe's jaggedness page for jev-1.13 lists nine weaknesses: literal reading of the question, unreliable counting, unreliable numeric comparison, weak numerical calibration on Score levels, dates read as text, double negatives, accuracy loss when the state carries unrelated content, hostile text in the state moving the answer, and no text generation. The fix for most is the same: do the arithmetic in code and put the result in the state as a plain fact.
When should a team use a language model instead of Jev?
Use a language model when the answer needs a written reason, when the right option might be one nobody listed, or when the output is text a person will read. Use Jev when the set of answers is known before the request and the decision repeats at volume. Many features need both: Jev decides which branch to take in under half a second, and the language model writes the reply only on the branches that need one.
Should a team train its own classifier instead?
Train your own model when you have a large set of labelled examples, when the data may not leave your network, when the system must work offline, when the text is mostly outside English, or when the decision is numeric. Jev is a hosted API with English as its primary training language. The only comparison figure available is JevBench, cited in the jevals README at 83 to 87 percent on Banking77 and CLINC150, both intent-classification benchmarks.
How many questions can go in one request?
Every question in a request is evaluated in parallel, and the docs state that adding questions barely changes the response time. TypeSafe's cookbook measured 13 questions against a 53,777-character article on jev-1.12: one batched request cost $0.000497 and took 0.27 seconds, while 13 single requests cost $0.006090 and took 2.71 seconds. The limit is the 64k-token request, of which the state plus the longest question may use 32k.
What did independent teams find when they built on Jev?
LangChain ran five weather-agent cases 100 times per judge and found Jev agreed with the human reference 100 percent of the time on the pass question, at $0.34 for the run against $28.17 with Claude Sonnet 4.6, while calling the result observational and early. Openlayer's jevals measured Jev at a median of 244 milliseconds per request. Browser-use cut one Google Flights task from 9.45 to 7.09 seconds median over six runs.
How does Reveneau use Jev?
Reveneau writes all of its code with AI and gates every change with an eval suite written from the specification. Checks with a deterministic answer stay deterministic. The checks that used to need a language model judge, such as whether a diff matches an acceptance criterion or stays in scope, are now Noul or Score questions to Jev with the rubric in the criteria. On our own suite the run is ten times faster than with the previous grader.
References
- [1] TypeSafe AI, Introducing System One models and Jev (15 September 2026): "a new class of frontier models built to make fast, structured decisions that software can use directly"; 70 to 500 ms end to end against 3 to 329 seconds for frontier LLMs; "40x-200x faster"; training method named as Reinforcement Learning for Calibrated Decisions (RLCD).
- [2] TypeSafe docs, System One concept: input is a state (string, JSON object, or array of text values; text only) plus a map of named questions; output is a typed answer per question with probabilities; the model does not generate text.
- [3] TypeSafe docs, Models: $0.042 per million input tokens, output free; jev-1.13.0 released 15 September 2026, aliases jev-latest and jev-preview; 64k tokens per request, 32k for the state plus the longest question; 250,000 tokens per second and 1,200 requests per minute; English the primary training language.
- [4] TypeSafe docs, Confidence: a single number from 0 to 1; for three options (3 x largest probability - 1) / 2; 0.9 and above "Act automatically", below 0.5 "Route to a human, request clarification, or fall back to a different system"; "Different actions within the same system should be gated at different levels depending on the consequences."
- [5] TypeSafe docs, Parallel questions cookbook: 13 questions against the 53,777-character Wikipedia GDPR article on jev-1.12, five repeats; batched $0.000497 and 0.27 s, thirteen single calls $0.006090 and 2.71 s; "12.2x cheaper, 10.0x faster"; standard deviation 0.0 across repeats for 11 of 13 questions.
- [6] TypeSafe docs, Model jaggedness for jev-1.13: "answers the question you wrote, not the one you meant"; "does not count reliably"; cannot reliably judge whether two numeric values are near each other; Score levels "are weak in numerical calibration"; "reads dates as text, not as ordered quantities"; accuracy falls with unrelated content; adversarial content "can move the answer".
- [7] MarkTechPost, TypeSafe AI releases Jev (19 September 2026, Asif Razzaq): Jev 0.114 s and $0.000081 against GPT-5.6 Terra 8.566 s and $0.013880, reported by TypeSafe as "193.6x faster and 444.6x cheaper"; workflows written by TypeSafe's own capabilities team; TypeSafe says it cannot prove the price is unsubsidised; architecture undisclosed.
- [8] DataCamp, Jev: TypeSafe's System One model explained: TypeSafe workflow evaluation with Jev at 67.8% agreement against GPT-5.6 Terra 67.9%, GPT-5.6 Sol 74.1%, Claude Opus 5 73.1%; 0% structured-output errors for Jev against 45.5% for Claude Haiku 4.5. The workflows are TypeSafe's own.
- [9] LangChain, Can Jev be a better agent evaluator? (20 September 2026, Daniel Shea and Sean Roche): five weather-agent cases, 100 repetitions per judge per case; does_pass agreement Jev 100%, GPT-5.6 Terra 99.8%, GPT-5.6 Luna 96.4%, Claude Sonnet 4.6 80.0%; Jev variance 0.0000149; run cost $0.34 with Jev against $28.17 with Claude Sonnet 4.6; "promising, but early", "observational, not evidence".
- [10] Openlayer, jevals README (MIT, alpha, 20 September 2026): one Jev request per trace; Ragas on GPT-4.1-mini $2.60 per 1,000 samples and 22 to 35 s for 20 samples against jevals $0.03 per 1,000 and 0.8 s; Jev p50 244 ms, p95 371 ms; 37 built-in evals; cites JevBench at 83 to 87% on Banking77 and CLINC150.
- [11] systemonemodels.org, Jev model page (states it is not affiliated with TypeSafe): waitlist removed on 20 September 2026, sign-up open at console.typesafe.ai.
- [12] Browser-use, Jev Ultrafast (16 September 2026): six alternating runs of one Google Flights task, median 9.45 s to 7.09 s, browser protocol calls 1,092 to 101; described by Browser-use as three repeats of one task and no general benchmark.
- [13] TypeSafe docs, Choice primitive: pick one of up to 255 options; returns the choice, a probability per option, and a confidence number.
- [14] TypeSafe docs, How to build with System One: "Keep control flow, deterministic rules, and side effects in code"; break a broad judgment into atomic questions asked in parallel and combine them in code; named anti-patterns include broad questions such as "Is this spam?" and hidden context.
- [15] TypeSafe docs, Introduction: every question in a request is evaluated in parallel; "Adding questions barely changes the response time."
- [16] TypeSafe docs, Coding agents: Jev "is not a drop-in replacement" for the LLM running a coding agent; used inside the application for routing, rubric scoring, and statement verification.
Related reading
Adding eval tests was the best decision we made
We generate every line of code we release. The single change that made that safe was writing the check before the code, and it turned out to change how we review, how we spec, and how fast we can work.
AI evaluation and guardrails for production: how to know your AI actually works
"It seems to work" is not a production standard. Here is how we turn that feeling into a number, and how we stop the system from doing damage on the days the number is bad.
How to evaluate a vendor's eval suite
"We test everything" means nothing until you know who wrote the tests, what they check, and who is allowed to grade them.
Can you trust an AI agent with real work yet?
An agent that answers a question and an agent that takes an action are not the same risk. Here is how we decide where an agent is ready to act, and where it is not.
Our eval suite now runs ten times faster. Here is what we changed.
This month we replaced the language model that graded the judged checks in our eval suite with Jev. The deterministic checks did not move, every rubric is now written inside the check, and the suite runs ten times faster.
How to tell a System One task from a System Two task
If the possible answers can be written down before you ask, the task repeats at volume, and nobody needs a written reason, a fast decision model can do it. Everything else needs a language model or a person. Here is the rule, with three features walked through it.