Models & agents

Laya is a new open-source decision model that ConvAI says runs 7.8 times faster than Jev on the same tests

September 19, 2026 at 8:20 AM PT

GitHub social card for the NandhaKishorM/laya repository

Image: GitHub

Why it mattersTeams routing emails, filtering spam, or scoring RAG passages can now try a self-hosted classifier that publishes latency and accuracy numbers against Jev, instead of paying per token to a closed API.

ConvAI Innovations released Laya on 2026-09-18, an Apache-2.0 decision model that outputs a calibrated probability over a fixed schema instead of generating text. The company positions it as an open-source alternative to TypeSafe's Jev, and the GitHub repository at NandhaKishorM/laya has gained 713 stars in one day. The Show HN thread reached 360 points in about four hours.

What it does

Laya answers three shapes of question: pick one option from a list, score something on a scale, and answer yes or no with a probability. ConvAI calls these choice, score, and noul. The example use cases named on the product page are email spam filtering, phishing detection, jailbreak detection, guardrails around another model, RAG passage relevance, support ticket routing, and invoice processing. Because the output is a probability over the schema you define at call time, the model cannot return anything outside that schema, and ConvAI writes that "hallucination is not possible" by construction.

What the numbers say

ConvAI publishes a benchmark table on the product page comparing Laya with Jev directly. On its own typed-decisions benchmark, ConvAI reports Laya at 0.766 accuracy against Jev at 0.727. On AG News four-way classification it reports 0.950 against Jev's 0.910. On expected calibration error the reported numbers are 0.081 for Laya and 0.246 for Jev, and on median latency the page reports 32.8 milliseconds for Laya against 236 to 276 milliseconds for Jev on the same hardware. The multilingual sweep is described as 45 of 51 languages exceeding three times the random baseline. Every one of those figures is ConvAI's own, and none has been reproduced by an independent party yet.

How it is distributed

Laya is Apache-2.0 licensed, and the model weights, training datasets, and inference code are all in the public repository. Self-hosting is the intended path: ConvAI states there is no per-token cost, against Jev's API price. A hosted endpoint is offered as an alternative.

The founder, Nandakishor Mukkunnoth, published the initial research in March 2025 under the name "Latent Attention Encoder", and the September 2026 release is the productised version of that architecture. The architecture is a bidirectional encoder that runs the whole input in one forward pass, which is what allows the single-pass classification and the sub-35ms latency claim.

Every number on the comparison page came from ConvAI itself, so a team currently paying per token for a closed classifier should test Laya on its own workload before drawing a conclusion.

Source

Source: ConvAI Innovations

This item was written by an AI system from the linked source. Reveneau is responsible for what it publishes.

More from AI News

TypeSafe AI released Jev, a model that returns only typed structured values and cannot hallucinate

TypeSafe AI launched publicly on 15 September and released Jev, its first System One Model. Jev returns only typed structured values, samples every output in parallel, and, by construction, cannot make a type error or hallucinate a field.

Source: PressModels & agents

Nvidia says a 30B Nemotron fine-tuned on its supply-chain data scored 86.7 percent, versus 55.5 for the 550B Nemotron

Nvidia and Palantir fine-tuned a 30B Nemotron 3.5 Lightning on Nvidia's own supply-chain decisions and, according to Nvidia, it scored 86.7 percent on the internal allocation task versus 55.5 for the 550B Nemotron 3 Ultra, a model 18 times its size.

Source: PressModels & agents

Hugo Vergnes trained a 3.8B language model to 0.384 on CORE for $998 in 43 hours

Solo engineer Hugo Vergnes trained a 3.8B-parameter language model on 65B tokens in 43 hours for $998, scoring 0.384 on the CORE benchmark and beating OpenAI's 2019 GPT-2 1.5B by a wide margin.

Source: Hacker NewsModels & agents