Published
Updated
Quyet-1.0-Large's homepage prints JevBench v1.6.0 at 71.39
This topic was created 19 days ago, and the information it contains may have evolved or changed since then.
Quyet-1.0-Large's homepage prints JevBench v1.6.0 official score 71.39, rank 1 of 92, and Capability 81.7. The card says Apache-2.0, 31.3B, from Gemma 4 31B. A later reading on this site still lists Capability 81.7 and official composite rank 3. We did not run the weights.
Florian S posted on October 5, 2026, at 15:09 UTC, that JevBench v1.6.0 was live. Capability rank 1 in that post is Quyet-1.0-Large at 81.7, ahead of deck-31B at 77.6 and Jev 1.13.0 at 76.5. The post says both models ahead of Jev are Gemma 4 checkpoints with open weights.
The homepage, opened October 12, prints a frozen v1.6.0 table and links benchmarkheaven.com/jev-models/v1.6.0. We did not reopen that file. The table says the release scored 1,624 decisions, open and sealed, across 92 systems.
| System | Official score | Rank | Capability | Intelligence | Calibration | $ / 1,000 |
|---|---|---|---|---|---|---|
| Quyet-1.0-Large | 71.39 | 1 | 81.7 | 73.4 | 90.0 | 0.045 |
| Jev 1.13 | 71.09 | 2 | 76.5 | 62.4 | 90.6 | 0.032 |
| Clef | 16.75 | 43 | 75.3 | 59.1 | 91.6 | 0.249 |
| decider-35b-a3b | 24.77 | 29 | 66.2 | 48.7 | 83.6 | 0.154 |
| decider-4b | 41.24 | 17 | 64.9 | 40.1 | 89.6 | 0.015 |
The homepage says Capability is the mean of Intelligence and Calibration, ranked among systems at most twice Jev’s cost and latency. deck-31B at 77.6 is the October 5 post. It is not a row in the homepage table we copied.
Later readings on this site stay on their own revisions. The October 8 open-weights list still leads with Capability 81.7, and the rank line says official composite 3. H2O’s October 7 blog prints composite 71.4 for Quyet-1.0-Large on revision v1.7.17, behind H2O-Lightning-4B at 72.5 and the Jev reference at 71.5. v1.6.1 on the JevBench page scores 1,500 decisions. Jev’s capability on that later board is 77.1. The frozen table’s 76.5 is the v1.6.0 cell.
Microsoft-Decision-1 says it was 4.5 times quicker than Quyet-1.0-Large. That post does not print an accuracy, and the appendix does not name Jev. The speed line is Microsoft’s comparison.
Quyet is Chinh Nguyen’s family of decision models. A state and one or more typed questions come back as a probability over the options the caller supplied. The README says the answers follow the TypeSafe /v1/systemone shape: choice, score, and noul. The package is pip install quyet. License on the Large card is Apache-2.0, and the card says a NOTICE file has to stay with a redistribution. The text is tuned for English and Vietnamese. Small-EN is English only.
| Checkpoint | README parameters | Homepage line |
|---|---|---|
| Large | 31.3B, 30.7B text | Gemma 4 31B, 80 GB GPU |
| Medium | 4.66B, 4.21B text | Qwen3.5 4B, 4.7B, 16 GB GPU |
| Small | 328M | Encoder, 330M |
| Small-EN | 153M | Encoder, 150M |
| Tiny | 183M | Encoder, 180M, 6 ms |
The Large card says the checkpoint is Gemma-4-31B-it with a merged LoRA of rank 16, read out from the next-token probabilities of the option letters. Weights are 62.5 GB in bf16. The state is capped at 6,000 tokens inside an 8,000-token prompt. A question takes at most 10 options. Prompt version 2 drops a system message and a closing line, and the card says that cuts about 68 input tokens. Temperatures were refit for that prompt. The card says one 80 GB GPU runs bf16, or several GPUs with device_map="auto".
The Small card says the encoder is aisingapore/SEA-LION-ModernBERT-300M plus a two-layer head, 328M parameters, input 8,192 tokens, 1.31 GB in F32, Apache-2.0. The homepage’s 330M is the rounded cell.
The homepage names a hosted listing of Large at FPT AI. That page was not opened, and it is not a row in the catalog here. The homepage’s demo box was not submitted. We did not run the weights.
This site's reading
Editorial notes evaluating claims against primary sources, contextualizing findings alongside related implementations, and defining technical terms.
Verify
Florian S, @airesearch12, October 5, 2026, 15:09 UTC, status 2107125940794880220. The text says JevBench v1.6.0 is live and that Capability rank 1 is Quyet-1.0-Large at 81.7, ahead of deck-31B at 77.6 and Jev 1.13.0 at 76.5. The homepage at quyet.ai, opened October 12, prints a frozen v1.6.0 table and links benchmarkheaven.com/jev-models/v1.6.0. We did not reopen that frozen file.
The homepage table lists Quyet-1.0-Large at official score 71.39, rank 1 of 92, Capability 81.7, Intelligence 73.4, Calibration 90.0, and $0.045 per 1,000 decisions. Jev 1.13 on that table is 71.09, rank 2, Capability 76.5, Intelligence 62.4, Calibration 90.6, and $0.032. The page says the release scored 1,624 decisions. This site's later reading of v1.6.1 scores 1,500. The October 8 open-weights rank line still says Capability 81.7 and official composite 3. H2O's October 7 blog prints composite 71.4 for Quyet on revision v1.7.17.
The Large card says Apache-2.0, Chinh Nguyen, Gemma-4-31B-it with a merged rank-16 LoRA, 31.3B parameters of which 30.7B are text, 62.5 GB in bf16, and a state cap of 6,000 tokens inside an 8,000-token prompt. At most 10 options. The README lists five sizes. The homepage names an FPT AI listing. We did not open that marketplace page, and we did not run the weights.
Compare
71.39 and rank 1 of 92 are the homepage's frozen v1.6.0 cells. Capability 81.7, Intelligence 73.4, and Calibration 90.0 are on that table and still match the October 8 capability card. Official composite rank 3 is the later rank line. H2O's 71.4 is revision v1.7.17. Jev's 76.5 on the frozen table is not the v1.6.1 capability 77.1. The homepage's 1,624 decisions are not v1.6.1's 1,500.
deck-31B at 77.6 is Florian's October 5 post. Microsoft's 4.5 times line is a speed comparison on the Command Line post, and that post does not print an accuracy. Those are different tests.
Terms
- Quyet 1.0
- Chinh Nguyen's family of decision models. Large is a Gemma 4 31B checkpoint, Apache-2.0. The homepage's frozen JevBench v1.6.0 cell is official score 71.39 and Capability 81.7.
- Quyet sizes
- The README lists Large 31.3B, Medium 4.66B, Small 328M, Small-EN 153M, and Tiny 183M. The homepage rounds Medium, Small, Small-EN, and Tiny to 4.7B, 330M, 150M, and 180M.
- Quyet v1.6.0 and later boards
- The homepage's rank 1 is frozen v1.6.0. The October 8 open-weights rank line says official composite 3 at the same Capability 81.7. H2O's October 7 composite for Quyet is 71.4.