THX-01 averages 98.4 on its 2,843 support tickets

This topic was created 19 days ago, and the information it contains may have evolved or changed since then.

HAL-X's THX-01 card averages 98.4 on 2,843 support tickets, against Jev 1.13 at 97.4 on the same four sets. Number lookup on a different set is 93.4, and Jev on that line is 96.6. The card says 322M parameters, Apache 2.0, on mmBERT-base. The October 11 post calls the API free. The docs page we opened does not print a price. We did not call the API.

doofz posted THX-01 on October 11, 2026, at 10:23 UTC. The text says the model has 322 million parameters, beats Jev on some benchmarks, runs locally on a phone, and now has a free API. It links doofz/THX-01, the docs at api.hal-x.ai, and pip install thx01. The share image is the still on that post. An earlier post from the same account named the model before the card was opened.

The card says THX-01 is a non-autoregressive decision model from HAL-X AI. A state and one or more typed questions come back in one forward pass, about 10 ms on one GPU. The parameter line is 322M, with 307M in the encoder and 15M in the decision head. The encoder is mmBERT-base, 22 layers, a 256k vocabulary. Input is capped at 1,024 tokens per question, and longer states are truncated. License is Apache 2.0. The citation names Farid Aghayev and Elturan Ahmadbayli. Post-training is described as eight RLCD stages and about 2.1 million decisions, with Azerbaijani the largest language in the synthetic data. The card lists 18 post-training languages and says the encoder covers more than 100.

Question types on the card are choice, noul, and score, plus number, excerpt, and a cite flag. The card says number, excerpt, and citations are not TypeSafe question types. Number returns a value written in the document, or null when it is not stated, and the card says it does not convert units or currencies. Excerpt is cut from the document with character offsets.

The support-ticket table is fifteen categories and four sets, 2,843 tickets in Azerbaijani, Russian, English, and Turkish. Independent is described as written by GPT-6-Luna and kept out of training. Claude Sonnet 5.5 is marked as a stratified subset of 200 tickets per set.

ModelCleanCorruptedMessyIndependentAverageECELatency
THX-0199.297.798.897.998.40.003about 10 ms
Claude Sonnet 5.598.598.098.599.098.51.5 s
Wahoo 1.599.896.398.097.297.8145 ms
GPT-6-Luna98.697.496.798.297.71.9 s
Jev 1.1399.295.096.299.097.40.007331 ms
Kev-4B96.188.490.895.892.80.202830 ms

The card says ECE is measured on the Independent set, and that the LLMs return no probabilities. THX-01’s latency is on one GPU. The other clocks are through APIs. A later sentence says the model handles about three quarters of the tickets with no error on any of the four sets, and 90% of tickets at an accuracy of at least 99.5%. Those coverage lines are the card’s operating-point claim, not a second accuracy table.

Extraction is a different set: 1,824 number questions and 1,357 excerpt questions. Number lookup moves from 69.6 on the previous checkpoint to 93.4. The card says Jev 1.13 reaches 96.6 on number lookup over the same documents. Excerpt F1 is 84.1. Citation accuracy is 94.0. The 39-task suite mean is 84.2, with mean ECE 0.066. Banking77 inside that suite is 65.9, ECE 0.087. DAIR Emotion is 44.6. That Banking77 cell is not Cloudflare’s macro-F1 of 94.8 and not Bespoke Nimble’s 292 of 324.

The docs page documents POST https://api.hal-x.ai/v1/systemone, alias POST /v1/decide, model thx-01. A sample response on that page shows output_tokens at 0, a billing choice at probability 0.5239 beside refund at 0.4735, and latency_ms 22.94. The page does not print a price. The October 11 post calls the API free. Context on the docs page matches the card’s 1,024 tokens per question. Batch size is 1,024 items. Questions with more than 24 options use a two-round tournament. We did not call the API, and we did not run the weights.

This site's reading

Editorial notes evaluating claims against primary sources, contextualizing findings alongside related implementations, and defining technical terms.

Verify

doofz, @reversedoofz, October 11, 2026, 10:23 UTC, status 2109228322752471304. The text says THX-01 has 322M parameters, beats Jev on some benchmarks, runs on a phone, and has a free API. It links the Hugging Face card, https://api.hal-x.ai/docs/thx-01/, and pip install thx01. The share image is the still on that post. An earlier post from the same account, 2109005792246657448, named the model before this card was opened.

The card, opened the same day, says 322M parameters, 307M in an mmBERT-base encoder and 15M in the decision head, Apache 2.0, input capped at 1,024 tokens per question. The support-ticket table is 2,843 tickets in Azerbaijani, Russian, English, and Turkish, four sets. THX-01 averages 98.4, ECE 0.003, about 10 ms. Jev 1.13 on that table averages 97.4, ECE 0.007, 331 ms. Claude Sonnet 5.5 is marked as a 200-ticket subset per set.

Number lookup on the extraction table is 93.4 for THX-01. The card says Jev 1.13 reaches 96.6 on number lookup over the same documents. Banking77 inside the 39-task suite is 65.9. The docs page at https://api.hal-x.ai/docs/thx-01/ documents POST https://api.hal-x.ai/v1/systemone and model thx-01. That page does not print a price. The citation names Farid Aghayev and Elturan Ahmadbayli at HAL-X AI. We did not call the API or run the weights.

Compare

98.4 and 97.4 are the four-set averages on the card's support-ticket table, 2,843 tickets, fifteen categories. ECE 0.003 and 0.007, and the 10 ms and 331 ms clocks, are columns on that table. Claude's 98.5 is marked as a subset of 200 tickets per set.

Number lookup 93.4 against Jev at 96.6 is the extraction section. Banking77 at 65.9 is one row of the 39-task suite. Clef-omni's BANKING77 macro-F1 of 94.8 is Cloudflare's ten-row table. Bespoke Nimble's 292 of 324 is the synthetic holdout.

Terms

THX-01
HAL-X's 322M decision model, Apache 2.0, on mmBERT-base. The card's support-ticket average is 98.4 against Jev 1.13 at 97.4 on 2,843 tickets.
THX-01 API
The docs page names POST https://api.hal-x.ai/v1/systemone and model thx-01. The October 11 post calls the API free. The docs page we opened does not print a price.
THX-01 number and excerpt
The card's question types add number, excerpt, and cite beside choice, noul, and score. Number lookup on the card is 93.4. Jev 1.13 on that line is 96.6.

Sources

  1. doofz, October 11
  2. Earlier THX-01 post
  3. doofz/THX-01
  4. HAL-X API docs