Wrangle's chart prints 137.3 perfect matches per 200 with Jev

This topic was created 8 days ago, and the information it contains may have evolved or changed since then.

John Crown's WrangleBench chart prints 137.3 perfect matches per 200 with Jev and 105.1 without, and the post calls that a 30.64 percent gain.

John Crown posted a chart on September 30, 2026. He is a co-founder of Wrangle. The title on the image is WrangleBench. The axis is perfect matches per 200.

The green bar, labeled “Wrangle, with Jev,” reads 137.3. The gray bar, “Wrangle, no Jev,” reads 105.1.

What the post adds

Crown writes that the gap is a 30.64 percent gain, and that the Jev ranker ran at 75 percent of the previous reranking cost. He says most recruiting benchmarks score precision on about 10 candidates, while a real search may have to look through hundreds. The full benchmark, he says, is still to come.

The chart does not name the previous ranker, the number of searches behind the two averages, or what counts as a perfect match. 137.3 has a decimal, so the bar is an average across searches. The post does not say how many.

TypeSafe quoted the post on October 1. The quote repeats those two percentages. It does not add a third number. The thread says Wrangle is working with Dae, @mathfax, and TypeSafe on more product features. Dae’s reply is the word “Huge.”

This site's reading

Editorial notes evaluating claims against primary sources, contextualizing findings alongside related implementations, and defining technical terms.

Verify

John Crown, @johncrown, co-founder of Wrangle, September 30, 2026, 19:46 UTC, status 2105383804936626365. The attached chart is titled WrangleBench. The axis is perfect matches per 200. With Jev the bar is 137.3. Without Jev it is 105.1. That image is the card saved for this page.

The post says the change is a 30.64 percent gain in matches, at 75 percent of the previous reranking cost, on searches recruiters actually run. It says the full benchmark will be released later. The chart does not print a price, a query count, or the name of the previous ranker.

TypeSafe, status 2105741653701242938, quotes the post on October 1 and adds no other figure. We did not rerun the searches.

Compare

137.3 and 105.1 are the whole printed comparison. jevsearch scores Hit@1 on 41 labelled TypeSafe-docs queries. JEV Search scores nDCG@10 on NFCorpus and SciFact. This chart uses neither metric.

The post's 75 percent cost line has no dollar amount next to it. MotherDuck's published table is a different task, SQL over AG News, and it does print a bill.

Terms

WrangleBench: John Crown's chart of perfect matches per 200. The printed bars are 137.3 with Jev and 105.1 without. The post says the full benchmark is still to come.