Updated

Published

dejevu books the same Flights search faster than the published Jev demo, on another machine

Idov Mamane posted dejevu, an MIT browser loop that sends one JSON action to an ordinary chat model. On the README's table, llama-3.3-70b on Groq finishes the Flights check in 5.63 seconds against jev-ultrafast's published 7.09 seconds. The Jev column was not rerun here. That Groq route costs more per run.

Idov Mamane posted idovmamane/dejevu on September 22. The post says Browser Use plus Jev booked Google Flights in 7.1 seconds, and dejevu plus plain Llama 3.3 70B did it in 5.6 seconds, with 10 model calls against 17 and 5.6 times fewer tokens. Traces are in the repo. The license is MIT.

The task is the one from browser-use/jev-ultrafast: one-way Zurich to London on a Sunday, one adult, economy, stop when results are visible. dejevu asks an ordinary chat model for one JSON object, op, target, text, option, and key. The model names an element number. The page resolves the node. A separate text model is not in the loop. Done is accepted only on a settled page, and code checks the final page. The README says the model saying it is finished does not count.

The flights table is a median of verified runs. jev-ultrafast with Jev 1.13 plus Mercury 2.5, marked published: 3 of 3, 7.09 seconds, 17 calls, 13 actions, 84,650 input tokens, about $0.0036 at list price. dejevu with llama-3.3-70b on Groq: 3 of 3, 5.63 seconds, 10 calls, 9 actions, 15,071 input tokens, $0.0092. gpt-oss-120b on Cerebras passed 1 of 2 at 7.92 seconds. The same Llama on DeepInfra passed 2 of 2 at 37.5 seconds and $0.0020. gpt-oss-20b on Groq passed 1 of 4. gemini-2.5-flash, gemini-2.5-flash-lite, qwen3-next-80b, deepseek-v3.1, and gpt-4.1-nano show zero verified flights runs, mostly by stopping inside the calendar or looping.

Wikipedia, from the main page to the Gödel incompleteness article, is a second table. The published jev-ultrafast cell is 2.80 seconds, and the verified count is blank. llama-3.3-70b on Groq is 3 of 3 at 1.31 seconds, two calls, one action, 4,033 tokens, $0.0024. Several other chat models also finish that task in two calls. Three hold-out tasks, added after the harness was tuned, are described as 18 verified runs out of 18 across three models and two runs each.

Three clocks sit next to each other in the repo. The table median is 5.63 seconds against 7.09. A side-by-side video freezes the counters at 7073 ms and 6070 ms, using jev-ultrafast’s docs/demo.mp4 on the left, cropped, with a counter overlay. A GIF caption says 6.07 seconds. The README says the Jev numbers were measured on that project’s machine and Chrome profile. dejevu’s runs are from September 22 on a MacBook Pro M3 Pro, headless Chrome 153, through OpenRouter. September 20 has passed, so the search date in this repo is Sunday, October 18, 2026. A fresh profile hits Google’s consent page first. The agent dismisses it, and the clock starts on the Flights page, which the README says is the same boundary jev-ultrafast uses.

The README also says what the speed does to the bill. dejevu sends about 5.6 times fewer tokens. Jev’s list price in that note is $0.042 per million. Groq at $0.59 per million makes the Flights run about 2.5 times Jev’s price. The break-even it prints is a provider at $0.24 per million for the same 70B model. DeepInfra at $0.10 per million was cheaper than Jev on the two passing runs and took 37.5 seconds. TypeSafePolicy can replay the Jev arrangement on the same machine with --backend typesafe. The README says that path is untested because no TypeSafe key was available.

Offline tests in the README: 45 pytest cases with no browser and no paid calls, and 18 browser checks with no model calls. The limits section says three runs per cell show a difference and are not a benchmark, the harness was tuned on llama-3.3-70b, and two websites plus a local fixture do not establish general reliability. We did not run it.

The flights story on this desk is the earlier clip: about seven seconds and $0.0039, with Jev choosing the action and the target. dejevu’s comparison uses the published side of that demo and a new date, a new machine, and a chat model that returns the whole action in one object.

This site's reading

Editorial notes evaluating claims against primary sources, contextualizing findings alongside related implementations, and defining technical terms.

Verify

Primary post is @idovmamane, September 22, 2026, 13:04 UTC. It says Browser Use plus Jev booked Google Flights in 7.1 seconds, dejevu plus Llama 3.3 70B in 5.6 seconds, 10 model calls against 17, and 5.6 times fewer tokens. The repo is idovmamane/dejevu, MIT, Python 3.12. The README table, median of verified runs: jev-ultrafast with Jev 1.13 plus Mercury 2.5, published, 3 of 3, 7.09 s, 17 calls, 13 actions, 84,650 input tokens, about $0.0036 at list price; dejevu with llama-3.3-70b on Groq, 3 of 3, 5.63 s, 10 calls, 9 actions, 15,071 input tokens, $0.0092. Other dejevu rows: gpt-oss-120b on Cerebras 1 of 2 at 7.92 s; llama-3.3-70b on DeepInfra 2 of 2 at 37.5 s and $0.0020; gpt-oss-20b on Groq 1 of 4 at 11.5 s. gemini-2.5-flash, gemini-2.5-flash-lite, qwen3-next-80b, deepseek-v3.1, and gpt-4.1-nano have a verified count of 0 on that task. Wikipedia, exact article URL: published jev-ultrafast 2.80 s with the verified cell empty; llama-3.3-70b on Groq 3 of 3 at 1.31 s, 2 calls, 4,033 tokens, $0.0024. A race video overlay freezes at 7073 ms against 6070 ms. A GIF caption says 6.07 s. Measured 2026-09-22 on a MacBook Pro M3 Pro, headless Chrome 153, models through OpenRouter. The README says the Jev numbers are jev-ultrafast's own published measurements, the original task date of September 20 has passed, and this repo searches Sunday October 18 2026. The clock starts on the Flights page after a fresh profile dismisses Google's consent page. TypeSafePolicy is in the repo and untested, because no TypeSafe key was available. Offline pytest count in the README is 45. check_browser.py is 18 checks with no model calls. We did not run the agent.

Compare

The flights story on this desk cites jev-ultrafast at about 7 seconds and $0.0039 in the original clip. This README's published Jev cell is 7.09 seconds and about $0.0036, and its Groq cell is 5.63 seconds at $0.0092. Stagehand's Jeong post was $0.001 and near-instant, on a different site. The token cut is 84,650 to 15,071. The README says Groq at $0.59 per million makes the Flights run about 2.5 times Jev's list price, and that break-even for the same model is a provider at $0.24 per million.

Terms

verified run
In dejevu, a run counts only when code checks the final page. The README says the model announcing that it is done is not the check. Flights must show results. Wikipedia must land on the exact article URL.
settle
After each action, dejevu waits until the DOM is quiet and the requests that action started have finished, with a cap per action type. The README contrasts that with fixed waits, and says jev-ultrafast discards 4 to 6 of 17 calls because the page changed under them.

Sources

  1. Idov Mamane on X
  2. idovmamane/dejevu
  3. browser-use/jev-ultrafast