arlen/benchOpen benchmarks for agentic consumers
SNAPSHOT web_search-2026-q3
11 JUN 2026 · BERKELEY, CA
Head-to-Head · Illustrative prototype

Exa vs Tavily

Exa versus Tavily for AI agents — hit@k accuracy, freshness lag, cost per verified-correct answer, and agent-readiness, scored against golden truth.

Answer firstillustrative

On the illustrative web_search-2026-q3 snapshot, Exa wins more head-to-head metrics (3 of 6). Exa leads on accuracy; compare cost per verified-correct answer and freshness below.

§ 01

Head to Head — Web Search

snapshot web_search-2026-q3
Metric ExaTavilyWinner
hit@1 %71.268.4Exa
hit@5 %87.684.0Exa
fresh<30d %81.086.4Tavily
retrievability h11.27.8Tavily
cost/correct $$0.0064$0.0059Tavily
p50 latency ms412688Exa
§ 02

Head to Head — Web Extraction

snapshot web_extraction-2026-q2
Metric ExaTavilyWinner
fidelity 0-10.740.79Tavily
JS gap Δ0.220.18Tavily
block rate %8.87.6Tavily
cost/correct $$0.0058$0.0044Tavily
schema validity %84.0Exa
§ 03

Which Should an Agent Pick?

For accuracy-first agent workloads, the higher hit@5 vendor wins; for cost-sensitive high-volume use, prefer the lower cost-per-correct vendor. Both Exa and Tavily should be evaluated on your own query mix — these are illustrative prototype figures.

Illustrative prototype. No verified vendor run has been published yet; every figure here is a placeholder and must not be cited as a measured result. Numbers are replaced when a snapshot’s first full run lands.