arlen/benchOpen benchmarks for agentic consumers
SNAPSHOT web_search-2026-q3
11 JUN 2026 · BERKELEY, CA
Head-to-Head · Illustrative prototype

Tavily vs Serper

Tavily versus Serper for AI agents — hit@k accuracy, freshness lag, cost per verified-correct answer, and agent-readiness, scored against golden truth.

Answer firstillustrative

On the illustrative web_search-2026-q3 snapshot, Tavily wins more head-to-head metrics (4 of 6). Tavily leads on accuracy; compare cost per verified-correct answer and freshness below.

§ 01

Head to Head — Web Search

snapshot web_search-2026-q3
Metric TavilySerperWinner
hit@1 %68.466.0Tavily
hit@5 %84.081.2Tavily
fresh<30d %86.477.3Tavily
retrievability h7.810.6Tavily
cost/correct $$0.0059$0.0041Serper
p50 latency ms688355Serper
§ 02

Head to Head — Web Extraction

snapshot web_extraction-2026-q2
Metric TavilySerperWinner
fidelity 0-10.790.69Tavily
JS gap Δ0.180.27Tavily
block rate %7.69.5Tavily
cost/correct $$0.0044$0.0027Serper
schema validity %
§ 03

Which Should an Agent Pick?

For accuracy-first agent workloads, the higher hit@5 vendor wins; for cost-sensitive high-volume use, prefer the lower cost-per-correct vendor. Both Tavily and Serper should be evaluated on your own query mix — these are illustrative prototype figures.

Illustrative prototype. No verified vendor run has been published yet; every figure here is a placeholder and must not be cited as a measured result. Numbers are replaced when a snapshot’s first full run lands.