arlen/benchOpen benchmarks for agentic consumers
SNAPSHOT web_search-2026-q3
11 JUN 2026 · BERKELEY, CA
Head-to-Head · Illustrative prototype

Serper vs SerpAPI

Serper versus SerpAPI for AI agents — hit@k accuracy, freshness lag, cost per verified-correct answer, and agent-readiness, scored against golden truth.

Answer firstillustrative

On the illustrative web_search-2026-q3 snapshot, Serper wins more head-to-head metrics (6 of 6). Serper leads on accuracy; compare cost per verified-correct answer and freshness below.

§ 01

Head to Head — Web Search

snapshot web_search-2026-q3
Metric SerperSerpAPIWinner
hit@1 %66.057.0Serper
hit@5 %81.273.1Serper
fresh<30d %77.366.0Serper
retrievability h10.6Serper
cost/correct $$0.0041$0.0102Serper
p50 latency ms355540Serper
§ 03

Which Should an Agent Pick?

For accuracy-first agent workloads, the higher hit@5 vendor wins; for cost-sensitive high-volume use, prefer the lower cost-per-correct vendor. Both Serper and SerpAPI should be evaluated on your own query mix — these are illustrative prototype figures.

Illustrative prototype. No verified vendor run has been published yet; every figure here is a placeholder and must not be cited as a measured result. Numbers are replaced when a snapshot’s first full run lands.