Vendor Profile · Illustrative prototype
Serper
Serper on the arlen/bench leaderboards — agent web-search accuracy, extraction fidelity, freshness, cost per verified-correct answer, and agent-readiness, scored against golden truth.
Answer firstillustrative
Serper ranks #3 of 6 for agent web-search accuracy at 81.2% hit@5; #6 of 7 for extraction fidelity at 0.69, and is not yet agent-ready in live onboarding trials.
hit@5
81.2%
web search
cost / correct
$0.0041
web search
extraction fidelity
0.69
web extraction
agent-ready
No
onboarding harness
§ A
Web Search — Serper
| Metric | Serper | Leaderboard best | Direction |
|---|---|---|---|
| hit@1 % | 66.0 | Exa 71.2 | higher is better |
| hit@5 % | 81.2 | Exa 87.6 | higher is better |
| fresh<30d % | 77.3 | Tavily 86.4 | higher is better |
| retrievability h | 10.6 | Tavily 7.8 | lower is better |
| cost/correct $ | $0.0041 | leads | lower is better |
| p50 latency ms | 355 | Brave 301 | lower is better |
§ B
Web Extraction — Serper
| Metric | Serper | Leaderboard best | Direction |
|---|---|---|---|
| fidelity 0-1 | 0.69 | Firecrawl 0.91 | higher is better |
| JS gap Δ | 0.27 | Firecrawl 0.03 | lower is better |
| block rate % | 9.5 | Apify 3.3 | lower is better |
| cost/correct $ | $0.0027 | Jina $0.0009 | lower is better |
| schema validity % | — | Firecrawl 96.2 | higher is better |
§ C
Serper vs Exa Serper vs Tavily Serper vs Brave Serper vs Firecrawl Serper vs SerpAPICompare Serper
Illustrative prototype. No verified vendor run has been published yet; every figure here is a placeholder and must not be cited as a measured result. Numbers are replaced when a snapshot’s first full run lands.