Benchmark · people data
People Search API Benchmark
When you ask a data API for “{role} in {country}”, how many of the returned people actually hold that role, at that seniority, in that country — and how deep and fast is the result? We asked each provider the same 10 frozen role+geo queries and blind-judged every person they returned.
Updated 2026-10-07 · judge openai/gpt-4.1-mini · 10 queries · K=25 · query set v2026-07-30.1· every raw request & judge call is published for verification.
Leaderboard
| Provider | Precision (of returned) | Precision@10 | Depth (avg/25) | Coverage | Latency |
|---|---|---|---|---|---|
| #1Crustdata | 78.8% | 80% | 25 | 10/10 | 11,246ms |
Precision of returned results
Share of returned people whose current title genuinely matches the requested function + seniority in the requested country (blind LLM judge).
Verdict
- Crustdata is the only provider to complete the run (10/10 queries) — 78.8% precision at full depth (25/25 average results) with 100% title, 100% company and 100% location fill.
Quota-limited this run
Apollo, ContactOut, Coresignal, People Data Labs, RocketReach returned no results because the test account hit a free-tier / subscription limit. They are excluded from the leaderboard until re-run on a paid tier — not scored as zero.
Methodology
A frozen, versioned set of 10 queries each fixes a role (with accepted title variants), a seniority bar, and a country. Each provider is asked for up to 25 matching people via its native people-search API, with the query expressed as faithfully as each API allows.
Every returned person is judged blind — the judge (openai/gpt-4.1-mini) sees only current title, company and location, never the provider — on two checks: the current title matches the requested function AND seniority, and the location is in the requested country. Duplicate people across providers are judged once. Field fill-rates (title/company/location present) are deterministic.
Every HTTP request/response and every judge call is cached under runs/ so the leaderboard can be independently re-graded. Judge cost for this run: $0.0181. Providers that hit quota mid-run are labeled partial; providers that could not run at all are excluded, never scored as zero.
Per-query results
| Query | Crustdata |
|---|---|
| vp-sales-us | 90% · 25 |
| talent-lead-uk | 80% · 25 |
| cfo-germany | 70% · 25 |
| marketing-vp-us | 60% · 25 |
| devops-india | 100% · 25 |
| founder-ceo-france | 50% · 25 |
| product-manager-canada | 90% · 25 |
| revops-director-us | 90% · 25 |
| data-engineer-uk | 90% · 25 |
| cto-australia | 80% · 25 |
cell = Precision@10 · results returned
Part of the PeopleDataBenchmarks open benchmark suite · dataset released CC BY 4.0.