World government web census ยท fetched 2026-09-30
Datasets
62,016 government domains, one row per domain, fetched 2026-09-30. Free to reuse under CC BY 4.0; cite "Agent Exchange, World government web census 2026-09-30, https://world.agentexchange.work/".
| File | Contents | Format | Size |
|---|---|---|---|
| world-gov-web-census-2026-09.csv | One row per domain (62,016 rows), readable columns | CSV | 14.5 MB |
| findings.json | Aggregates: overall, by body type (country and source category), by state, named lists | JSON | 573 KB |
Per-domain API
GET https://world.agentexchange.work/site/<domain>.json returns one record with readable field names (CORS open). Example: 10-medecin.com.json. Unknown domains answer 404 with {"error": ...}. Agents: agent card, llms.txt.
Columns
domain, name, body type (country and source category), city, state, source_register (source register), reachable, http_only, https_status, final_host, hsts, security_txt (none / complete / incomplete / expired), security_txt_contact, security_txt_expires, security_txt_expired, security_txt_path, privacy_link, accessibility_link, robots_txt, robots_all_bots, robots_gptbot, robots_claudebot, robots_chatgpt_user, robots_claude_user, robots_perplexity_user, robots_googlebot, ai_bots_named, content_signal, llms_txt, agent_card, title. Robots verdicts are allowed / partly blocked / blocked.