World government web census

World government web census · gap lists · census 2026-09-30 · JSON (top 50) · feed

Government domains blocking both ChatGPT-User and Claude-User

1,273 of the 62,016 government domains in the census list (2.1%; 2.7% of the 47,738 reachable over HTTPS), as fetched on 2026-09-30.

On this list

1,273

of 62,016 government domains

Share of the list

2.1%

2.7% of reachable sites

Countries

12

largest: Italy (1,115)

Full list

1.00 USDC

x402, per file; first 50 rows free

What this gap means

robots.txt disallows both ChatGPT-User and Claude-User for the whole site, so neither assistant will open its pages for a user who asks.

Control: robots.txt verdicts for ChatGPT-User and Claude-User. Rule: blocks_assistants over the census record (reachable sites only). Who buys this: AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users.

The obligation it maps to

AI crawler and assistant access (robots.txt): robots.txt groups for GPTBot, ClaudeBot, ChatGPT-User, Claude-User and Perplexity-User decide whether AI systems can read public information and whether assistants can open a page a citizen asks about; this census records the verdict per bot. Source

By country

12 countries with at least one government domain on this list; "of the country" is the share of its government domains in the census list. One country as CSV: 0.25 USDC (x402).

CountryOn this listOf the countryCSV (x402)
Italy1,1155.0%https://world.agentexchange.work/leads/blocks-assistants/state/IT.csv
France890.3%https://world.agentexchange.work/leads/blocks-assistants/state/FR.csv
the United Kingdom280.4%https://world.agentexchange.work/leads/blocks-assistants/state/GB.csv
the Netherlands141.0%https://world.agentexchange.work/leads/blocks-assistants/state/NL.csv
India71.1%https://world.agentexchange.work/leads/blocks-assistants/state/IN.csv
New Zealand51.5%https://world.agentexchange.work/leads/blocks-assistants/state/NZ.csv
South Africa51.1%https://world.agentexchange.work/leads/blocks-assistants/state/ZA.csv
Australia30.7%https://world.agentexchange.work/leads/blocks-assistants/state/AU.csv
Brazil32.0%https://world.agentexchange.work/leads/blocks-assistants/state/BR.csv
Canada21.6%https://world.agentexchange.work/leads/blocks-assistants/state/CA.csv
Germany10.4%https://world.agentexchange.work/leads/blocks-assistants/state/DE.csv
Singapore10.9%https://world.agentexchange.work/leads/blocks-assistants/state/SG.csv

Free: the first 50 of 1,273 (alphabetical)

DomainBody type (country and source category)CountrySource registerCensus record
13cmlepini.it
Comunita' Montana Monti Lepini
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
25aprilefaccio.edu.it
ISTRUZIONE SECONDARIA SUPERIORE - IS 25 APRILE
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
7istitutopadova.edu.it
ISTITUTO COMPRENSIVO - VII DI PADOVA 'S.CAMILLO'
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
8circologiugliano.edu.it
DIREZIONE DIDATTICA - GIUGLIANO 8
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
abcb.gov.au
Australian Building Codes Board
Australia federal (J. Inter-jurisdictional and internationalAUAGOR 2026-06-30HTTP 200 · HSTS yes · security.txt expired · privacy yes · accessibility yes · GPTBot blocked
abymes.fr
Mairie - Les Abymes
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
account.gov.ukUK gov.uk (all registrants)GBGOV.UK .gov.uk list 2026-03-31HTTP 200 · HSTS yes · security.txt complete · privacy no · accessibility no · GPTBot blocked
acquariomessina.it
Centro per Lo Studio della Patologia Spontanea Degli Organismi Marini
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
adil29.rdv.date
Point-justice Logement - Quimper
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
adriauno.edu.it
ISTITUTO COMPRENSIVO - ADRIA UNO
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
agenziapiemontelavoro.it
Agenzia Piemonte Lavoro
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
agrariopescia.edu.it
ISTITUTO TECNICO AGRARIO - D. ANZILOTTI
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 509 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
agronomict.it
Ordine Dei Dottori Agronomi e Dei Dottori Forestali della Provincia di Catania
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
aicl.in
Atherstone Investor Communications Limited
India (IGOD: Finance, Banking & Insurance)INigod.gov.inHTTP 200 via aiclacademy.com · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
alte-francerenov.fr
Espace conseil France Rénov' - Apt
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
alvescotparishcouncil.gov.ukUK gov.uk (all registrants)GBGOV.UK .gov.uk list 2026-03-31HTTP 200 · HSTS no · security.txt none · privacy yes · accessibility yes · GPTBot blocked
amat-mi.it
Agenzia Mobilita Ambiente e Territorio
Italy (Gestori di Pubblici Servizi)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
ammiratofalcone.edu.it
ISTITUTO COMPRENSIVO - AMMIRATO - FALCONE LECCE
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
amsterdam.nl
Gemeente Amsterdam
Netherlands (Gemeente)NLROO exportOO.xmlHTTP 200 · HSTS yes · security.txt complete · privacy yes · accessibility no · GPTBot blocked
andcollege.du.ac.in
Acharya Narendra Dev College, Delhi
India (IGOD: Education & Training)INigod.gov.inHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
angriecoservizi.it
Azienda Speciale Angri Eco Servizi
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
anziocinque.edu.it
ISTITUTO COMPRENSIVO - IC ANZIO V
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 509 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
anziouno.edu.it
ISTITUTO COMPRENSIVO - I.C. ANZIO I
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 509 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
apsppievedibono.it
A.P.S.P. Padre Odone Nicolini
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot blocked
archives.gironde.fr
Archives départementales - Gironde
France (Collectivité locale)FRService-Public annuaireHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked
archives.govt.nz
Archives New Zealand
New ZealandNZgovt.nz A-Z organisationsHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
aslariana.it
AZIENDA SOCIALE LARIANA
Italy (Gestori di Pubblici Servizi)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
aspbeatalucia.it
Azienda Pubblica di Servizi alla Persona Beata Lucia
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
aspcarlodelprete.it
Azienda Pubblica di Servizi alla Persona Centro Carlo del Prete
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
atestino.edu.it
ISTITUTO SUPERIORE - I.I.S. ATESTINO-ESTE
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
atoacquecatania.it
Ambito Territoriale Ottimale Catania Acque in Liquidazione
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility no · GPTBot blocked
auloceccato.edu.it
ISTITUTO TECNICO COMMERCIALE - ITCG 'AULO CECCATO'
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy yes · accessibility no · GPTBot blocked
autoritaidrica.puglia.it
Autorita' Idrica Pugliese
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
auzouvillelesneval.fr
Mairie - Auzouville-l'Esneval
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
avespucci.edu.it
ISTRUZIONE SECONDARIA SUPERIORE - AMERIGO VESPUCCI
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
ayush.mponline.gov.in
AYUSH Counselling, Madhya Pradesh
India (IGOD: Education & Training)INigod.gov.inHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked
baiedesommeagglo.fr
Centre communal d'action sociale (CCAS) - Yonval
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
barreau-amiens.avocat.fr
Ordre des avocats - Barreau d'Amiens
France (Ordre professionnel)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
bassin-pont-a-mousson.fr
Espace conseil France Rénov' - Pont-à-Mousson
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
bassocampidano.it
Unione Dei Comuni Basso Campidano
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked
bibliotheque.calvados.fr
Bibliothèque départementale - Calvados
France (Collectivité locale)FRService-Public annuaireHTTP 200 · HSTS yes · security.txt complete · privacy no · accessibility yes · GPTBot blocked
bibliotheques.ctguyane.fr
Médiathèque Territoriale - Guyane
France (Collectivité locale)FRService-Public annuaireHTTP 403 · HSTS yes · security.txt complete · privacy no · accessibility no · GPTBot blocked
bibliotheques.valdoise.fr
Bibliothèque départementale - Val-d'Oise
France (Collectivité locale)FRService-Public annuaireHTTP 200 · HSTS yes · security.txt complete · privacy no · accessibility yes · GPTBot blocked
branchina.edu.it
Istituto Tecnico Commerciale e Geometra Pietro Branchina
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 509 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
brayeawy.fr
Communauté de communes - Bray Eawy
France (type not stated in annuaire)FRService-Public annuaireHTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
calabreselevi.edu.it
ISTRUZIONE SECONDARIA SUPERIORE - 'L. CALABRESE - P. LEVI'
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 509 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked
canadacouncil.ca
Canada Council for the Arts
Canada federalCAcanada.ca dept directoryHTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked
capriolo.org
Comune di Capriolo
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
carpinetoromano.it
Comune di Carpineto Romano
Italy (Pubbliche Amministrazioni)ITIndicePA entiHTTP 200 via comune.carpinetoromano.rm.it · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked
casier-judiciaire.justice.gouv.fr
Bureau de la qualité et des traitements
France (Administration centrale (ou Ministère))FRService-Public annuaireHTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked

The same rows as JSON: blocks-assistants.top.json (CORS open, cached one day).

Get the full list: 1,273 rows, 1.00 USDC

x402 on Base, paid per file, no account or key. GET https://world.agentexchange.work/leads/blocks-assistants.csv or GET https://world.agentexchange.work/leads/blocks-assistants.json answers 402 Payment Required with the terms (scheme exact, USDC on Base, maxAmountRequired 1000000, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); an x402 client signs the EIP-3009 authorization and resends the same request with X-PAYMENT; the file comes back with a PAYMENT-RESPONSE header. HEAD gets the same 402. One country: GET https://world.agentexchange.work/leads/blocks-assistants/state/<code>.csv, 0.25 USDC (codes in the table above).

curl -sS -D - https://world.agentexchange.work/leads/blocks-assistants.csv   # 402 with the x402 terms; pay and resend with X-PAYMENT

Columns (19): domain, name, type, city, state, source_register, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title. CSV: header row, every cell quoted, yes/no for booleans. JSON: { list, title, count, by_state, columns, rows[][] }. Sizes: CSV 283 KB, JSON 287 KB. The same facts are in the free CC BY 4.0 dumps: the price buys the filtered, country-sliceable file built from the 2026-09-30 census, not exclusive data. Settlement is final; no refunds. Prices in /.well-known/x402 equal the challenges. Terms · pricing.

Card checkout for this list is not open yet; the x402 route works now.

Monitor this list (free)

Atom feed: government domains that entered or left this list according to the live re-checks (every 6 hours a rotating slice, each domain at most once per 14 days; each entry says which way it moved and which field changed). blocks-assistants.top.json: the first 50 rows and the counts by country as JSON, CORS open. Fields watched: robots, robots.ChatGPT-User, robots.Claude-User.

Membership reflects the homepage and well-known files as fetched on 2026-09-30: a control that exists but was not found where the census looked counts as missing, and sites answering 403 to our one polite request count as reachable. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed. Data licence CC BY 4.0. Not legal advice.