Census fetched 2026-09-30 · population: National registers and official directories: Service-Public.fr annuaire (FR), IndicePA (IT, CC BY 4.0), GOV.UK list of .gov.uk domains as of 2026-03-31 (OGL v3), Register van Overheidsorganisaties (NL, CC0), AGOR 2026-06-30 (AU), IGOD (IN), gov.za directory (ZA), govt.nz A-Z (NZ), GovData Brandenburg (DE), SIORG (BR), GovHK A-Z (HK), canada.ca departments (CA), gov.sg trusted sites (SG), european-union.europa.eu bodies (EU), e-Gov links (JP) · datasets (CC BY 4.0)
The world government web census, September 2026: what 62,016 government domains in 15 countries publish for citizens, security researchers and AI agents
Every government hostname found in published registers and official directories outside the United States (62,016 domains: France's Service-Public annuaire, Italy's IndicePA, the GOV.UK domain list, the Dutch Register van Overheidsorganisaties, Australia's AGOR, and the official directories of India, South Africa, New Zealand, Brazil, Hong Kong, Canada, Singapore, the EU institutions, Brandenburg and Japan) was fetched once over HTTPS on 2026-09-30, with robots.txt, security.txt (both locations), llms.txt and the A2A agent card. 47,738 answered with a website; the rest are registered for internal use, are not live, or blocked our one polite request. The US .gov census is a separate property.
Reachable over HTTPS
77.0%
47,738 of 62,016 government domains
security.txt
5.6%
2,681 of reachable sites; 1,539 complete and current
Accessibility statement linked
32.1%
15,307 homepages
Privacy policy linked
31.8%
15,203 homepages
Block GPTBot
2,031
1,405 block ChatGPT-User; 1,624 ClaudeBot
llms.txt
1,451
4 publish an A2A agent card
What we found
- security.txt: 2,681 of 47,738 reachable sites (5.6%) publish one; 1,539 are complete and current (a Contact line and an unexpired Expires line, RFC 9116); 296 have expired; 415 serve it only at /security.txt instead of /.well-known/security.txt.
- Accessibility: 32.1% of reachable sites link an accessibility statement from the homepage.
- Privacy: 31.8% link a privacy policy from the homepage.
- HTTPS: 47,738 of 62,016 domains (77.0%) answered over HTTPS; 2,531 answer only over plain HTTP; 43.6% of reachable sites send HSTS; 1,783 homepages redirect to a different domain.
- AI crawlers and assistants: 37,826 sites serve a robots.txt; 2,031 block GPTBot, 1,624 ClaudeBot and 1,405 ChatGPT-User; 1,261 disallow every bot; 1,273 block both ChatGPT-User and Claude-User; 613 block GPTBot while leaving OAI-SearchBot allowed; 4,734 name an AI crawler explicitly; 131 carry a Content-Signal line.
- Machine-readable surfaces: 1,451 publish an llms.txt and 4 an A2A agent card; 14,438 homepages carry schema.org structured data.
By body type (country and source category)
| Body type (country and source category) | In list | Reachable | security.txt | valid | privacy link | accessibility link | HSTS | blocks GPTBot | blocks ChatGPT-User | llms.txt | agent card |
|---|---|---|---|---|---|---|---|---|---|---|---|
| France (type not stated in annuaire) | 25,022 | 20,709 (82.8%) | 887 (4.3%) | 89 | 2.9% | 29.2% | 36.5% | 238 | 135 | 827 | 2 |
| Italy (Pubbliche Amministrazioni) | 20,674 | 13,929 (67.4%) | 476 (3.4%) | 448 | 62.1% | 24.7% | 55.9% | 1,150 | 1,138 | 229 | 0 |
| UK gov.uk (all registrants) | 7,913 | 6,534 (82.6%) | 272 (4.2%) | 200 | 56.7% | 66.2% | 29.3% | 487 | 33 | 202 | 1 |
| other | 3,831 | 2,850 (74.4%) | 461 (16.2%) | 380 | 29.4% | 23.7% | 58.8% | 84 | 40 | 79 | 0 |
| Italy (Gestori di Pubblici Servizi) | 1,141 | 737 (64.6%) | 7 (0.9%) | 3 | 66.6% | 17.9% | 25.6% | 6 | 5 | 29 | 1 |
| France (Établissement public) | 670 | 589 (87.9%) | 19 (3.2%) | 7 | 1.4% | 45.3% | 49.2% | 11 | 8 | 11 | 0 |
| Netherlands (Gemeente) | 456 | 405 (88.8%) | 335 (82.7%) | 251 | 70.1% | 4.7% | 89.1% | 9 | 8 | 2 | 0 |
| Italy (Stazioni Appaltanti) | 446 | 290 (65.0%) | 1 (0.3%) | 1 | 66.6% | 15.9% | 24.1% | 1 | 2 | 5 | 0 |
| Netherlands (Regionaal samenwerkingsorgaan) | 393 | 354 (90.1%) | 177 (50.0%) | 125 | 74.0% | 1.4% | 71.2% | 4 | 2 | 7 | 0 |
| New Zealand | 325 | 320 (98.5%) | 19 (5.9%) | 12 | 49.7% | 14.1% | 65.6% | 11 | 9 | 9 | 0 |
| France (Association d'utilité publique) | 323 | 284 (87.9%) | 3 (1.1%) | 1 | 3.2% | 6.7% | 30.3% | 6 | 3 | 21 | 0 |
| France (Ambassade ou mission diplomatique) | 296 | 259 (87.5%) | 0 (0.0%) | 0 | 1.5% | 73.4% | 78.0% | 1 | 1 | 1 | 0 |
| France (Collectivité locale) | 282 | 249 (88.3%) | 24 (9.6%) | 22 | 0.4% | 32.5% | 65.5% | 21 | 19 | 3 | 0 |
| France (Ordre professionnel) | 244 | 229 (93.9%) | 0 (0.0%) | 0 | 0.9% | 7.0% | 30.6% | 2 | 2 | 26 | 0 |
By country
Countries with at least 20 government domains in the list; percentages are of reachable sites.
| Country | In list | Reachable | security.txt | privacy link | accessibility link | HSTS | blocks GPTBot |
|---|---|---|---|---|---|---|---|
| FR | 27,555 | 22,849 (82.9%) | 965 | 2.8% | 30.3% | 38.0% | 287 |
| IT | 22,411 | 15,064 (67.2%) | 485 | 62.4% | 24.2% | 53.7% | 1,158 |
| GB | 7,913 | 6,534 (82.6%) | 272 | 56.7% | 66.2% | 29.3% | 487 |
| NL | 1,413 | 1,290 (91.3%) | 837 | 67.8% | 11.5% | 81.5% | 33 |
| IN | 664 | 331 (49.8%) | 3 | 25.7% | 15.7% | 64.7% | 8 |
| AU | 451 | 262 (58.1%) | 30 | 55.7% | 27.5% | 54.6% | 9 |
| ZA | 435 | 320 (73.6%) | 1 | 20.6% | 0.9% | 16.9% | 6 |
| NZ | 325 | 320 (98.5%) | 19 | 49.7% | 14.1% | 65.6% | 11 |
| DE | 256 | 235 (91.8%) | 58 | 2.6% | 2.6% | 50.6% | 21 |
| BR | 148 | 104 (70.3%) | 1 | 1.0% | 10.6% | 52.9% | 4 |
| HK | 142 | 136 (95.8%) | 2 | 16.2% | 10.3% | 60.3% | 1 |
| CA | 129 | 122 (94.6%) | 3 | 30.3% | 33.6% | 73.0% | 4 |
| SG | 108 | 108 (100.0%) | 0 | 50.0% | 3.7% | 78.7% | 2 |
| EU | 53 | 51 (96.2%) | 5 | 25.5% | 27.5% | 86.3% | 0 |
Named lists
Largest government domains without a security.txt (first 60 of 300)
aihw.gov.au · aph.gov.au · asc.com.au · aemc.gov.au · acara.edu.au · acecqa.gov.au · arena.gov.au · acs.gov.au · afma.gov.au · aasb.gov.au · aiatsis.gov.au · austroads.gov.au · accan.org.au · arpc.gov.au · anindilyakwa.com.au · ato.gov.au · aafcans.gov.au · ampc.com.au · acmc.gov.au · actf.com.au · amsa.gov.au · border.gov.au · ano.gov.au · ausport.gov.au · asic.gov.au · atsihealthpracticeboard.gov.au · armyrtf.com.au · austrade.gov.au · auasb.gov.au · ayersrockresort.com.au · asbfeo.gov.au · aciar.gov.au · alrc.gov.au · awm.gov.au · anrows.org.au · adfconsumer.gov.au · australiaday.org.au · asf.org.au · armyholidays.com.au · cefc.com.au · agrifutures.com.au · aspi.org.au · competitiontribunal.gov.au · arrb.com.au · aitsl.edu.au · australianpork.com.au · consult.treasury.gov.au · coag.gov.au · ansto.gov.au · ahpra.gov.au · acl-apac.com.au · asis.gov.au · anuenterprise.com.au · bundanon.com.au · cbf.com.au · clc.org.au · barossa.org.au · australianeggs.org.au · coallsl.com.au · crdc.com.au
Sites with an expired security.txt (first 60 of 296)
abcb.gov.au · abc.net.au · about.abc.net.au · aga.gov.au · asac.gov.au · abs.gov.au · cleanenergyregulator.gov.au · federalfinancialrelations.gov.au · frc.gov.au · intercountryadoption.gov.au · oaic.gov.au · nhsac.gov.au · takeovers.gov.au · treasury.gov.au · defesa.gov.br · taxboard.gov.au · natural-resources.canada.ca · oci-bec.gc.ca · barnim.de · fh-potsdam.de · th-wildau.de · sesarju.eu · th-brandenburg.de · aiglepierre.fr · annoire.fr · archives.cotesdarmor.fr · audelange.fr · aumont39.fr · balaiseaux.fr · boisdegand.fr · bourgdesirod.fr · bracon.fr · cbnbl.org · cdg-41.org · censeau.fr · chapois.fr · charchilla.fr · chatillon39.fr · chauxdescrotenay.fr · chevigny39.fr · chu-lyon.fr · chu-brest.fr · chu-toulouse.fr · collectivite.fr · conte39.fr · cotesdarmor.fr · cosges.fr · crans39.fr · dammartin-marpain.fr · epec.paris · etival39.fr · foncinelebas.fr · fontainebrux.fr · frangy-en-bresse.fr · gevry.fr · gillois.fr · gendrey39.fr · granderivierechateau.fr · gredisans.fr · ivrey.fr
Sites publishing an llms.txt (first 60 of 1,000)
arena.gov.au · accan.org.au · armyrtf.com.au · arrb.com.au · aitsl.edu.au · bundanon.com.au · igt.gov.au · fulbright.com.au · lawcourtsltd.com.au · nlc.org.au · ourwatch.org.au · rdawidebayburnett.org.au · rdacc.org.au · tiwilandcouncil.com · rdatasmania.org.au · rdapilbara.org.au · wilpenapound.com.au · docasdoceara.com.br · destinationcanada.com · ncc-ccn.gc.ca · marineatlantic.ca · abwasserzweckverband-gerswalde.de · eisenbahnmuseumgramzow.de · amt-schenkenlaendchen.de · hwaz.de · hnee.de · osl-online.de · nuwa.de · ltk-brandenburg.de · wav-wittstock.de · wav-rathenow.de · wbv-dj-neustadt.de · waz-jueterbog.de · zowa-online.de · wac-calau.de · wtazv.de · wazv-hohenseefeld.de · wbv-freiwalde.de · wazv-ziesar.de · zv-kms.de · wav-westniederlausitz.de · ombudsman.europa.eu · 3co-mayotte.fr · abzac-gironde.fr · achereslaforet.com · abondant-village.com · acjm.info · adefi-ml.com · aclou.fr · actisce.eu · adera.asso.fr · agel34.fr · agence-mve.org · aillonlejeune.fr · aigny.fr · alec-paysmessin.fr · amaye-sur-orne.fr · ambon.fr · alzheimer-aidants.fr · amet.org
Sites publishing an A2A agent card (4)
levroux.fr · ville-levroux.fr · lalestoncommunitycouncil.gov.uk · latinambiente.it
Sites telling ChatGPT-User and Claude-User not to open pages for users (first 60 of 300)
abcb.gov.au · housingaustralia.gov.au · thenavysanchorage.com.au · account.gov.uk · alvescotparishcouncil.gov.uk · cornwall-aonb.gov.uk · coronation.gov.uk · coningtonparishcouncil.gov.uk · edlingtontowncouncil.gov.uk · eightashgreenparishcouncil.gov.uk · foodstandards.gov.uk · gloucestershirealc.gov.uk · halton.gov.uk · inclusiveeconomypartnership.gov.uk · keyworthparishcouncil.gov.uk · linton-pc.gov.uk · lound-pc.gov.uk · monyashparishcouncil.gov.uk · myjobscotland.gov.uk · northernpowerhouse.gov.uk · platinumjubilee.gov.uk · policylab.gov.uk · pointsoflight.gov.uk · publiccontractsscotland.gov.uk · shincliffeparish.gov.uk · thatchamtowncouncil.gov.uk · ve-vjday80.gov.uk · ve-vjday75.gov.uk · visitukheritage.gov.uk · warton-pc.gov.uk · winstonparishcouncil.gov.uk · finep.gov.br · defesa.gov.br · dpu.def.br · canadacouncil.ca · cb-cda.gc.ca · dife.de · abymes.fr · adil29.rdv.date · alte-francerenov.fr · archives.gironde.fr · auzouvillelesneval.fr · barreau-amiens.avocat.fr · baiedesommeagglo.fr · bassin-pont-a-mousson.fr · bibliotheques.valdoise.fr · bibliotheque.calvados.fr · bibliotheques.ctguyane.fr · brayeawy.fr · casier-judiciaire.justice.gouv.fr · caue69.fr · cc-paysdebray.com · cchnvy.fr · cdg71.fr · ceser.hautsdefrance.fr · ch2p.bzh · chu-guadeloupe.fr · commune-chaspinhac.fr · commune-surdoux.fr · consulat.gouv.fr
Sites blocking GPTBot (OpenAI's training crawler) (first 60 of 300)
arena.gov.au · abcb.gov.au · abc.net.au · about.abc.net.au · housingaustralia.gov.au · nfsa.gov.au · portrait.gov.au · thenavysanchorage.com.au · sbs.com.au · account.gov.uk · aldhamsuffolk-pc.gov.uk · alphetonparish.gov.uk · alkingtonparishcouncil.gov.uk · anston.gov.uk · ashbywouldstowncouncil.gov.uk · asfordbyparishcouncil.gov.uk · ashfieldcumthorpe-pc.gov.uk · ashbymagnaparishcouncil.gov.uk · alvescotparishcouncil.gov.uk · ashbournetowncouncil.gov.uk · ashurstwood-vc.gov.uk · astonontrentparishcouncil.gov.uk · ashover-pc.gov.uk · ashwellparishcouncil.gov.uk · badinghamparishcouncil.gov.uk · assington-pc.gov.uk · baildontowncouncil.gov.uk · bacton-pc.gov.uk · bagworthandthornton-pc.gov.uk · barnham-pc.gov.uk · barningham-pc.gov.uk · barrowupontrentparish.gov.uk · barlestoneparishcouncil.gov.uk · barkbyparishcouncil.gov.uk · bakewelltowncouncil.gov.uk · barkingparishcouncil.gov.uk · barshamshipmeadow-pc.gov.uk · bartonmills-pc.gov.uk · barnbyparishcouncil.gov.uk · barrowden-pc.gov.uk · beckington-pc.gov.uk · barlboroughparishcouncil.gov.uk · bawdsey-pc.gov.uk · barwell-pc.gov.uk · beckinghamcumsaundby-pc.gov.uk · bentleysuffolkparishcouncil.gov.uk · beltoninrutland-pc.gov.uk · bedfieldparishcouncil.gov.uk · biburyparishcouncil.gov.uk · benhallandsternfield-pc.gov.uk · belvoirparishcouncil.gov.uk · bestwoodvillageparishcouncil.gov.uk · billesdonparishcouncil.gov.uk · bledlowcumsaundertonparishcouncil.gov.uk · bingleytowncouncil.gov.uk · bewerleyparishcouncil.gov.uk · blaxhall-pc.gov.uk · bitteswellparishcouncil.gov.uk · bottesford-pc.gov.uk · boylestoneparishcouncil.gov.uk
Homepages that redirect to another domain (first 60 of 300)
about.abc.net.au → www.abc.net.au · asac.gov.au → www.abs.gov.au · arrb.com.au → www.ntro.org.au · coag.gov.au → federation.gov.au · cbf.com.au → cbf.org.au · cleanenergyregulator.gov.au → cer.gov.au · igt.gov.au → taxombudsman.gov.au · fulbright.com.au → www.fulbright.org.au · rdamidnorthcoast.org.au → rdamnc.org.au · startrack.com.au → auspost.com.au · cvm.gov.br → www.gov.br · rdasunshinecoast.org.au → rdambsc.org.au · aeb.gov.br → www.gov.br · agu.gov.br → www.gov.br · cgu.gov.br → www.gov.br · conab.gov.br → www.gov.br · ancine.gov.br → www.gov.br · ans.gov.br → www.gov.br · wilpenapound.com.au → www.discoveryholidayparks.com.au · rissb.com.au → www.ariso.org.au · casaruibarbosa.gov.br → www.gov.br · cbtu.gov.br → www.gov.br · cnpq.br → www.gov.br · mec.gov.br → www.gov.br · ebserh.gov.br → www.gov.br · anp.gov.br → www.gov.br · saude.gov.br → www.gov.br · mma.gov.br → www.gov.br · itamaraty.gov.br → www.gov.br · iphan.gov.br → www.gov.br · investidor.gov.br → www.gov.br · previc.gov.br → www.gov.br · turismo.gov.br → www.gov.br · iti.gov.br → www.gov.br · susep.gov.br → www.gov.br · ifmg.edu.br → validate.perfdrive.com · www2.planalto.gov.br → www.gov.br · clc-sic.ca → www.clcl-sicl.ca · ciec-ccie.parl.gc.ca → www.ethicscanada.ca · cottbus.ihk.de → www.ihk.de · ihk-ostbrandenburg.de → www.ihk.de · gsta.brandenburg.de → staatsanwaltschaften.brandenburg.de · lhk.brandenburg.de → mdf.brandenburg.de · mdfe.brandenburg.de → mdf.brandenburg.de · pueckler-museum.eu → www.pueckler-museum.de · lzkb.de → www.die-brandenburger-zahnaerzte.de · mdj.brandenburg.de → mdjd.brandenburg.de · museum-dkw.de → www.blmk.de · sta-potsdam.brandenburg.de → staatsanwaltschaften.brandenburg.de · vg-potsdam.brandenburg.de → verwaltungsgerichtsbarkeit.brandenburg.de · stk.brandenburg.de → www.brandenburg.de · wav-hoherflaeming.de → wav-hf.de · accessibilite.gouv.fr → www.info.gouv.fr · ac-caen.fr → www.ac-normandie.fr · ad.ambafrance.org → ad.diplomatie.gouv.fr · adil29.org → www.anil.org · academiedemarine.com → www.academiedemarine.fr · adil.dromenet.org → www.anil.org · adil17.org → www.anil.org · adil34.org → www.anil.org
Sites with a Content-Signal line in robots.txt (first 60 of 131)
nlc.org.au · nfsa.gov.au · bancoamazonia.com.br · ombudsman.europa.eu · abondant-village.com · alzing.fr · arnouville-les-mantes.fr · auresurmer.fr · avocats-soissons.com · bidon.fr · blandy-les-tours.fr · brouzetlesales.fr · buironfosse.fr · canet-aude.fr · ccdessavoirfaire.fr · cciamp.com · cci28.fr · chu-nice.fr · cmarguadeloupe.org · colombieres-sur-orb.fr · congis-sur-therouanne.fr · connangles.fr · corcelleslesciteaux.fr · courcellessurnied.com · dagny77.fr · escn58.info · essises.info · expertis.org · framont.fr · gcsms-alliance.com · grandchateaudun.fr · henriville.fr · ilo.org · jouysousthelle.fr · kiffis.fr · larochelle70.fr · laujuzan.com · les-salelles-ardeche.fr · lissay-lochy.fr · mairie-araules.com · mairie-fille.org · mairie-montjean53.fr · mairie-nanslespins.fr · mairie-saintciersdecanesse.com · mairie-toujouse.fr · mairie-valdoust.fr · mairieallereysursaone.fr · mairiechampgeneteux.fr · mairiedevou.fr · mairiepoillysurtholon.fr · malherbe-sur-ajon.com · mefi-2rives.fr · mef23.fr · mission-locale-nord-isere.fr · montlouis18-cher.fr · mousson.com · padlet.com · partinello.fr · pij-des-sucs.fr · puycasquier.fr
Largest government domains without an accessibility link on the homepage (first 60 of 300)
aihw.gov.au · aph.gov.au · asc.com.au · aemc.gov.au · acecqa.gov.au · auspost.com.au · acs.gov.au · afma.gov.au · apra.gov.au · aiatsis.gov.au · austroads.gov.au · accan.org.au · anindilyakwa.com.au · aifs.gov.au · ato.gov.au · aafcans.gov.au · ampc.com.au · actf.com.au · border.gov.au · ano.gov.au · abc.net.au · aga.gov.au · ausport.gov.au · armyrtf.com.au · austrade.gov.au · aemo.com.au · aciar.gov.au · alrc.gov.au · anrows.org.au · adfconsumer.gov.au · armyholidays.com.au · cefc.com.au · agrifutures.com.au · aspi.org.au · competitiontribunal.gov.au · arrb.com.au · australianpork.com.au · consult.treasury.gov.au · ansto.gov.au · acl-apac.com.au · asis.gov.au · anuenterprise.com.au · bundanon.com.au · cbf.com.au · clc.org.au · barossa.org.au · australianeggs.org.au · crdc.com.au · australiaindonesiacentre.org · ausncp.gov.au · courts.act.gov.au · defenceappeals.gov.au · cisc.gov.au · bom.gov.au · artc.com.au · dfa.org.au · csc.gov.au · business.gov.au · frdc.com.au · esa.edu.au
What government domains are expected to publish
- EU Web Accessibility Directive (Directive (EU) 2016/2102): Public-sector bodies in EU member states must make their websites accessible and publish an accessibility statement in a prescribed format; monitoring reports go to the Commission every three years. This census counts a homepage link to an accessibility statement as a proxy. Source
- UK Public Sector Bodies (Websites and Mobile Applications) Accessibility Regulations 2018: UK public-sector bodies must meet WCAG 2.2 AA and publish an accessibility statement; GDS monitors compliance. Source
- Vulnerability disclosure: security.txt (RFC 9116): RFC 9116 defines /.well-known/security.txt so researchers can find a contact and a policy; several national cyber agencies (NCSC UK, NCSC-NL, ANSSI, ACSC) recommend or require it for government sites. Source
- AI crawler and assistant access (robots.txt): robots.txt groups for GPTBot, ClaudeBot, ChatGPT-User, Claude-User and Perplexity-User decide whether AI systems can read public information and whether assistants can open a page a citizen asks about; this census records the verdict per bot. Source
Look up any government domain
Questions
How many government websites outside the US publish a security.txt?
2,681 of the 47,738 reachable government sites (5.6%) publish a security.txt; 1,539 are complete and current and 296 have expired.
How many government websites block AI crawlers?
2,031 of the reachable sites tell GPTBot not to crawl at all; the report lists the per-bot verdicts for ClaudeBot, ChatGPT-User, Claude-User and Perplexity-User.
How many government websites link an accessibility statement?
32.1% of the reachable sites link an accessibility statement from the homepage, measured as a homepage anchor whose path mentions accessibility or the visible text "accessibility statement".
Where does the list of domains come from?
From each country's own published register or official directory (listed above); domains were cleaned to bare hostnames and deduplicated, and consumer hosting platforms were dropped. No domain was invented; every row traces to a source file.
How many publish an llms.txt or an A2A agent card?
1,451 publish an llms.txt that parses; 4 publish an A2A agent card at /.well-known/agent-card.json.
Method and limits
Population: National registers and official directories: Service-Public.fr annuaire (FR), IndicePA (IT, CC BY 4.0), GOV.UK list of .gov.uk domains as of 2026-03-31 (OGL v3), Register van Overheidsorganisaties (NL, CC0), AGOR 2026-06-30 (AU), IGOD (IN), gov.za directory (ZA), govt.nz A-Z (NZ), GovData Brandenburg (DE), SIORG (BR), GovHK A-Z (HK), canada.ca departments (CA), gov.sg trusted sites (SG), european-union.europa.eu bodies (EU), e-Gov links (JP) with each body's name, country (ISO 3166-1 code in the state column), body type as the source states it, and the source register.. Fetch: one HTTPS request to the apex (then www.), following redirects, 8-second timeout, user agent agentexchange-census/1.0; then robots.txt, /.well-known/security.txt, /security.txt, /llms.txt and /.well-known/agent-card.json on the final host. "Reachable" means any HTTP response over HTTPS, including 403s from bot protection. Homepage links are detected from anchor targets and visible text, so a policy that exists but is not linked from the homepage is not counted. A robots.txt "blocked" verdict means the agent's own group (or the * group) disallows the whole site; "partly blocked" means some paths are disallowed. One snapshot per domain; slow sites and sites that block automated requests are counted as unreachable or reachable-with-error as the server answered. Per-domain records: lookup; downloads: CSV, NDJSON and JSON (CC BY 4.0).
Run one of these sites?
$49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk
Other censuses
US government web census (.gov) · US bank web census · US college web census · US school district web census · Agent-readiness grade and fix guides