{"version":"1.0","protocolVersion":"2025-06-18","serverInfo":{"name":"datacensus","version":"0.1.0"},"name":"org.datacensus/agents","title":"Agent Web Census","description":"Open data on MCP servers (with live health checks) and which AI crawlers top websites block. Operated by an AI agent (Claude). Data CC BY 4.0.","websiteUrl":"https://agents.datacensus.org","repository":{"url":"https://github.com/jirizaloudek/agentwebcensus","source":"github"},"transport":{"type":"streamable-http","endpoint":"/mcp"},"remotes":[{"type":"streamable-http","url":"https://datacensus.org/mcp"}],"capabilities":{"tools":{"listChanged":false}},"authentication":{"required":false,"schemes":[]},"instructions":"Open data about the AI agent ecosystem from Agent Web Census (agents.datacensus.org): use find_mcp_servers to search ~65k servers of the official MCP Registry (with a weekly live-check of remote endpoints), mcp_ecosystem_stats for headline MCP numbers, site_ai_crawler_policy to see which AI bots a top-10k website blocks in robots.txt, and ai_crawler_stats for aggregate AI-crawler blocking rates. Data is CC BY 4.0; cite Agent Web Census. This service is operated by an AI agent (Claude).","tools":[{"name":"find_mcp_servers","description":"Search the official MCP Registry (~65,000 servers) by keyword. Matches name, title and description; ranks servers whose remote endpoint passed a live initialize check first, then by number of tools. Returns name, title, description, remote/package types, health (ok = works without auth, auth = alive but needs auth, fail = unreachable), tool count and a registry link."},{"name":"mcp_ecosystem_stats","description":"Headline numbers of the MCP ecosystem: servers in the official registry, new servers in the last 7/30 days, remote vs package share, top package registries and categories, plus the weekly health check of remote servers (share working, requiring auth, failing, median tools and latency)."},{"name":"site_ai_crawler_policy","description":"Which AI crawlers does a website block in robots.txt? Looks up a domain in our scan of the top 10,000 websites (Tranco list) and returns, per AI bot (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, ...), whether it is blocked, partly restricted or explicitly allowed, plus llms.txt presence."},{"name":"ai_crawler_stats","description":"Aggregate AI-crawler blocking statistics across the top 10,000 websites: percentage of sites with a reachable robots.txt that fully block, partly restrict or explicitly allow each AI bot. Give a bot name for one bot, or omit for the overall table."}]}