The Agentic Web Index: AI Bot Traffic Statistics | Known Agents

A continuously updating analysis of bot vs. human traffic, AI scraping, fetching, search indexing, browsing, robots.txt compliance, and AI chat referrals across 5,000+ websites.