AI bot & crawler traffic
AI bots scan public websites to collect data used in search engines, AI model training, and other data processing tasks
AI Insights
AI bot transparency
Tracking best practices from bots of leading AI models and service providers
Generative AI services popularity
Top services based on 1.1.1.1 DNS resolver traffic
Learn more...AI user agents found in robots.txt
robots.txt files found across the top 10,000 domains
Learn more...Adoption of AI agent standards
Standards adoption across of the top 200,000 scanned domains
Learn more...Workers AI model popularity
Distribution of AI model usage on Cloudflare Workers AI
Learn more...Workers AI task popularity
Distribution of AI tasks performed on Cloudflare Workers AI
Learn more...Latest AI blog posts
Posts tagged with "AI" from the Cloudflare blog