AI bot & crawler traffic
Copy linkAI bots scan public websites to collect data used in search engines, AI model training, and other data processing tasks
AI bots scan public websites to collect data used in search engines, AI model training, and other data processing tasks
Posts tagged with "AI" from the Cloudflare blog
Cloudflare Gateway identifies MCP requests using protocol-level heuristics. Security teams can use that signal to find shadow MCP traffic, enforce Portal-only access for approved servers, and block direct connections on managed network paths.
Introducing Cloudflare Access for Workers. Attach an Access policy directly to a Worker and it applies everywhere that Worker runs — routes, custom domains, workers.dev, and previews — automatically.
Our latest Agents Week has come to a close. Here’s a recap of all the announcements we made from Wallets to Radar.