Cloudflare’s Pay per Crawl Marketplace Lets Websites Charge AI Bots

Cloudflare’s Pay per Crawl Marketplace Lets Websites Charge AI Bots

Cloudflare's Pay per Crawl Marketplace Transforms How AI Bots Access Content As AI companies increasingly rely on web content to train their models and fuel generative search engines, website owners have struggled to maintain control over how their data is scraped and used. That’s where Cloudflare’s Pay per Crawl marketplace steps in. This newly launched platform enables website publishers to monetize AI access to their content by setting prices for AI bot crawls — a groundbreaking shift in the data economy. In just the first phase of the private beta, the initiative empowers site owners to decide whether AI bots should be blocked, allowed for free, or charged for each interaction. For content creators and publishers worried about AI scraping without consent or compensation, Cloudflare is offering a much-needed path forward. Image : Google This launch builds on Cloudflare’s earlier anti-AI crawler tools like the one-click AI bot blocker and bot visibility dashboard. But now, instead …