Cloudflare introduces pay-per-crawl feature to combat AI scraping

Cloudflare is beta testing a pay-per-crawl program to deter bots from endlessly scraping websites, aiming to make it financially unfeasible for AI scrapers to operate. This feature charges bots for each crawl they make, potentially reducing the prevalence of scraping activities. The initiative could help protect website content and intellectual property from being exploited by automated scraping bots.