Some people are defending Perplexity after Cloudflare ânamed and shamedâ it
In a debate likely to get louder as AI agent usage grows, some people say Perplexity crawling blocked websites isn't a simple matter.
Perplexity accused of scraping websites that explicitly blocked AI scraping
Internet giant Cloudflare says it detected Perplexity crawling and scraping websites, even after customers had added technical blocks telling Perplexity not to scrape their pages.
Cloudflare launches a marketplace that lets websites charge AI bots for scraping
Cloudflare, a cloud infrastructure provider that serves 20% of the web, announced Tuesday the launch of a new marketplace that reimagines the relationship between website owners and AI companies â ideally giving publishers greater control over their content. For the last year, Cloudflare has launched tools for publishers to address the rampant rise of AI […]