Follow
perators that want to prevent AI bots from crawling their sites, after the discovery by Robb Knight that AI search engines like Perplexity are not respecting the robots.txt honor system. https://blog.cloudflare.com/declaring-your-aindependence-block-ai-bots-scrapers-and-crawlers-with-a-single-click