 In response to data-hungry AI companies gobbling up every corner of the internet, websites have started to put AI companies in this file. A way of telling ChatGPT, stop, do not scrape here. But here's the problem. The AI industry is ignoring it. Just recently, Amazon Web Services announced it is investigating popular AI search engine Perplexity over this. Officials from Perplexity wouldn't talk to me for this story. But in a statement, the company said, "...robots.txt is not a legal framework."