A number of major news outlets are among those who are less than thrilled with this practice and have taken advantage of OpenAI’s option to block the crawler. According to Originality.AI, major news outlets that had taken this step as of Sept. 1 included The Guardian, the New York Times, the Washington Post, Bloomberg, CNN and Reuters.
What publications have blocked ChatGPT’s web crawler?
Answer: The Guardian and the New York Times, just to name a few.
Shutterstock
While many, many people love ChatGPT, there are also quite a few who don’t. Some of that has to do with how and where the large language model gets the information that it is trained on. OpenAI, ChatGPT’s parent company, reportedly uses a web crawler called GPTBot that takes data from websites to train the AI model.
A number of major news outlets are among those who are less than thrilled with this practice and have taken advantage of OpenAI’s option to block the crawler. According to Originality.AI, major news outlets that had taken this step as of Sept. 1 included The Guardian, the New York Times, the Washington Post, Bloomberg, CNN and Reuters.
News outlets aren’t the only ones, either. Popular sites like Amazon, Indeed, Quora and Lonely Planet have also blocked the GPTBot crawler.
A number of major news outlets are among those who are less than thrilled with this practice and have taken advantage of OpenAI’s option to block the crawler. According to Originality.AI, major news outlets that had taken this step as of Sept. 1 included The Guardian, the New York Times, the Washington Post, Bloomberg, CNN and Reuters.
