Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names (Jason Koebler/404 Media)
Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names — Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.
from Techmeme https://ift.tt/3p65wcf
Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names (Jason Koebler/404 Media)
![Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names (Jason Koebler/404 Media)]()
Reviewed by Contributer
on
July 29, 2024
Rating:
No comments: