2025-01-12
TechCrunch
4 related
OpenAI's crawlers took down e-commerce site Triplegangers by relentlessly trying to scrape the entire site, whose robots.txt file was not properly configured
techcrunch.com/2025/01/10/h... #google #seo #openai [image] @tante.cc : #OpenAI is basically the locusts of the digital by now. Their massive scrapers crushing websites in order to steal and feed th...
2025-01-11
TechCrunch
4 related
OpenAI's crawlers took down e-commerce site Triplegangers by relentlessly trying to scrape the entire site, whose robots.txt file was not properly configured
On Saturday, Triplegangers CEO Oleksandr Tomchuk was alerted that his company's e-commerce site was down. Bluesky: @valkayec , @glynmoody , and @tante.cc Mastodon: @remixtures@tldr.nettime.org , @DrPe...
Loading articles...