empireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comexternal-linkmessage-square56fedilinkarrow-up1401arrow-down10cross-posted to: technology@lemmy.ml
arrow-up1401arrow-down1external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comempireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agomessage-square56fedilinkcross-posted to: technology@lemmy.ml
minus-squareSpectacle8011@lemmy.comfysnug.spacelinkfedilinkEnglisharrow-up3·1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.