@[email protected] to Privacy [email protected]English • 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.commessage-square56fedilinkarrow-up1399arrow-down10cross-posted to: [email protected][email protected]
arrow-up1399arrow-down1external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.com@[email protected] to Privacy [email protected]English • 1 year agomessage-square56fedilinkcross-posted to: [email protected][email protected]
minus-square@[email protected]linkfedilinkEnglish3•1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.