kiol@discuss.onlineM to Linux Prepper podcast@discuss.onlineEnglish · 2 months agoWhat steps can be taken to prevent AI training and scraping of my public facing website?message-squaremessage-square2linkfedilinkarrow-up18arrow-down10file-text
arrow-up18arrow-down1message-squareWhat steps can be taken to prevent AI training and scraping of my public facing website?kiol@discuss.onlineM to Linux Prepper podcast@discuss.onlineEnglish · 2 months agomessage-square2linkfedilinkfile-text
I realize my options are limited, but what about any robots.txt style steps? Thanks for any suggestions.
minus-squareShellMonkey@piefed.socdojo.comlinkfedilinkEnglisharrow-up5·2 months agoA robots txt with a bunch of scraper user agents is a start, but there’s no guarantee they honor it. A firewall with some dynamic lists of known scanners and scrapers is a bit more forceful method.
A robots txt with a bunch of scraper user agents is a start, but there’s no guarantee they honor it. A firewall with some dynamic lists of known scanners and scrapers is a bit more forceful method.