Tea to Technology@lemmy.zipEnglish · edit-22 days agoCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comexternal-linkmessage-square7fedilinkarrow-up148arrow-down10cross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected]
arrow-up148arrow-down1external-linkCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comTea to Technology@lemmy.zipEnglish · edit-22 days agomessage-square7fedilinkcross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected]
minus-squaredraughtcyclist@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·1 day agoThis is amazing. The number of crawlers that don’t respect crawling directives is out of hand. Feed them garbage till they can’t pay their bills.
This is amazing. The number of crawlers that don’t respect crawling directives is out of hand. Feed them garbage till they can’t pay their bills.