ProM to TechnologyEnglish · 4 days agoCloudflare debuts “Pay per Crawl”, a marketplace that lets sites charge AI crawlers per crawl; new sites using Cloudflare will now block AI crawlers by defaultblog.cloudflare.comexternal-linkmessage-square6linkfedilinkarrow-up125arrow-down10cross-posted to: [email protected]
arrow-up125arrow-down1external-linkCloudflare debuts “Pay per Crawl”, a marketplace that lets sites charge AI crawlers per crawl; new sites using Cloudflare will now block AI crawlers by defaultblog.cloudflare.comProM to TechnologyEnglish · 4 days agomessage-square6linkfedilinkcross-posted to: [email protected]
minus-squareMichallinkfedilinkEnglisharrow-up2·4 days agoIt’s up to site owners to decide the price and the crawler operators decide if the content is worth it or not. They won’t crawl your site if it has a steep price, and the few cents you will receive won’t make it worth your while. I wouldn’t call it a fraud.
It’s up to site owners to decide the price and the crawler operators decide if the content is worth it or not.
They won’t crawl your site if it has a steep price, and the few cents you will receive won’t make it worth your while. I wouldn’t call it a fraud.