I just started using this myself, seems pretty great so far!

Clearly doesn’t stop all AI crawlers, but a significantly large chunk of them.

  • sudo
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    I write a lot of webscrapers. This sounds like the weakest solution with the most cost to regular users. I don’t even have to spoof anything, just solve some hash?

    1. Just open a browser and let anubis hash
    2. Intercept the its token
    3. Scrape the api with the token
    4. Schedule a background task that steadily solves the hashes at a steady rate.

    I should spin this up and test it out before I talk more shit about it. But the concept of slowing me down just by forcing extra computations is laughable. You’d have to crank the amount of computations up so high you’ll hurt your own userbase.