Yes but even curl easily passes those tests by default, regardless of the user-agent. I guess I’m just skeptical of how much effect it really has in the real world… you see a lot of people saying “oh yea it works great”, but they don’t tell you what the before and after bot traffic actually was.

Happen to be proven wrong though if anyone has some hard data.