because companies like your employer's are destroying the commons by abusing the limited budgets of individuals and smaller organizations who put content online and this is literally what it has come to
That sucks, but my employer has datacenters all over the world, 2^16 SHA2 operations is literally too small to even measure? For people on limited devices however... 😬
I am completely new to this topic, but what you have said seems correct in theory. Do you know if any website published real data comparing traffic before and after implementing anubis?
also, fun fact, you can get rid of the anime catgirl by just using non-browser user agents. would be a real shame if someone built a browser extension that does that automatically when detecting anubis 🤭 addons.mozilla.org/en-US/fir…
I think a few big/notable open-source projects use Anubis because ... it seems to work? I think the interesting question is why - it's just enough of a metaphorical "locked door" such that AI crawlers would look *too sleazy* if they just "kicked it down"? For now?
"There's a solid strategy behind it: give people what they want with a flaw that makes it unviable for corpos. Then sell the cure."
news.ycombinator.com/item?id…
Perhaps Anubis works because the most aggressive bots are not browsers, they just pretend to be one, and do not execute JS. Browser-based bots presumably pass Anubis, but they don't hammer servers as much, so it's a win (for now)
About the article:
could you redo your calculations for the cost(s), by *assuming* the AI bots are (1) independent, (2) don't have a cookie file, and tries to access ~300k pages + ~3*300k images (a site I sysadmin for)
I’d argue it’s “because we can’t have nice things” and if you allow bots to scrape your site they will take down your infrastructure and hosting costs will go up. But still weird that it’s an anime girl, you couldn’t find a different mirror?
why does half of software online have anime girls in there 😭
i overall dont like any sort of companions in apps/websites because they look cringe but this?
this is just my personal preference though of not wanting to see this
My understanding was that the goal is to make it expensive to switch your browser's "identity" around to bypass regular rate limiting. You either stick to the same and get rate limited, or get slowed by the hashes, targeted website gets some breathing room either way.