Get the latest tech news

It seems like the AI crawlers learned how to solve the Anubis challenges


It seems like the AI crawlers learned how to solve the Anubis challenges. Anubis is a tool hosted on our infrastructure that requires browsers to do some heavy computation before accessing Codeberg again. It really saved us tons of nerves over the past months, because it saved us from manually maintaining blocklists to having a working detection for "real browsers" and "AI crawlers".

Get the Android app

Or read this on Hacker News

Read more on:

Photo of AI crawlers

AI crawlers

Photo of Codeberg

Codeberg

Photo of Anubis

Anubis

Related news:

News photo

Proof-of-work to protect lore.kernel.org and git.kernel.org against AI crawlers

News photo

AI crawlers cause Wikimedia Commons bandwidth demands to surge 50%

News photo

Open source devs are fighting AI crawlers with cleverness and vengeance