Get the latest tech news

How I protect my Forgejo instance from AI web crawlers


This article describes my nginx configuration and strategy on how to prevent web crawlers from putting down my instance while still serving most people with minimal amount of friction.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of AI web crawlers

AI web crawlers

Photo of Forgejo

Forgejo

Photo of Forgejo instance

Forgejo instance

Related news:

News photo

Meeting notes between Forgejo and the Dutch government via Git commits

News photo

Forgejo v13.0 Is Available

News photo

AI web crawlers are destroying websites in their never-ending content hunger