Get the latest tech news
Amazon's AI crawler is making my Git server unstable
Please, just stop.
Should you want to crawl my git server for some reason, please reach out to me so we can arrange for payment for hardware upgrades commensurate to your egregious resource usage. It's futile to block AI crawler bots because they lie, change their user agent, use residential IP addresses as proxies, and more. Any and all opinions listed here are my own and not representative of any of my employers, past, future, and/or present.
Or read this on Hacker News
