Get the latest tech news

The "personal computer" model scales better than the "terminal" model


You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace, the wiki thing it's part of. Unfortunately whatever you're using to do so has a HTTP User-Agent header value that is too generic or otherwise excessively suspicious.

Unfortunately whatever you're using to do so has a HTTP User-Agent header value that is too generic or otherwise excessively suspicious. Unfortunately, as of early 2025 there's a plague of high volume crawlers (apparently in part to gather data for LLM training) that behave like this. To reduce the load on Wandering Thoughts I'm experimenting with (attempting to) block all of them, and you've run into this.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of model

model

Photo of personal computer

personal computer

Related news:

News photo

Cloudflare Flips AI Scraping Model With Pay-Per-Crawl System For Publishers

News photo

Xiaomi’s YU7 Is an SUV-Sized Middle Finger to Tesla’s Model Y

News photo

Meta may face daily fines over pay-or-consent model, EU warns