Get the latest tech news

You Wouldn't Download a Hacker News


You Wouldn't Download a Hacker News

I had a 20 GiB JSON file of everything that has ever happened on Hacker News, and I can just re-run the command above to “top it off” any time I need the latest. I spend most of my day wrangling a different database(there’s the plug my coworkers will be looking for) but I’ve been meaning to try DuckDB and it seemed perfect for this one-off task. Now that I have a local download of all Hacker News content, I can train hundreds of LLM-based bots on it and run them as contributors, slowly and inevitably replacing all human text with the output of a chinese room oscillator perpetually echoing and recycling the past.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Hacker News

Hacker News

Related news:

News photo

Classifying aviation-related posts on Hacker News with SLMs

News photo

LLM-hacker-news: LLM plugin for pulling content from Hacker News

News photo

The Lonely Work of Moderating Hacker News (2019)