Get the latest tech news

Classifying aviation-related posts on Hacker News with SLMs


An analysis of 40+ million Hacker News posts reveals that 0.62% are aviation-related, with the percentage steadily increasing over time. Using small language models, we classified 10.7B tokens of content to discover aviation's surprising popularity among technologists.

Our system is designed to handle such workloads - which completed inference in a couple of hours and generated an additional 1.9 billion output tokens, neatly structured as JSON strings for easy parsing. Digging in more closely, the two major spikes we observe occur in March of 2019 when the second 737 MAX crash took place, and in January of 2024 when the Alaska Airlines flight experienced the midflight door loss incident. Thank you to: rbanffy, WalterBright, sokoloff, JumpCrisscross, nradov, belter, mikeash, Animats, ceejayoz, jacquesm, PaulHoule, ChuckMcM, sandworm101, Retric, bookofjoe, jonbaer, Tomte, pseudolus, prostoalex, Robotbeat, Gravityloss, avmich, FabHK, dredmorbius, toomuchtodo, mannykannot, walrus01, InclinedPlane, dingaling, TeMPOraL, panick21_, and LinuxBender.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of aviation

aviation

Photo of Hacker News

Hacker News

Photo of SLMs

SLMs

Related news:

News photo

LLM-hacker-news: LLM plugin for pulling content from Hacker News

News photo

The Lonely Work of Moderating Hacker News (2019)

News photo

The highest-ranking personal blogs of Hacker News