Get the latest tech news

The last six months in LLMs, illustrated by pelicans on bicycles


I presented an invited keynote at the AI Engineer World’s Fair in San Francisco this week. This is my third time speaking at the event—here are my talks from October …

These haven’t made many waves yet but are notable because they handle 1 million tokens of input and feel competitive with the less expensive of Google’s Gemini family. It turns out trade restrictions on the best GPUs weren’t going to stop the Chinese labs from finding new optimizations for training great models. I already have a tool I built called shot-scraper, a CLI app that lets me take screenshots of web pages and save them as images.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of LLMs

LLMs

Photo of months

months

Photo of bicycles

bicycles

Related news:

News photo

A Knockout Blow for LLMs?

News photo

How much information do LLMs really memorize? Now we know, thanks to Meta, Google, Nvidia and Cornell

News photo

From tokens to thoughts: How LLMs and humans trade compression for meaning