Get the latest tech news

Porting nanochat to a TPU: what carries over from PyTorch, and what breaks


Karpathy's nanochat normally runs on an 8×H100 GPU node, and several ports of it to JAX already exist. Among them, my aim was to keep the config and architecture as close to nanochat as possible (p...

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of PyTorch

PyTorch

Photo of TPU

TPU

Related news:

News photo

The annotated PyTorch training loop

News photo

Google is spending billions to turn its TPU chips into a real challenger to Nvidia

News photo

Google, Canonical team up to certify Ubuntu images for TPU VMs