Get the latest tech news

I built a 2x faster lexer, then discovered I/O was the real bottleneck


Archiving 104K files into tar.gz reduced I/O time by 43x and total processing time by 2.3x. The bottleneck was not disk speed, it was syscall overhead.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of faster lexer

faster lexer

Photo of real bottleneck

real bottleneck