Get the latest tech news
Faking a JPEG
Creating something that seems like a JPEG, very quickly
Sadly, two of the hardest-hitting crawlers go to extreme lengths to hide their identity, generating random, and unlikely, browser signatures (e.g. Firefox version 134.0, 64 bit, on Windows 98!) Where I can identify a heavy hitter, I add it to the list on Spigot's front page so I can track crawler behaviour over time. This massively reduces the probability (from > 90% to < 4%) of generating a JPEG that has invalid Huffman codes, without requiring a lot more CPU.
Or read this on Hacker News