Get the latest tech news
Etched Is Making the Biggest Bet in AI
2022, we made a bet that transformers would take over the world. We’ve spent the past two years building Sohu, the world’s first specialized chip (ASIC) for transformers (the “T” in ChatGPT).
Transformers are shockingly similar: tweaks like SwiGLU activations and RoPE encodings are used everywhere: LLMs, embedding models, image inpainting, and video generation. We’ve secured enough HBM and server supply from top vendors to quickly ramp our first year of production Our early customers have reserved tens of millions of dollars of our hardware Video models generate one frame per second 17, and even OpenAI ran out of GPU capacity when ChatGPT signups hit 10M users, just 0.15% of the world.
Or read this on Hacker News