Get the latest tech news
Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3. - abi/secret-llama
Entirely-in-browser, fully private LLM chatbot supporting Llama 3, Mistral and other open source models. Works offline Easy-to-use interface on par with ChatGPT, but for open source LLMs In addition to WebGPU support, various models might have specific RAM requirements.
Or read this on Hacker News
