Get the latest tech news
Torchchat: Chat with LLMs Everywhere
Run PyTorch LLMs locally on servers, desktop and mobile - pytorch/torchchat
torchchat is a small codebase showcasing the ability to run large language models (LLMs) seamlessly. Follow the app's UI guidelines to select the model and tokenizer files from the local filesystem and issue a prompt. Michael Gschwind, Bert Maher, Scott Wolchok, Bin Bao, Chen Yang, Huamin Li and Mu-Chu Li who built the first version of nanogpt ( DSOGPT) with AOT Inductor proving that AOTI can be used to build efficient LLMs, and DSOs are a viable distribution format for models.
Or read this on Hacker News
