Get the latest tech news
Can You Run the Llama 2 LLM on DOS?
Slashdot reader yeokm1 is the Singapore-based embedded security researcher whose side projects include installing Linux on a 1993 PC and building a ChatGPT client for MS-DOS. He's now sharing his latest project — installing Llama 2 on DOS: Conventional wisdom states that running LLMs local...
Slashdot reader yeokm1 is the Singapore-based embedded security researcher whose side projects include installing Linux on a 1993 PC and building a ChatGPT client for MS-DOS.He's now sharing his latest project — installing Llama 2 on DOS: Conventional wisdom states that running LLMs locally will require computers with high performance specifications especially GPUs with lots of VRAM. Thanks to an open-source llama2.c project [original created by Andrej Karpathy], I ported it to work so vintage machines running DOS can actually inference with Llama 2 LLM models. (They even addressed an early "gotcha" with DOS filenames being limited to eight characters.)
Or read this on Slashdot