Get the latest tech news
Ollama and gguf
What is the issue? The original model coudl run without problem, but the gguf model fail to run for below errors May need an update of ggml dependencies like llama.cpp ggml-org/llama.cpp#15091 Note...
The original model coudl run without problem, but the gguf model fail to run for below errors Note: Running gguf on llama.cpp without problem. 👍React with 👍11kappa8219, b9AcE, musica2016, duyvo18, tomtanti and 6 more😕React with 😕1codeswhite
Or read this on Hacker News