DISCOVERED IN HACKER NEWS
Llamafile
Llamafile: a product linked in Hacker News recommendation discussions.
Developer tools
3Recommendation signals
3Sources
2024-10-12Latest mention
Why does HN talk about it?
Automatically selected excerpts in their original language. Read the full discussion for context.
If your goal is > Run and explore Llama models locally with minimal dependencies on CPU then I recommend https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which ships as a single file with no dependencies and runs on CPU with great performance.Read the full discussion
> then I recommend https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which ships as a single file with no dependencies and runs on CPU with great performance.Read the full discussion
I’ve been using llava via https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile which runs on any modern system.Read the full discussion