Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Why are you using Ollama? Just use llama.cpp

brew install llama.cpp

use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app



For MLX I'd guess.


That also comes upstream from llama.cpp https://github.com/ggml-org/llama.cpp/discussions/4345


https://omlx.ai/


Does this have a CLI only interface?


Yes. You could also look at the README.md.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: