llama.cpp
C/C++ LLM inference engine behind much of the local AI ecosystem.
Best for: Max control and performance
Visit llama.cpp ↗Alternatives
O
Ollamaopen-source
Simple CLI/app to download and run open-weight LLMs locally.
94
/100
L
LM Studiofree
Desktop app to discover, download and chat with local models.
90
/100
H
Hugging Facefreemium
The hub for open models, datasets and Spaces.
75
/100
v
vLLMopen-source
High-throughput LLM serving engine.
72
/100