Local LLM — LM Studio · llama.cpp · Ollama · vLLM
The trend of running large language models directly on personal computers has taken hold rapidly since 2023. Where there used to be only cloud APIs, the combination of quantization formats like GGUF, inference runtimes…