# LLM inference engines — GitHub repository comparison

Canonical HTML: https://gitdebt.com/compare/llm-inference

> llama.cpp, vLLM, Ollama, SGLang and TGI serving stacks.

## Repositories in this category

| Repository | Report | Markdown |
| --- | --- | --- |
| `ggml-org/llama.cpp` | https://gitdebt.com/ggml-org/llama.cpp | https://gitdebt.com/ggml-org/llama.cpp.md |
| `vllm-project/vllm` | https://gitdebt.com/vllm-project/vllm | https://gitdebt.com/vllm-project/vllm.md |
| `ollama/ollama` | https://gitdebt.com/ollama/ollama | https://gitdebt.com/ollama/ollama.md |
| `sgl-project/sglang` | https://gitdebt.com/sgl-project/sglang | https://gitdebt.com/sgl-project/sglang.md |
| `huggingface/text-generation-inference` | https://gitdebt.com/huggingface/text-generation-inference | https://gitdebt.com/huggingface/text-generation-inference.md |

## Overlay every repository on one chart

```markdown
![LLM inference engines star history](https://api.gitdebt.com/api/chart.svg?repos=ggml-org%2Fllama.cpp%2Cvllm-project%2Fvllm%2Collama%2Follama%2Csgl-project%2Fsglang%2Chuggingface%2Ftext-generation-inference&rebase=1&theme=dark)
```

Public repositories only. Open the canonical HTML page for the interactive timeline and the per-repository health columns.