Local LLM Lab

LiteLLM Docs

Docs for routing many LLM providers through OpenAI-compatible APIs and gateways.

LM Studio Developer Docs

Local LLM developer docs for running models with OpenAI-compatible endpoints.

awesome-selfhosted

Browseable directory of self-hostable software and services.

GGUF Format & Quantization (Hugging Face Hub)

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

LocalAI

The free, OpenAI, Anthropic alternative. Your All-in-One Complete AI Stack

Ollama

Ollama is the easiest way to automate your work using open models, while keeping your data safe.

llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

vLLM Docs