Inference

Ollama

Run large language models locally with a simple Python API — supports Llama, Mistral, Gemma, and dozens more open-source models