Ollama

Open-source tool to download, manage, and run LLM models locally. Supports Llama, Mistral, Phi, and many more. With a single command, you can start a model and access it via a local REST API. It is one of the easiest ways to get started with local AI.