Running the Latest and Greatest LLM Locally

Install OLlama

curl -fsSL https://ollama.com/install.sh | sh

Install LiteLLM

Depends on OLlama for the local gateway , but also connects to Anthropic , Groq , and