I run different models using Ollama

Ollama

Ollama is the easiest way to automate your work using open models, while keeping your data safe.

Its very easy to install and then add/run the models. I have used DeepSeek, Qwen and some more specialized isolated in a virtual machine with lots of ram and cpu.