Only mini models on non specific purpose hardware. To run full models you would need a machine tailored for running AI models. My experience is with ollama only.
Login to reply