I have been looking for something just like this, thanks

If it is working for you as is, no need to make a change

Interesting, I see that is pretty new. Some of the documentation must be out of date because it definitely said Nvidia only somewhere when I tested it about a month ago. Thanks for giving me hope!

Wish I could accelerate these models with an Intel Arc card, unfortunately Ollama seems to only support Nvidia

I personally have absolutely no services with an open port to the internet, everything accessed remotely goes through Tailscale. I just don’t trust that I could do it myself safely