troed

Ollama as a general LLM server and then LLaVa as model

I host a SearXNG instance and follow the Matrix channel. Haven’t seen anything along those lines.

The AI support doesn’t hurt you if you don’t use it - and they’ve done the right thing by making sure you can do things locally instead of cloud.

Here’s what AI does for me (self-hosted, my own scripts) on NC 9:

When our phones sync photos to Nextcloud a local LLM creates image descriptions on all the photos, as well as creating five tags for each.

It is absolutely awesome.

You want Matrix. Synapse if you intend to host for others, Conduit if you just want to host for yourself. There are quite a few different clients but I do indeed use ElementX on mobile.

That sounds problematic. Where do they detail this?

Wikipedia:

Google Safe Browsing “conducts client-side checks. If a website looks suspicious, it sends a subset of likely phishing and social engineering terms found on the page to Google to obtain additional information available from Google’s servers on whether the website should be considered malicious”.

But why are random people visiting your instance?

If you were just selfhosting services for you and your family, would really browsers be flagging your site?

C is crap for anything where security matters. I’ll happily take that debate with anyone who thinks differently.

Tenacity is a thing.

https://tenacityaudio.org/