• 0 Posts
  • 137 Comments
Joined 2 years ago
cake
Cake day: June 4th, 2023

help-circle


  • Not sure if it counts as “budget friendly” but the best and cheapest method right now to run decently sized models is a Strix Halo machine like the Bosgame M5 or the Framework Desktop.

    Not only does it have 128GB of VRAM/RAM, it sips power at 10W idle and 120W full load.

    It can run models like gpt-oss-120b or glm-4.5-air (Q4/Q6) at full context length and even larger models like glm-4.6, qwen3-235b, or minimax-m2 at Q3 quantization.

    Running these models is otherwise not currently possible without putting 128GB of RAM in a server mainboard or paying the Nvidia tax to get a RTX 6000 Pro.
















  • I use Jellyfin but I download all my songs from Tidal, Qobuz or Deezer and tag them automatically right then and there in a clean format so Jellyfin does not have to guess at all.

    I also have some automatic checks in place to convert incorrect metadata to a proper format. Like moving artists from the title (feat. Somebody else) to the artists tag Somebody; Somebody else and a bunch more.

    Together with Finamp on desktop and mobile everything is pretty much working as expected.



  • I switched from Fedora KDE to Kinoite a few months ago. Both were 100% stable for me as well.

    The main reason I switched to Kinoite is because I’m a digital hoarder and after 5 years or so all my systems are completely trashed with various libraries, 12 different PHP/.NET versions, custom builds and a bazillion Python packages.

    In the end it always causes issues like my builds stop working because I have some ancient version of a library stashed away somewhere.

    Immutable distros are really easy to return to “factory defaults”. It keeps a list of all the packages that are installed on the system and everything else now goes in Toolboxes, Distroboxes or Docker containers. If I mess up my C++ environment (again) I can just delete that toolbox and start from scratch.

    I still manage to bloat my home directory but that is much easier to clean up than looking through all system files.