I finally got TruNas running an LLM on my AMD GPU!!! (gotosocial.michaeldileo.org)
from RagingHungryPanda@lemm.ee to selfhosted@lemmy.world on 26 Mar 21:12
https://lemm.ee/post/59547174

And I’m making everyone go to my gotosocial post because the server is running, so I’m going to use it!

#selfhosted

threaded - newest

possiblylinux127@lemmy.zip on 26 Mar 22:00 next collapse

You missed an e

RagingHungryPanda@lemm.ee on 26 Mar 22:29 collapse

Because it doesn’t feel real 😉

Edit: i thought you referred to TrueNas. I’m tired

possiblylinux127@lemmy.zip on 26 Mar 23:48 collapse

I think you are still missing an e in the title.

Cool project though

Condiment2085@lemm.ee on 27 Mar 01:23 next collapse

That’s so cool!!

liliumstar@lemmy.dbzer0.com on 27 Mar 07:18 next collapse

Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn’t really possible. Now, smooth sailing.

JigglySackles@lemmy.world on 27 Mar 12:36 collapse

Congrats!!

RagingHungryPanda@lemm.ee on 27 Mar 13:18 collapse

Thank you! This took so long to figure out

JigglySackles@lemmy.world on 27 Mar 18:35 collapse

I bet! That’s a lot of technical info to sort through, understand and create.