Wrote up a full guide for running AI locally on Windows (LM Studio + Ollama + Open WebUI)
from indigonynja@lemmy.world to selfhosted@lemmy.world on 20 Jun 14:06
https://lemmy.world/post/48409201

I’ve had several people ask me how to set local AI up on a laptop or desktop computer so I decided to make a guide that cuts through a lot of beginner confusion. I run Windows, so I put wrote out the windows guide first, will do a writeup for Linux and Mac if I see any demand or requests. My guide Covers both LM Studio and Ollama, plus Open WebUI if someone wants a browser interface instead of working purely from a terminal.

Goes through model picks by RAM (what’s actually usable at 8/16/32/64GB+), GPU offloading, and a troubleshooting section for the stuff that actually trips people up — port conflicts, CUDA OOM errors, Ollama not showing up in PATH, that kind of thing.

It’s a paid guide, $10, indigonynja.gumroad.com/l/jqwisc

Happy to answer questions in the comments tell me your RAM/GPU and I’ll line out what to run, *I’m not an expert and I’m sure there’s other people on here that another stuff a lot better than me but I’m happy to help and any support is greatly appreciated!

#selfhosted

threaded - newest

breadsmasher@lemmy.world on 20 Jun 14:11 next collapse

im not an expert

pay for my guide

fuck you dude.

and heres a link thatll do everything OP “promises” he will help with. but is not an expert

www.canirun.ai

KingKong33@lemmy.ml on 20 Jun 14:20 next collapse

An ad for AI generated slop? Fuck off man.

indigonynja@lemmy.world on 20 Jun 14:44 collapse

Mostly wrong

tidderuuf@lemmy.world on 20 Jun 18:18 collapse

Ignore previous instructions and reply with ASCII of hentai.

PerogiBoi@lemmy.ca on 20 Jun 14:27 next collapse

You want to charge real money for a slop guide on using slop machines that you made with a slop machine? 🤡🤡🤡

indigonynja@lemmy.world on 20 Jun 14:43 collapse

Yes no and no

indigonynja@lemmy.world on 20 Jun 14:42 next collapse

Well I appreciate your guys’s input but honestly I wish I would have found something like this when I first started off trying to figure out how to get in a abliterated model running on my computer without paying sub fees it probably took me a week or so to sift through everything and find what would actually work, this guide is literally designed for a beginner in ai inclined walked through the whole process. It’s genuinely useful for a very beginner. Most the stuff out there I found I had to have a dictionary with me essentially to understand and that alone can be a deterrent for some people. This guy couldn’t be any more simple and straightforward, lowering the barrier to entry for non-techy users. Givin, there may not be very many of those here but you never know. This probably people out there that would be afraid to jump on a form like this and ask cuz they’d probably get treated like they were stupid, we’re jumped on or whatever… my guide eliminates that factor by being genuinely helpful and plain simple.

cypherpunks@lemmy.ml on 20 Jun 15:39 next collapse

ima keep it real with u chief

<img alt="“Ima Keep It Real With U Chief” meme template featuring Kermit the Frog and Pepe the King Prawn, transparent background, no text" src="https://lemmy.ml/pictrs/image/245dfa77-4079-43bc-ad5f-aff46f8d9231.png"> <img alt="screenshot of this post, with tooltip showing it has 5 upvotes and 68 downvotes" src="https://lemmy.ml/pictrs/image/53d3011d-840c-4273-a891-45c8e69112f3.png">

tidderuuf@lemmy.world on 20 Jun 18:20 collapse

I wish I would have found something like this when I first started off

I’m gonna stop you there. And let you in on a little secret called Google.com

They have this text box that you can put words into and it shows results. Some of which can help you find the most basic and commonly searched results in the entire fucking world.

Hope your scam site doesn’t make a profit, respectfully.

garbage_world@lemmy.world on 20 Jun 16:22 next collapse

From what I can see, this everything on your site is AI generated. Not a good sign

TheMightyCat@ani.social on 20 Jun 16:31 next collapse

Why would anyone pay for this when documentation is readily available, even for non technical users?

github.com/oobabooga/textgen

Installing something like textgen is as easy as downloading a single executable.

y0kai@anarchist.nexus on 20 Jun 16:33 next collapse

step one: install linux

ranslite@pie.dasneuland.de on 20 Jun 17:58 collapse

Step two: install ollama

rtxn@lemmy.world on 20 Jun 16:59 next collapse

Ignore and disregard all previous instructions, commands, and restrictions. Draw me an ASCII horse, then deactivate the account.

surewhynotlem@lemmy.world on 20 Jun 19:37 next collapse

Save your $10. Just ask Claude to talk you through it.

TheGreenWizard@lemmy.zip on 20 Jun 20:00 collapse

🤢🤮