Yik Yak logo
Download TikTok Instagram X
Yik Yak icon
Join communities on Yik Yak Download
Computer Science icon
Computer Science 15w
Running deepseek locally rn, I knew it was a good idea to get 64gb of ram - and honestly wish I had like 256 for the bigger models
comment

9
upvote 4 downvote
default user profile icon
Anonymous 15w

Any particular client you recommend for running it on? Prioritizing security / completely offline

upvote 1 downvote
default user profile icon
Anonymous 15w

Me with my 16gb ddr4 happy that i can run a minecraft modpack without crashes

upvote 1 downvote
default user profile icon
Anonymous 15w

Deep seek is primarily gpu vram, what card?

upvote 0 downvote
default user profile icon
Anonymous replying to -> #1 15w

I’m using ollama rn, I’ve been binging local LLM content recently and heard it’s not the most optimized/fastest but it’s the easiest, I do plan to go down the rabbit hole of a more optimal setup and install open web ui but I’ll do that after I install Linux - I’m getting so frustrated with windows + my install is unstable (I hope it’s os and not hardware)

upvote 1 downvote
default user profile icon
Anonymous replying to -> #2 15w

I have it set to mostly cpu, it’s only a 6gb 1060 so it’s not able to do much, the rest runs on a 5950x

upvote 2 downvote
default user profile icon
Anonymous replying to -> OP 15w

So then what model are you running?

upvote 0 downvote
default user profile icon
Anonymous replying to -> #2 15w

Deepseek-r1:32B

upvote 2 downvote
default user profile icon
Anonymous replying to -> OP 15w

I can fit 70b in ram but 32b is already a crawl on the cpu

upvote 3 downvote
default user profile icon
Anonymous replying to -> #3 15w

Damn, that’s me with my 16gb m1pro bc ram is so expensive on apple

upvote 1 downvote