What GPU should I get to run the DeepSeek R1 32b?

Question

I’m planning to run the DeepSeek R1 32b, and I’m not sure which GPU would be best suited for it. Any suggestions?

RedDragon2000 · Accepted Answer

The 5080 is a solid choice for this, tho you really gotta be careful with the VRAM limits. I remember when I first tried running a 32b model... I thought I had plenty of room until the context window started filling up and the whole system just chugged. It was super frustrating because I kept getting these random out-of-memory errors halfway through a generation. Make sure to keep an eye on your quantization levels because that 32b model is gonna eat up space way faster than youd expect. I would suggest sticking to a 4-bit quant if you want to keep things stable, otherwise youre definitely gonna run into some headaches once you start doing longer prompts.

U_NNNN · Answer

I running it with my RTX 5080.