>>106292070
I have a 3090 and I just use Deepseek off OpenRouter.
There's a free version of it too and you can switch to less than a tenth or hundredth of a cent.
Not sure why I'd ever unnecessarily blast my GPU at full wattage for hours just to have sex with Ninetails.
>>106292070
I survived the text/audio generation with 8GB. And cutting it close with image generation with quantized versions. But any video model is a no go. 16GB is the mininum. Not 12gb. Optimal is 20+GB. 64GB DRAM + 20+GB VRAM