Anonymous
8/6/2025, 8:53:16 AM
No.106159621
>>106159597
Big glm for me runs at 10t/s tg at q8. I’ve got dual epyc w/768gb ddr5 4800 sysram.
I need more vram though because 24gb gives me barely any usable context (16k) at that bit depth.
Big glm for me runs at 10t/s tg at q8. I’ve got dual epyc w/768gb ddr5 4800 sysram.
I need more vram though because 24gb gives me barely any usable context (16k) at that bit depth.