Anonymous
8/19/2025, 11:33:56 AM
No.103656293
>>103653402
>>103649242
What's the breakpoint for something like the 355 MoE models or R1 @ q4 at a good speed? I'm used to only running things in exl3 so I have 48VRAM for 70b but it seems they're pretty much forgotten. 48 VRAM + 256 GB + a good mobo? Is quad channel necessary? I'm trying to avoid getting a workstation Mobo if possible since i still play games
>>103649242
What's the breakpoint for something like the 355 MoE models or R1 @ q4 at a good speed? I'm used to only running things in exl3 so I have 48VRAM for 70b but it seems they're pretty much forgotten. 48 VRAM + 256 GB + a good mobo? Is quad channel necessary? I'm trying to avoid getting a workstation Mobo if possible since i still play games