Anonymous
8/6/2025, 5:15:30 AM
No.106158442
>>106158404
if you can fit a model entirely into vram (+kv) then you keep going until you hit the sweet spot. if you can't fit a model anyways into vram just go for a quality thats decent. look for q4 at the lowest unless you literally don't have the ram to fit it otherwise.
if you can fit a model entirely into vram (+kv) then you keep going until you hit the sweet spot. if you can't fit a model anyways into vram just go for a quality thats decent. look for q4 at the lowest unless you literally don't have the ram to fit it otherwise.