Anonymous
6/23/2025, 8:37:24 PM
No.105682744
bors what to use for local small scale stuff
I got 24gb vram on my PC but only 8gb on my work laptop so can't really do shit.
Currently using
general stuff: mistral-small-3.2-Q6
code generation: gemma-2-9b-it-Q8_0
I got 24gb vram on my PC but only 8gb on my work laptop so can't really do shit.
Currently using
general stuff: mistral-small-3.2-Q6
code generation: gemma-2-9b-it-Q8_0