>>106244940
Make sure you're using 3.2 24B 2506. Its still repetitive, but not nearly as repetitive as previous versions. Here are my samplers
>Temp 0.8
>minP 0.05

Fuck around with the rep penalty as much as you like. If you still can't stand it, check out Mistral Nemo 12b instruct, Rocinante, Gemma 3, and maybe the qwens in that order.


Anyone fuck with ooba's multimodal functionality yet? Got it running for Mistral Small and doing some testing. Using the F16 mmproj file. Not sure if it makes a difference if I use the F32 or BF16.