>>106128892
>it is concerning it's getting to a point consumer cards must quant in order to do anything
this is just because the models and training/inference code are bloated and unoptimized. all of them. we're going to see many 10x speed, memory footprint, and quality improvements yet.

>>106128914
just use linux and a venv. I have never had comfy break, and I'm on AMD which is supposed to be buggy and have poor support.