svdquant speeds up generation time:
RTX 3060 12GB @100W:
clip offloaded to cpu, flux in gpu fully:
100%|| 8/8 [00:24<00:00, 3.04s/it]
-total gen time:
after prompt change: 35 seconds
2nd gen: 25 seconds
clip device default, flux auto offload:
100%|| 8/8 [00:25<00:00, 3.15s/it]
-total gen time:
26s in both cases

@170w:
19s - 8 steps
29s - 20 steps