>>106361499
>nuh uh! see picrel!! offloading isnt supported in the CPP backend, nothing to do with comfy, flux has offloading implemented in the nunchaku CPP thing, not ComfyUI-nunchaku!!
Doesn't matter where this code is, this is NOT IN THE MODEL. This is CODE OUTSIDE OF THE MODEL. THE MODEL QUANTIZATION IS DONE. YOU CAN DOWNLOAD THE MODEL:

https://huggingface.co/nunchaku-tech/nunchaku-qwen-image/tree/main