So, i've finally updated nunchaku to the nightly 1.0 version, with cfg 1.0 i can finally reach 1 or 2s per iteration.

For all winfuck users that are struggling with nunchaku update , you have to install the correct(python and pytorch combo) whl wheel with pip AND updating the nunchaku from comfyui manager to nightly or else it won't work.