neat trick i found
if you do controlnet Sketch weight 2.0 and stop it around 0.15 you can regen traits from quality gens