Seems like the fp8 text encoder introduces more motion while the fp16 is more stiff.
>>106141184
Set block swap to 40 and tick every offload switch. Also how much system ram do you have.