>>106378087
>What is DPO
>What is SFT

Have you been paying attention to this thread at all? A well curated DPO data set alone will probably be good enough to lessen the shivers to a noticeable extent, if not entirely.