These new MoE models are fucking stupid.