fact is dense models are OVER. nobody will want to run 1T dense at 0.5 t/s. moe unironically killed local.