>>105894507
Dense models will make a comeback when we have the hardware to run them sufficiently in ~5 or so years when we have LLM specific inference hardware (server grade, not for consumers)