i'm starting to wonder if transformer architecture already hit the wall. there are no more drastic improvements that can be done, and deepseek team already caught up on this.
it's really going to be a long wait until V4 or R2. i really hope they will release newer deepseek-coder tho