deep down you know transformers already hit the wall. there will be no massive improvements if LLM still stuck with it