Do people actually look down at their controller when they play games? Who cares what letter is on what button? All you have to do is get acclimated to whatever control scheme your current game is using, which happens in the first hour or two of starting a game.
>I'm playing a PC game that uses Xbox Layout so A is on the bottom
>I'm emulating a Switch game so A is on the right
>I'm emulating a PS2 game so it's the same layout as Xbox except there's shapes on screen