The switch is located between them and it's obvious when you go to use it and you can see it activated visually.
Wouldn't the other pilot immediately say something like, "I just saw you switch it to cutoff you bloody benchod!" or similar? Either way, very rare for the switch to fail unless there's something else that failed or whatever.