>>106478186
Don't think it's stupid, but you might have to repaste & repad the TIMs.
3080 was a very popular card, so there are plenty of online resources sharing accurate thermal pad measurements.
Use soft pads if you decide to replace them.

You'll also have to lower some texture settings on some titles, but I don't think this will be a deal breaker, considering the raw performance gain.
The 9060 XT & 5060 Ti have weaker GPUs than the 3080.
https://www.techpowerup.com/gpu-specs/geforce-rtx-3060-12-gb.c3682