As a man, is it a faux pas to wear a mixture of yellow gold, and steel/silver jewellery?

I've always heard that best practice was to pick a metal tone and stick to it, but typically this rule applies more strictly to woman, right?

Do you mix metals?