Pale skin in prompt. Tan skin, dark skin in negative prompt. Man still turns out brown. Leave the prompt the same, inpaint 100% of the male, he is remade as white.

Why is this? Why does the inpainted version come out how I wanted, yet the prompt is the same?