They care but women are just not as strictly visual as men. In fact, when women are assessing the visual attractiveness of a man they’re still largely thinking about themselves, how a man makes them look. They’re natural narcissists and attraction for them is more contextual and story-driven. That’s why there’s only 2 types of men they’re consistently into: bad boys and providers. It’s less about how appealing either one is as an object unto itself and more about his role as a narrative accessory to her impression on other people, or how she imagines that to be.