>>81775322 (OP)Sometimes the traits selected for in women may appear in their sons. (Part of the reason you shouldn't breed short women no matter how cute they are, it will give you manlet sons.) Over a millennium this adds up. Women with petite bodies are less like to starve in famine due to low TDEE. Same thing with shorter and slender men. Half of asian history is dealing with famine.
There is also the fact that wars in the past century have had a dysgenic effect instead of a eugenic effect. Used to be that a large population of men would go to war or a nation would host war. In these wars, the strongest men survived and proliferated their genes through the widows of their nation and/or the war brides of their enemies.
War is instead a lottery of death where weak and strong are killed alike while the elderly, cowardly, and dysgenic stay at home with easy access to the women.
Japan, for example, actively selected men who were not scared of death and put them in kamikaze planes, and saw them being young and without children as a bonus (no grieving family to compensate). Now they are left with men that are too sissy to even speak to women unless forced to.
The same has happened to the west as well, but we had a better starting point due to larger frames from the necessity of european winters.
There are also the issues with pollutants that effect hormones, but that's a long tangent.