>>512487154
Populations can and do become more intelligent over time, just as they get taller, or as they adopt any new trait.
Of course it might take some time to populate an island with 7ft+ giants, but you could probably reach a point where most 7ft giants come from your island relatively quickly.

Selective pressures are applied continuously, and eventually that deck of high cards becomes a deck of aces.