Genetics is a factor
It is demonstrated that modern Olympic rowers cannot compete with their ancient equivalents.

Look up the modern reconstruction Olympias