You don't need 20+ units in Civ V/VI unless you're fighting multi-front wars. The improved combat mechanics make it possible to defeat armies and capture cities with relatively small armies.