People pray looking to the sky because they're praying to the heavenly father, the pure consciousness. You are that pure consciousness but your ego, senses, etc. create a sense of separation. Your mind can affect reality, but most people don't know that or how the process works, so they're told to pray in sincere faith to the Father, which they do bowing their heads to the sky or looking at it.
Faith is the key to the Father answering your prayers. You can reach a point where you'll just know, you won't have to rely on pure faith, if you put in the work though.