Should I be rolling for new horses or just play with the horses the game gives you off the bat?

Do people really play genshin for the story? I thought we all agreed that it's dog shit.