I deal with this in motorsports. Most of the time I go in looking for a specific shot, like this one. I know the car or bike is on its run and that will take time, I'm already set up for the shot so I get it and purposely set the camera aside to watch its run, though it's still ready if something happens.

Don't forget to live in the moment, not everything has to be recorded.