If he wanted to save Nozomi, he could have just gone back a few days but he went all the way
The real reason he went back is for Hiruko. It's why her route has an ending that can be considered a Golden Ending