Numbers should always be adjusted based on what the game expects me to fight. If I'm going to fight Titans, Gods, Jailer, etc etc. Then I want to be doing big numbers.
If I'm expected to fight weak beta bitches like the Bitch King and Incelidan Stormrage. Then I want to do smaller numbers