First time playing this game and hope I can fulfill a summoner power fantasy.

If one steals in the imperial city and nobody sees it, does it cause any infamy or badness? I'm thinking of doing the thieves guild first