During the second act I just figured if I explored every planet I would find all the rumors and never looked twice at it

I now (act 4) discover that if you return to some planets there is stuff actively going on, but this is not marked on the map when looking around, you have to put your cursor on the system to see that something id going on inside
Just how much did I miss in act 2?