>>16789675
It doesn't. Just as your hand doesn't avoid silver balls. Thus, the fact that you are holding a gold ball tells us something about what happened, and we can exclude one box.