>>280356226
there's a good chance the gorosei only found out he was the son of rocks after shamrock reported it to them during the reverie
and shamrock in turn might have only found out from shanks, who figured it out after getting scarred by him
his commanders know, but basically nobody else did. I don't think even whitebeard knew since he joined his crew under a fake name/his mother's maiden name
I'm guessing the number of people who even knew he had a kid at the time of his death was single digits