Does it only count surviving castles?

I've also remembered that the UK lost a lot of castles back in the old days, they all got blown up.