I figured it out. Set some focus on producing more soldiers and making the people more supportive of the Count's regime