Most if not all of AJ's issues in later life stem from his relationship with his father.
He would have probably genuinely turned out better if Tony inducted him into the family business.