I doubt Bojack even actually felt sorry. When you tell someone you are sorry you have to mean it and I don't think he did. He just wanted to feel better about himself and Herb didn't give him that.
It's the same with that 'tell me I'm a good person' speech he did with Diane.