His centre-right party "New Social Contract" is also leaving with him.