Ok, looks like the model already has very good arithmetic performance out of the box, at least when prompted with the large prompt explaining how to do long division/long multiplication.