For windows you could use plastic film. We used to put it up in the winter, it helps keep condensation off too.