>>2939938
Within the scope you have, there's a plethora of options.
I'd say the easiest option by far is to just get a large enough NMC 18650 battery that it can outlast the winter. These esp32 sensor projects can have very very low power consumption if they are sufficiently optimized, you can run one for several years off just a single 18650 with a single charge.
Now, since you want a weather station, weather station will probably have sensors that run on interrupts, so you can't utilize deep sleep mode and as such won't get the ultra low power consumption, but you can still achieve about 50-100 days off a single charge of a single 18650 with light sleep and some reserve for broadcasting data in intervals. Get 3 18650 in parallel and you should easily get through winter. Repurpose a 5V solar power bank's circuitry or whatever else for charging, maybe give the esp32 functionality to disable charging when it detects enclosure temperature under 0C. There are lots of various solar-lithium charging modules on aliexpress, you can even just get a 5V solar panel and connect it to a USB-to-18650 charging circuit's input.
More complicated options would be LTO, Na-ion batteries or an insulated enclosure with a built-in heater that uses the solar panel to heat the enclosure before starting to charge the NMC battery.
>caveats for lead acid
Decreased capacity, decreased efficiency, risk of freezing if you discharge the battery too much when it's too cold. Lead acid is still workable, I just wouldn't use it in any project, because the longevity of the batteries is so bad even without the low temp factor.
Insulating the electronics box really well could also be enough to maintain 0C+ inside even without additional heating. Maybe putting a tiny resistor on the solar side to dump like 0.1-0.2W inside the box all the time from solar.