You just need to balance it by having seasonal bonuses. For example you may not be able to grow anything when there is snow all over the ground, but that was traditionally the season for hauling work because nice hard frozen ground, a slippery low friction mantle of snow and a sled meant that getting logs out of the forest was a quarter of the work that is was in other seasons. It was also the season for visiting and travel for the same reason. A nine hour journey in the summer on a bad road could easily be accomplished in four with a sleigh instead of a wagon.
It's the food supply that is perplexing. If there is a really mild winter like in Southern Britain you can have winter crops like turnips and cabbage to keep your brand new player alive but then really you only have two seasons: summer (with pretty changing colours) and winter with occasional slush and plenty of rain. If you have a hard winter you could make it much easier to hunt animals like deer that would get bogged down in the snow... but you don't want to make it too easy either. You could make things painfully complex, such as by ruling that things like cheese and other preserves only ripen in the winter and have to be consumed by the summer or they spoil but that would be even worse. The oldbies would swear shockingly and there would be no trickle down to the newbies. It is far easier to toss 132 mouldy cheeses into a snowbank than it is to try to trek half a supergrid to deliver them to the food bank.
I'd love a four season Haven and Hearth with food products specific to each season but finding a balance could involve the poor devs going to post-post-graduate school and each getting a doctorate in law just to hang onto the student apartment where the server lives long enough to get it done.