Crops will fall fallow in winter. Fallow crops can be harvested at any time for a reduced amount of seeds of the relevant plant.
I think we all assumed he meant "dormant" instead of "fallow." But apparently he meant "dead." At least so far, I haven't seen any crops return to their natural state.
I can't say I like this mechanic. It just leaves the hearthlands looking, well, dead.