As title says, there are yellow, red, brown leaf trees that still gives fresh green leaves.
Make it so that trees will give different leaves, that cant be used for their destinations when they are not green (like using laurel as spice or feeding silkworms with mullberry leaves), or just make them unharvestable during season.