So I was making a cabin, and on my last trip back (before trees were replantable), I placed the VERY last board.. and click! I hit destroy. Oh dear, I don't think the trees were too happy about that one.
Perhaps some materials that were in the build queue should be dropped on the ground after destroying unbuilt things? Just an idea, might save the clumsy types some trouble.