Removing a plant from a garden pot should take a little bit of time, which allows players to stop if they are doing it by mistake. Even a second or two would be enough.
Too often when I'm harvesting plants there's 1 or 2 that aren't ready yet and end up removed instead of harvested. Worst of all, sometimes happens while doing garden credo quests like "Harvest 40 Strawberries", and despite planting them all at the same time, you end up with 38 ready and mistakenly remove one of the last two.
Please add a short delay.