When you click on a stump with the "dig" command, the player will dig it up with a shovel. If the shovel is available and can be equipped, it will be removed.
A small improvement for gardeners and builders: changing the command will allow you to switch to the desired tool.