It depends.
Sometimes when you aggro, let's say a fox, it will run around signs, and sometimes it'll just destroy them, even though there is a clear path.
I'm not really sure what triggers any of these issues, though I wouldn't let my village take the risk.