Please correct me if I am wrong, but my understanding is that siegecraft now requires rage, which makes sense from an aggressive attacking standpoint. I don't think that is unreasonable. However, could there perhaps be an alternative mechanic for tearing down palisades on a personal or village claim that you have rights to that does not require siege equipment? Maybe you have to build or craft something specialized and maybe it could take a number of days to work, depending on the size of the palisade. It just seems like it should be an option.
You can say "just plan ahead so you don't have to bash your walls" or "make an alt" but I feel that these are not really addressing the core issue.