Thanks for the input on this topic. Most of our palisade is already in place now. Looks like we're going to exclude the cliffs when we get to the brick wall, and suffer through reduced security for the moment.
As it stands I'm hoping we deter minor thieves/bandits with the wall, and deter advanced thieves/bandits with the lack of awesomeness in our town.