Yeah, materials aren't the problem. You should be able to build a
pretty darned good wall out of just stone and earth alone.
The moral of the story: Make existing walls not suck.
Though some kind of
epic fortress style stone wall for all us wannabe castle builders would be cool.
