I had this same problem, then I figured out that the edges of your building have to be half-way through a tile of pavement. So, build another ring of pavement around your existing one, and make sure there is half a tile of cobble on all sides - problem solved!
