As suggested in the announcement thread by someone else, replace the odd looking poles with small flagstone style graphics that can be walked over.
Alternatively, give us an action from mile stones to set the rally point for that stone. Then we can set up paths that go in straight lines and not have carts wander off the road.