Golden era of haven for so many people was w10, where roads circumnavigated the globe, making the game feel like a larger community. In w11, this got destroyed for some reason, and then reverted to make it less painful, but still miserable.
Right now the answer to being able to travel is sleeping (not playing the game, yikes), Heartwood leaves (limited resources) and pipeweed (okayish).
Just remove it or make it so it passively comes back at bed speed while awake.