Looks like it gives aooriximate direction, and the water node is an area, not a visible 1-tile-spot. Just try to put your well hundred times in the place the arrow shows.
If it's anything like the old prospecting, randomly changing arrows basically means there's nothing nearby. Once you get closer to a well zone, they start pointing in the same direction.
I'd guess Q of div rod influences this a bit.
Lucky: haven is so quirky Lucky: can be so ugly, can be so heartwarming Sevenless: it is life