It makes no sense to me that I'm unable to steal from someone if they accidentally leave their front door wide open, or that I could kill someone and take the key to their base off their corpse, open the gate to their base, and stand right in front of all that precious loot without being able to touch it unless I bash through a wall with a wrecking ball. I understand the implementation of the visitor debuff to make people feel more comfortable with social interaction and to make it easier to trade, but it doesn't make sense to force it on an unwanted guest with clearly bad intentions. Nobody should feel safe leaving their base open for anyone to enter. That makes no sense in a game like Haven and Hearth, and I always considered it a crucial part of the game. Locking doors has become practically pointless. I have a simple solution that makes sense to me.
If someone has criminal acts enabled before they enter the gate, they shouldn't get the visitor debuff, and it should be considered tresspassing. The person clearly doesn't intend to have a friendly visit if they have criminal acts enabled. And, if someone enters through the gate without criminal acts enabled, they shouldn't be able to enable it with the visitor debuff on, just so they aren't able to change their mind.
I see no reason why this wouldn't be implemented. There is no reason to protect someone stupid enough to leave their gate open, or to let their key fall into someone else's hands. At the very least, I think the visitor debuff should be thought about more.