Then maybe the permission system should be a little finer in granularity, because in case I allow someone to travel over my land that someone should still be a criminal in case he decides to attack me or others - which is a worse act compared to stealing or breaking stuff...
So 'Castle Doctrine' should be a separate permission.
Oh, and does that apply to villages with white group trespass enabled too?