Put up a really big wall. They'll never go away. All you can do is keep them out. Start off with a
Palisade, then when you can, upgrade to a
Brick wall.
If it's that much of an issue, try to locate somewhere else with friendlier neighbors or join a village with said amenities already.
Also, don't leave things in cabinets you absolutely need to be there when you come back.
Opinions expressed in this statement are the authors alone and in no way reflect on the game development values of the actual developers.