Okay, I've hermited for more than a full year ingame and managed to get pretty good, so I'll be nice and drop a tiny guide in here.
First off, never ever leave even one criminal scent anywhere until you're "safe", meaning strong enough to defend yourself and your camp.
Knowing that, you start off by building a camp, "safe" from raiders or other threats.
Find a place with at lease some nodes (preferable clay for brickwall and more, water is also useful for later). If you're fast in building all that I'm about to say, you can't be bothered building next to a lake/river, it'll be useful.
When you've found a nice location, first thing you'll need is a house and claim over it.
Next thing you'll need is a palisade. Get this as fast as you can, because this will make you safe from most of HnH's population. Also, people that can bash palisades by hand/sledgehammer will probably never try to break into your camp, unless you did something wrong. Also be sure the whole palisade is claimed so it doesn't decay.
When you have a camp established, start making (trade) relationships with your neighbourhood, but be careful! Haven and Hearth has a nasty community, so always be careful when approaching other players.
If you see a large village, you better stay away from it until you think you can try talking to them (just incase they're hostile).
You will need a village claim in your camp as fast as possible too.
Why? This gives you access to trading from distance with other players (and this will boost your progress ALOT). It also makes your village safe from being claimed by another village claim, as village claims cannot overlap each other. As long as this claim and your personal claim stays here, you will never lose your settlement.
While you're working on the village claim you might want to start thinking about setting up a mine. Try to find a cave or build a minehole and start digging for ores. Metals will give you alot of advantages in.. uhm.. everything! You'll also need Iron for a brickwall later on.
When you have your house, village claim, mine, farm and all the other basic needs, you should think about getting a brickwall. This cannot be bashed by hand or sledgehammer, only with a ram, so you're even more safe!! Get a brickwall by getting iron and ALOT of bricks!

Last but not least, when you're done with all the above, you can start focussing on quality, skills, attributes, food and all the other things you need for your character!
Having all of this will give you alot more time for curios and all. This is the moment where your character should be boosting all his levels up in the sky.
Don't forget to keep gathering curios throughout all these tasks though! You'll just be alot more busy.
I hope this tiny guide will help you in your future hermit life! Enjoy it!!