At current, there's pretty much no good curiosities newbs can find without Exploration. The devs need to add in more, so that Exploration doesn't become a requirement for getting LP. They shouldn't be incredible, but good enough to give newbs other options then Ant Empresses.
Bone Idols: Made out of five bones.
Buried Trinket: Found randomly when digging.
Amber: Found while collecting branches.
And finally:
Message in a Bottle: Can only be found while swimming, gives great LP, creates raeg threads.