I don't really get how it works either, it still seems like players that go and explore all day find the good stuff and anyone stuck doing the village chores or anyone that just does not have hours to spend walking around seem to get left behind.
I'm not certain that it SHOULDN'T work this way but it would be nice to be able to just do what you want, village related or exploration related and still find something once in awhile.
I personally don't find much of anything, ever. Still only one bluebell since world start but it sounds like I'm still doing better than you, Portgas!