village management is rather stressful for many people, so many men, so many minds.
as for myself, i couldnt have fun dealing with all the internal problems, complaints, events, conflicts, or my own dislikes arising daily, and decided to stay away since w4. its harder especially when you know all are nice people, cause you cant even kick them lol i felt like i was a hotdog inside a bun pushed so hard from both sides (and slipped outside). i spent most of my time talking, not playing game and i was always too frustrated to have fun. i love talking, but you know, it really depends on topics and time

(its much more fun just translating and talk about other people's business but not your own.)
anyways. i understand your frustration. im not an ambitious player, so lp gain does not worry me much, but still, its always sad to see someone starting later are ahead of you. the problem is rather that you feel guilty for foraging outside when your job is a miner/trader, no? (i felt too guilty for hunting for so long.)
i think it is frustrating for foragers too, its not like foragers are promised to find all good curios all the time.
a friend asked us what system we used the other day, saying all his farmers never stay to farm but go outside to forage. someone else was complaining on IRC that lately there were no decent farmers any more lol
so i bet this is not only your issue but some others are facing.
maybe youd better learn to become selfish yourself for fun, or learn to accept others selfishness for fun with respect, or if possible, talk with your own villagers for solutions or get more foragers like sabinati said.
(none of them worked well enough for me, though. i learned im not up to this on w3.)
maybe devs could let miners and farmers obtain a bit more curios out of their daily works to balance out with foragers later if we get heard. but it may be a tough work when we dont want bot companies to prosper.