i have had and do have villagers who arent on often, which isnt an issue for me, when i trust that person. but when someone is new and you dont really know them, and you see them only a couple of times a week, then it is a security issue for a town.
If i am going to invite someone to the town and give them a job, which is how we work, and they turn up a few times a week, whereas everyone else is on daily for many hours achieving the success that the part timer enjoys without putitng in the same effort, then it seems unfair to me. When we have big projects which tend to be the shitty parts like brick burning and building walls and various other things, i'm not going to be able to depend on someone who isnt on a lot, since when they do log, they'd possibly have enough time to do some of their job and possibly forage for themselves some curios and then theyre off.
so as an investment, its pointless for a large town to take on someone who cant play regularly. at least being able to log 2 hrs a day is decent, it worries me when i dont see villagers logging, because it means me or someone else who plays more has to cover their job, and really no one wants to equip and support someone who we then have to do their job for them untilt hey log in again.
good luck, you may well find a casual small town which has similar players who arent hardcore regulars like yourself that you can enjoy the game with.