Usually when you just ask someone there's a perfectly legitimate explanation for even the strangest of behaviors but do feel free to carry on fantasizing.
That being said it may be perfectly legal to film this fellow as well, seeing as how he seems to be in a public place the whole time. If at any point he had entered the front yard of anyone and you continued to film him then technically you would be breaking the law. Jurisdictions may vary.