Maybe what you need is to take that vacation in a national park. Nobody would blink at a man with a camera
OR you could hang a lot of stuff around your neck that looks like it's meant for professional photography - lens bags, etc. Then nobody will think you're creepy - they'll think you're on assignment.
Or you could have a decal made for your VW "Timmah's Photography - If it moves, we shoot it. (except horses.)"