I think we've all ran into a few people like this.
Personally, I no longer take photos of planes inside of hangars because I feel like I'm encroaching on the line between "in public view" and "in private view" and don't want anyone fussing over it. Again, that's just me though.
Most people I've talked to love that fact that I have photos of their plane(s) on here. It's led to some great conversations. There's always a few that look at it the opposite way. If it were me I would probably just remove the photos so the guy quits bugging you.
Best of luck to you!