Forest Grove, OR
I've been thinking about this a lot and I can't quite say that I feel this way towards objects/buildings/etc but I can see how others might. In contrast, I was never comfortable taking pictures of people when I traveled in underdeveloped countries (unless I had their permission of course) and I always wonder how other photographers got comfortable with candid shots where I wouldn't necessarily assume they had permission (though I could be totally wrong about that).
In the end, however, I think it's about intent of the photographer. Beyond that, a photographer can't control the thoughts or reactions of those that view one's photos...
My $0.02 worth at any rate.