Yes, it's a delicate balance no matter what. I suppose "Would you go there without diplomatic immunity?" is not a terrible test to employ. On the other hand, there are surely places where you'd be okay as a foreigner or a tourist, but where the situation is not good for locals.