I very rarely came across rude or disrespectful people. I don't know how I slipped by all of them but I honestly can't think of one experience off the top of my head that was like that. I'm sure they're there but I'd have to think really hard to recall them.
You can hold yourself back from the sufferings of the world that is something you are free to do and it accords with your nature but perhaps this very holding back is the one suffering you could avoid.