I dont think it applies if everyone you know is actually an asshole.
The takeaway from the phrase is just to check yourself and your attitude. Make sure you aren't the one being difficult before you confirm that all these other people are shit heads.
Juat about self-awareness.
That's the whole basis of CBT