Lack of empathy from others

Does anyone else get depressed when seeing others not display empathy? I don't understand how so many people don't care about others. I have this expectation that everyone should be as empathetic as me, and when they're not, I get depressed.