Not only because people dont really care that much, in fact you should be the only one judging you.

Great point. I think that is a really common fear that defines many people's actions. It is silly - I think people are often more focussed on their own problems.