There is a beautiful Sanskrit proverb that says, "Nobody gives happiness or misery. It is created by one's own mind." It means that you take unhappiness from others. You question people, "Why did you behave like that? Why did you insult me?"
It is useless to do so. You should have compassion and feel, "Oh this person does not have that refined level of consciousness." If you don't want to be insulted, then nobody can insult you.
If you are basing your life on these feelings, you will be ruined because emotions are not stable at all. And not only are you bothered by your feelings, you also bother everybody by your feelings which are anyway momentary. The first thing in spiritual path: Praise yourself and praise others.
And stop blaming your self and others. Lord Krishna says to Arjuna, "You are so good, you already have all the good qualities. I am only just bringing them up in you. Don't worry."
There is a story of a Guru who had stupid disciples. So, any work that the Guru would give, the disciples would do the opposite. Once the Guru's daughter was getting married and he told the disciples to whitewash the front of the house.
The disciples went and whitewashed the opposite house. The Guru asked, "What did you do? Now the baraat (bridegroom's family) is coming. Quickly whitewash the front." When the guests arrived, the disciples caught hold of each guest and started painting them. The guests got so annoyed that they cancelled the wedding. The Guru was very upset. But then he later found out that the groom was not mentally sane.
The lesson: Even though the disciples were stupid, something good came out of all their mistakes.
So, the point is to see the positivity everywhere and in everyone, and hold the mind steadfast in the self. That is a sign of yoga and it will bring skill in action, success in endeavours and happiness in one's being.