Do you think I did the right thing..?

I suggest just hanging around until you make friends that are acutally cool to talk to, then drop him. This guy doesn't deserve your friendship if he is like that.