Sometimes, when we think deep down that we don't deserve to be happy we will seek out people that hurt us because, in a twisted way, it feels "right" when we're being abused.
Words DO have incredible power. In some ways we are little more than incredibly complex computers, filled with programming we aren't even ourselves aware of, but can rise to the surface unexpectedly because of a few harsh words.
That said, we can take control of our lives by refusing to associate with people that use words to harm and manipulate. Until you can learn to become the "Zen master" and maintain perfect internal control, you can work on controlling the outside world and your place in it. Good luck, buddy.