I don't know if I would want that kind of drama in my life. I would agree with the first person about this guy avoiding you. The question I would ask you, is this how you would like the rest of you life to be? Some people need drama in their life. I think it makes them feel better about themselves when people are feeling sorry for them. He has a choice to make and if he is not willing to cut his ties with his ex's then I would have to take a good look at this relationship and ask myself is this really what I want. Some times a person has to go through some struggles inorder grow as a person.
Good luck