I have a bit of wisdom that I don't know if you have thought about.
People often speak and act out of a motivation that is called transference.
I believe he may be expressing feelings of bitterness towards you do not fully deserve. I realize you said that you did treat him badly, but if I hear you right you are saying you feel his rejection of you is exaggerated or out of proportion to the reality of the situation. People are highly influenced by their previous hurts and emotional wounds, etc. It sounds like really the both of you could have been dumping negative emotions on each other in the past, as you have described. I would encourage you to look to your own soul and consider how you might be helped to clear up your own issues concerning him.