Well... yeah. What with your situation. But you know what; it's his loss; leaving you would have come back to bite him in the ass, ergo; you don't need to have a relationship with him if you were fine prior to him being around.
I had a high fever, so I was burning up, my head was killing me, I could barely think and I layed in bed all day.