“I’m not fighting with you”

What’s a good “comeback” for that? I was just trying to discuss things with him and he always just says “I’m not fighting with you”. I’m AWFUL when it comes to standing up for myself and I just say “I’m not fighting or arguing” but it’s not enough. Any time I want to talk to him, he says that. And yeah, I know I know, best thing would be to just pack up & go (I’m working on that) but I need a response in the meantime. As much as I hate him and I know he has SOME issue in his brain, there’s a part of me that always, always hopes “maybe one day he will get better” “maybe one day he will change” “maybe one day he will care about my feelings” … wishful thinking, I know. I’m an idiot 😔