How can you tell whether you're splitting on someone, or whether they've actually done something bad enough to warrant you cutting them off?

In my case: I was seeing someone (hi if you're reading this, I know you've checked this sub), and we went on 3 dates. This is over the period of around 6 weeks, throughout which we talked a lot everyday. So naturally I eventually mentioned my BPD (I had a psych appointment that day, and he enquired about it; I really only told him my diagnosis and not much beyond that). It didn't seem to change his attitude towards me; he continued talking to me, still wanted to hang out, and so on.

But a few days ago, a problem occurred due to a misunderstanding. Then he went on to say he's glad the problem came up, because he had been thinking that he could not be with me anyway due to my BPD. Mind you I've hardly told him a thing about it and at this point I don't think I've displayed many of my symptoms. He continued to say that he's basically read a lot that a relationship with someone who has BPD is basically not a good idea. Everything he was saying sounded like he read a lot of shit off reddit from people who had a bad attitude about those with BPD. I was pretty shocked and saddened, because I'd really done nothing at this point and he was basically fearful of what \*could\* happen. Everything had been going quite well, he'd stayed over the previous night so at this point I felt misled since he'd shown interest and whatnot but apparently ever since I mentiond my BPD he's had no hope for a relationship. He said he was pretty confident it wouldn't work out between us due to the BPD.

I thought it was the end, but he wanted time to think. He came back later saying he was willing to give things a shot.

But I said I also needed time to mull it over. Honestly right now all I feel is anger and annoyance towards him. I feel I want nothing to do with him. Everything was great and going fine. But the fact that he said all that shit is just so offputting to me. It was so upsetting; I tried hard to not become attached, but our last night we did get close, and I started letting myself feel more. Now he's practically confessed he's never had hope for us despite nothing bad happening!! I felt abandoned. And I feel taking a chance with him will only lead to pain, for he will likely leave me at any sign of hardship.

So now I just feel anger, like I never want to talk to him again. Perhaps I'm splitting; he has shown he was ready to abandon me and I won't take the risk.

The logical side of me wonders, maybe his thoughts were reasonable and I'm overreacting and should give things a chance. But everything else screams, don't.

I don't know what to do. Everything was going great. Should I just go with my feelings and cut things off?