TW suicide

I posted this also in relationship advice. But I really would appreciate a perspective from someone with bipolar. I'm trying to understand.

I'm feeling pretty numb. I know I did the right thing, but I'm dealing with the fallout of him hating me. My ex is a bipolar alcoholic, when things are good, they're amazing, when they're bad, it's bad. I am in recovery, he was actually my rock bottom. Years ago, we had a incident of domestic violence. That I won't go into here, but I did report it 

A couple years later, we reconnected. We were actively talking about getting back together. I have a one year old so I promised myself to take things slow and to get pit if it got bad. Fast forward to this Monday, I go over to his house and he's in active withdrawal. I go with him to get vodka since withdrawal is dangerous and planned to talk to him after he had a drink.

He took a sip of vodka and immediately started vomiting. I start getting upset and talk to him about treatment, he dismissed it. He then goes on a two hour rant about how he's going to kill himself. Active plans. Saying he's going to shoot himself in the head in a area where his roommates will find him. I am uncontrollably crying and he keeps saying things like 'don't be sad for me. This is what I want. Remember the good memories of me' and told me he would kill himself within the month and I would probably be the last person he sees.

I try to get him to go the hospital, he refuses. I still can't stop crying and he tells me to go home and move forward. I didn't call the police immediately when I should have, and I was reeling the next day. I wasn't sure if it was real or not.

I called a wellness check last night, the police came, didn't take him and he called me screaming. A mix of threatening me, saying to never speak to him again, and saying him talking about that was a normal part of a relationship. And I ruined all chances of us getting back together. I told him that I loved him and I couldn't live with myself if he harmed himself and I knew and did nothing.

I also called his cousin, who said he had been concerned and that he told him he had bought a gun. My question is: how do I move forward? I feel like I got put in a horrible position. Was I supposed to do nothing? I had already decided that I couldn't continue and he wasn't safe to be around my daughter but I still feel guilty. I've never been used to the amount of venom he has. I still keep looking for his call and I just don't know how to feel.

TLDR;

Ex told me about his active plane for suicide and I called a wellness check. I feel guilty and numb and have no idea how to move forward. He hates me.