I'm curious about something. do you guys experience something similar? is this even a bipolar thing? 

when I'm not on medication or the meds who work like they should. 

I have problems to go outside, sometimes. I have problem with people looking at my direction, it feels almost threatening. or people who want to get to know me (in places  for example we have mutual friends), I feel really uncomfortable and sometimes even don't answer their questions. I have even this problem with people online. 
But I can't say what my fear is about. 

I stay in this certain times more inside and go just out, if I really need something like food.
but when I'm on drugs (namely antipsychotics) this problem disappears. I start to go outside again and meet new people. I basically live my life.

is this a bipolar thing? btw I'm bipolar 1 or Schizoaffectiv. My therapist said it wouldn't matter that much, because the treatment is the same.