I have a friend that has stated he was diagnosed with anxiety and depression  prior to us being friends. We've tried to hang out before in public but he's had panic attacks before when we went to a small Magic tournament  at our local comic book store. He's come by to hang out and drink a few times, we've played social-ish games like dnd/pathfinder. So I don't think he's antisocial in any kind of way but recently he barely wants to interact when I ask if he wants to hang out somewhere quiet or just come chill out at my house. 

My main question is as someone who isn't depressed/go8ng through a depressed period, how do I interact with him without pushing too hard? I worry about him since he's shutting himself off and has stopped all of his hobbies,  but I don't want to be intrusive and over step.

Open to any criticism  for hiw my thinking is, but just trying to figure out how I should approach my friend to make sure he's okay and kind of give him that back up if he needs someone