So this is just a major issue but it is sometime I would like to change. I've been married for 6 years. Whenever my wife holds my hand or arm in bed at night I get anxious about it and my muscles start flexing a little. I feel the need to move the part of my body that's being touched but I also feel that my wife expects me to not move my hand or arm or whatever part of my body it is. The reason I feel this expectation from my wife is usually because we're trying to go to sleep or rest. 

My wife wants to sleep while cuddling some nights but it's not really possible for me to relax enough to fall asleep while we're touching in any way. It's not possible for me to fall asleep in a few minutes. It usually takes about 10 minutes according to a Fitbit I used to own years ago. Although it usually feels more like 30 minutes since I'm not aware of the time and so many other things whole I'm trying to fall asleep. 

To explain in another way I have a physical feeling that compels me to move my body in some way (as if to prove to myself that I'm not being constrained possibly) and mental anxiety that is telling me I should remain still and relaxed because my wife would feel me move and our intentions are to fall asleep and moving would be counteractive to that. Is this part of my ADHD or is this a pretty normal experience? What can I do to be less anxious in these situations?