This is a pun on 'kicking myself', which is another way of saying you regret something, in this case the speaker is regretting not taking karate lessons earlier in his life, but it's also being used because you kick things in karate 
I am kicking myself I did not take up karate earlier .