He attended Barrow-in-Furness Grammar School for Boys where his favourite subject was English. At the end of his fifth year, Brown was asked to leave the school, later stating that he was a "dreadful troublemaker". He lives in Paddock Wood, Kent, with his wife. They have two children.