Alexander entered the ministry of the Free Church of Scotland and after serving as colleague in Free St John's, Glasgow (1866–1870), removed to Edinburgh as colleague and successor to Rev Dr Robert Candlish at Free St George's.