From 2016 to 2018, Stewart was Minister of State at the Department for International Development and Minister of State for Africa, and on 9 January 2018 he was appointed Minister of State for Prisons.