Secretary of War Edwin M. Stanton had decided that white officers would be in charge of all "coloured" units. Andrew chose Robert Gould Shaw to be the regiment's colonel, and Norwood Penrose "Pen" Hallowell to be its lieutenant colonel. Many of the other officers in charge of the 54th Regiment were from abolitionist families. Governor Andrew chose several of them himself.