After Aizuwakamatsu Castle fell, Saitō and the five surviving members joined a group of former Aizu retainers who traveled southwest to the Takada Domain in Echigo Province, where they were held as prisoners of war.