Burnside was born in Liberty, Indiana and was the fourth of nine children of Edghill and Pamela (or Pamilia) Brown Burnside, a family of Scottish origin.
Burnside blev født i Liberty i Indiana som det 4. af Edghill og Pamela (eller Pamilia) Brown Burnsides 9 børn, en familie af skotsk oprindelse.