Hoyne was born on February 11, 1817 in New York City, New York. He was married to Leonora Maria Temple. They had seven children. Hoyne was killed on July 27, 1883 in Carlton, New York in a train crash, aged 66.