He lies buried at St James ' Cemetery , Toronto .
After 1854 Scarlett spent most of his time in town , by then renamed Toronto , where he died July 31 , 1865 .
Scarlett lies buried at St James ' Cemetery , Toronto .
After 1854 Scarlett spent most of his time in town , by then renamed Toronto , where he died July 31 , 1865 .