He was the son of Dr. William Fraser Tolmie, a prominent figure in the Hudson's Bay Company and a member of both the colonial assembly of Colony of Vancouver Island and the Legislative Assembly of British Columbia.