Kingston was born in Adelaide, the son of Sir George Kingston, a Protestant Irish-born surveyor, architect and landowner in the early days of British settlement in South Australia and later a member of the first Parliament of South Australia.