The original building on the site was completed, as a private dwelling, in mid-to-late 1843, by John George Nathaniel Gibbes, the then Collector of Customs for New South Wales and a member of the New South Wales Legislative Council.