The eastern side of the cove remained largely uninhabited in the early years of the colony; one notable inhabitant was Bennelong, after whom the adjacent Bennelong Point and Bennelong Apartments are named.