Vermilye, who was of Huguenot ancestry, was "a descendant of one of the oldest families of New-York, the original founder of the family, Mr. John Vermilye, having immigrated to this country from England in 1690."