Married to Blasina Tobar Finch in 1843, he was the father of future Colombian president Miguel Antonio Caro as well as future first lady Margarita Caro Tobar, the wife of another president Carlos Holguin Mallarino.