Ferrer was born in Santa Monica, California to Academy Award-winning actor José Ferrer and singer Rosemary Clooney. His first cousin is actor George Clooney. He never went to college because he began his Hollywood career at an early age. His career began in 1981. He was married to actress Leilani Sarelle from 1991 until they divorced in 2003. In 2005, he married Lori Weintraub. They had three children.