Nevertheless, ancient sources allege poverty for the Flavian family at the time of Domitian's upbringing, even claiming Vespasian had fallen into disrepute under the emperors Caligula (37–41) and Nero (54–68).