They conjectured that the training process of a DNN consists of two separate phases; 1) an initial fitting phase in which formula_15 increases, and 2) a subsequent compression phase in which formula_14 decreases.