Consider a ANN with fully-connected layers formula_43 of widths formula_44, so that formula_45, where formula_46 is the composition of an affine transformation formula_47 with the pointwise application of a nonlinearity formula_48, where formula_49 parametrizes the maps formula_50.