The NTK formula_34 represents the influence of the loss gradient formula_35 with respect to example formula_36 on the evolution of ANN output formula_37 through a gradient descent step: in the scalar case, this readsformula_38In particular, each data point formula_39 influences the evolution of the output formula_37 for each formula_41 throughout the training, in a way that is captured by the NTK formula_34.