In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel which describes the evolution of deep artificial neural network during their training by gradient descent.