 The standard approach had been to train these models using central processing units, or CPUs. But these calculate their instructions sequentially. So instead, this team ran these training calculations using graphics processing units, GPUs. A graphics card handles tens of thousands of instructions at a time. And who makes graphics cards? NVIDIA, of course.