Testing of the motor system in an unresponsive patient typically involves applying a noxious stimulus to the supraorbital nerve, the nail bed, or the temporomandibular joint and assessing the patient's reaction.