Torch JIT Training
Whilst the primary purpose of Pytorch’s Torchscript & JIT compilation is for export & inference, it does seem to support training too, e.g.:SpellSpeeding up model training with PyTorch JITPyTorch JIT can be used to enable 2x-3x speedups on custom module code.Curious to hear if anyone has tried it with Transformers & HF Trainer?