Pytorch like loop for finetuning whisper
Hello! I was wondering if there is any pytorch like loop based training code for finetuning Whisper. I have come checked and tried the references mentioned in other topics (one trained on Japanese kana) but I haven’t found one that replicates the results onFine-Tune Whisper For Multilingual ASR with 🤗 Transformerswhich uses the Trainer. I have to conduct some very intricate operations on the model (registering hooks adding decoders etc. ) and the Trainer object isn’t conducive to them. Please let me know how I may be able to train using a torch like loopwhich replicates the resultsof the Trainer object to a fair margin of error.