How to manually change the head of a fine-tuned model that doesn't work with AutoModelFor*?
Hi everyone,How can I manually remove the head of a checkpoint that was fine-tuned for a specific task, and then add my own head for another task?Let’s say I want to use thegoogle/bigbird-pegasus-large-arxivcheckpoint that has been fine-tuned forsummarizationonarxiv dataset. I cannot load it usingAutoModelForTokenClassificationas Big Bird Pegasus doesn’t have theTokenClassificationclass.Can anyone provide a generalizable solution to this?Thank you very much!