How to load after calling trainer.model.push_to_hub() on a fine tuned model?
I fine-tuned a falcon-7b model and calledtrainer.train()usingSFTTrainerfrom huggingface’strlpackage.Callingtrainer.model.push_to_hub('hub_name')pushes three files to the hugginface repository–aREADME.md, anadapter_config.json, andadapter_model.bin. I’m having trouble finding any documentation that describes how to use these file formats.At first I found this huggingface page, “Using Adapter Transformers at Hugging Face.)”, and it says to use the class “AutoModelWithHeads”. However, this class won’t load after downloading theadapter-transformspip package on Google Colab, I think it’s deprecated? Also, callingadapter_name = model.load_adapter(ADAPTER)model.active_adapters = adapter_namewith AutoModel results in this error:AttributeError: ‘RWForCausalLM’ object has no attribute ‘load_adapter’How can you apply adapter_model.bin files? My code was based on the officialFalcon-7b huggingface tutorial, where they link a Google Colab notebook on that page.
2023-10-09T13:55:43Z
Same Problem here with LLama 2, did you fix this somehow or did you find a solution?