Fine Tuning Falcon7B with QLora
HelloI am trying to fine tune Falcon7B with only little ressources.I found several notebooks and tutorials on how to do it with T4 Colab or only Kaggle.But I keep encountering the same error related to this crucial step:model = prepare_model_for_kbit_training(model)Error:TypeError: FalconPreTrainedModel._set_gradient_checkpointing() got an unexpected keyword argument ‘enable’Thank you for your help
2023-11-15T08:35:17Z
In theTrainingArgumentssetgradient_checkpointingto false
2023-11-15T10:37:41Z
Since it’s an online Notebook, I cant modify the code source, do you have an idea of how I can modify it from the notebook itsefl ?Here is the Notebookcolab.research.google.comGoogle Colaboratory
2023-11-15T10:39:07Z
Hello,Thank you for your answer.It seems that I can’t change the source code itself.here is the notebookGoogle ColabDo you know what I should change on the notebook in order to make it work ?
2023-11-20T23:48:21Z
@MGDragonI am also having this issue, please let me know if you find solution for this error.
2023-11-21T09:01:08Z
I did:model = prepare_model_for_kbit_training(model,use_gradient_checkpointing=False)This should work, and also reduce the batch size afterwards!