Unable to prepare model for kbit training
Hi, i am trying to finetunephi 1.5on a custom dataset using QLora. When i run:model = prepare_model_for_kbit_training(model)I receive the following errorAttributeError: ‘MixFormerSequentialForCausalLM’ object has no attribute ‘_set_gradient_checkpointing’peft version : 0.5.0transformer: 4.33.2
2023-09-20T20:34:07Z
Same problem here, Because of that the GPU is filling up like crazy. If you got it solved by now, Could you share here?
2023-11-14T16:41:12Z
Excuse me, did you solve this ?