Active Learning code example
I am looking for an example code implementing supervised training with active learning for sentence classification using large transformer models such asmeta-llama/Llama-2-7b-chat-hf.I tried using thesmall-textlibrary but it does not support large transformer model sizes. Unfortunately, small-text was not able to load and perform distributed training of large models.Please let me know of any good code examples or good libraries which implement active learning with large transformers models.
2024-06-07T16:35:51Z
https://github.com/NielsRogge/Transformers-Tutorials/blob/master/BERT/Fine_tuning_BERT_(and_friends)_for_multi_label_text_classification.ipynbhttps://huggingface.co/docs/transformers/main/en/model_doc/llama2#transformers.LlamaForSequenceClassificationHugging Face has sequence classification models that can be used interactively by adding user input into the fine-tuning.