Finetuned I-Bert for question answering task
How can we fine-tune an Integer Bert for question answering task?
2021-11-22T10:28:46Z
Hi,As explained inIBERT’s model card: fine-tuning the model consists of 3 stages:full precision fine-tuningquantizationquantization-aware training.So for the first step, you can fine-tune IBERT just as any BERT model. You can take a look at theexample scriptsas well as theofficial QA notebook.Step 2 is simply setting thequantizeattribute of the model’s configuration toTrue.Step 3 is the same as step 1, but now with your quantized model.