Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
|
18 |
# apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
|
19 |
|
20 |
-
This model is fine-tuned for black-box LLM calibration as part of the 🍑 Apricot paper ["Calibrating Large Language Models Using Their Generations Only"](https://
|
21 |
|
22 |
## Model description
|
23 |
|
@@ -38,14 +38,11 @@ More information needed
|
|
38 |
|
39 |
**TODO**: update the values below
|
40 |
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
-
|
45 |
-
|
46 |
-
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
47 |
-
- lr_scheduler_type: linear
|
48 |
-
- num_epochs: 3.0
|
49 |
|
50 |
### Framework versions
|
51 |
|
|
|
17 |
|
18 |
# apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
|
19 |
|
20 |
+
This model is fine-tuned for black-box LLM calibration as part of the 🍑 Apricot paper ["Calibrating Large Language Models Using Their Generations Only"](https://arxiv.org/abs/2403.05973) (ACL 2024).
|
21 |
|
22 |
## Model description
|
23 |
|
|
|
38 |
|
39 |
**TODO**: update the values below
|
40 |
|
41 |
+
This model was trained with the code available on the [parameterlab/apricot GitHub repository](https://github.com/parameterlab/apricot) using the following command:
|
42 |
+
|
43 |
+
```shell
|
44 |
+
python3 run_regression_experiment.py --model-identifier lmsys/vicuna-7b-v1.5 --dataset-name trivia_qa --device cuda:0 --num-training-steps 600 --num-in-context-samples 10 --data-dir $data_dir --model-save-dir $model_save_dir --result-dir $result_dir --lr 0.00003369 --weight-decay 0.008936 --model-save-dir models --push-to-hub
|
45 |
+
```
|
|
|
|
|
|
|
46 |
|
47 |
### Framework versions
|
48 |
|