Update README.md

README.md

@@ -10,6 +10,7 @@ model-index:
   results: []
 datasets:
 - mandarjoshi/trivia_qa
+library_name: transformers
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -28,16 +29,10 @@ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggin
 
 More information needed
 
-## Training and evaluation data
-
-More information needed
-
 ## Training procedure
 
 ### Training hyperparameters
 
-**TODO**: update the values below
-
 This model was trained with the code available on the [parameterlab/apricot GitHub repository](https://github.com/parameterlab/apricot) using the following command:
 
 ```shell
@@ -49,4 +44,31 @@ python3 run_regression_experiment.py --model-identifier lmsys/vicuna-7b-v1.5 --d
 - Transformers 4.32.0
 - Pytorch 2.0.0+cu117
 - Datasets 2.14.6
-- Tokenizers 0.13.3
+- Tokenizers 0.13.3
+
+## Citation
+
+If you find 🍑 Apricot models useful for your work, please cite our paper:
+
+``` latex
+@inproceedings{ulmer-etal-2024-calibrating,
+    title = "Calibrating Large Language Models Using Their Generations Only",
+    author = "Ulmer, Dennis  and
+      Gubri, Martin  and
+      Lee, Hwaran  and
+      Yun, Sangdoo  and
+      Oh, Seong",
+    editor = "Ku, Lun-Wei  and
+      Martins, Andre  and
+      Srikumar, Vivek",
+    booktitle = "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
+    month = aug,
+    year = "2024",
+    address = "Bangkok, Thailand",
+    publisher = "Association for Computational Linguistics",
+    url = "https://aclanthology.org/2024.acl-long.824",
+    doi = "10.18653/v1/2024.acl-long.824",
+    pages = "15440--15459",
+    abstract = "As large language models (LLMs) are increasingly deployed in user-facing applications, building trust and maintaining safety by accurately quantifying a model{'}s confidence in its prediction becomes even more important. However, finding effective ways to calibrate LLMs{---}especially when the only interface to the models is their generated text{---}remains a challenge. We propose APRICOT (Auxiliary prediction of confidence targets): A method to set confidence targets and train an additional model that predicts an LLM{'}s confidence based on its textual input and output alone. This approach has several advantages: It is conceptually simple, does not require access to the target model beyond its output, does not interfere with the language generation, and has a multitude of potential usages, for instance by verbalizing the predicted confidence or using it to re-prompting the LLM to accurately reflecting its uncertainty. We show how our approach performs competitively in terms of calibration error for white-box and black-box LLMs on closed-book question-answering to detect incorrect LLM answers.",
+}
+```