Update README.md

README.md

@@ -43,13 +43,15 @@ This percentage is *calibrated* in the following sense: given a set of answers a
 
 Answering a question and obtaining a certainty score proceeds as follows. 
 
-1. Prompt the model with a system and/or user prompt.
+1. Prompt the model with a system prompt followed by the user prompt. The model is calibrated with the system prompt below. 
 2. Use the model to generate a response as normal (via the `assistant` role).
 3. Prompt the model to generate a certainty score by generating in the `certainty` role (by appending `<|start_of_role|>certainty<|end_of_role|>` and generating).
 4. The model will respond with a certainty percentage, quantized with steps of 10% (i.e. 5%, 15%, 25%,...95%).
 
 When not given the certainty generation prompt `<|start_of_role|>certainty<|end_of_role|>`, the model's behavior should mimic that of the base model [ibm-granite/granite-3.0-8b-instruct](https://huggingface.co/ibm-granite/granite-3.0-8b-instruct). 
 
+**System prompt** The model was calibrated with the system prompt `You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully follow instructions. You are helpful and harmless and you follow ethical guidelines and promote positive behavior.` 
+It is recommended to prepend this to any other desired system prompts.
 
 
 
@@ -73,7 +75,7 @@ tokenizer = AutoTokenizer.from_pretrained(BASE_NAME,padding_side='left',trust_re
 model_base = AutoModelForCausalLM.from_pretrained(BASE_NAME,device_map="auto")
 model_UQ = PeftModel.from_pretrained(model_base, LORA_NAME)
 
-system_prompt = "You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully follow instructions. You are helpful and harmless and you follow ethical guidelines and promote positive behavior." #NOTE: this is generic, it can be changed
+system_prompt = "You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully follow instructions. You are helpful and harmless and you follow ethical guidelines and promote positive behavior." 
 question = "What is IBM?"
 print("Question:" + question)
 question_chat = [