Model save

README.md

@@ -6,28 +6,30 @@ tags:
 - generated_from_trainer
 - trl
 - sft
-license: apache-2.0
-datasets:
-- OpenAssistant/oasst1
+licence: license
 ---
 
-# notHumpback-Myx
+# Model Card for notHumpback-Myx
 
-This model follows the Humpback architecture, proposed in the paper [Self-Alignment with Instruction Backtranslation](https://arxiv.org/pdf/2308.06259) 
-by Li et al.
+This model is a fine-tuned version of [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B).
+It has been trained using [TRL](https://github.com/huggingface/trl).
 
-It represents the "backward model", which is used to generate instructions from web texts. These are considered as possible model outputs.
+## Quick start
 
-Humpback uses instruction backtranslation on a web corpus to generate input-output pairs (self-augmentation), 
-creating a richer dataset for fine-tuning models without the need for additional manual annotation.
-The model then iteratively curates the created dataset, scoring the pairs by quality, and is then finetuned on the resulting subset 
-of all pairs with the highest possible score (self-curation).
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="Alepach/notHumpback-Myx", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
 
-Varying from the original paper, this model is a fine-tuned version of [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B).
-It has been trained using [TRL](https://github.com/huggingface/trl).
 
-The dataset used to train this model has been sampled from the [oasst1](https://huggingface.co/datasets/OpenAssistant/oasst1) dataset. 
-In order to achieve the "backward" structure, the model is trained on output-input pairs.
+
+This model was trained with SFT.
 
 ### Framework versions
 
@@ -39,18 +41,7 @@ In order to achieve the "backward" structure, the model is trained on output-inp
 
 ## Citations
 
-Original paper:
 
-```bibtex
-@misc{li2023selfalignment,
-    title={Self-Alignment with Instruction Backtranslation},
-    author={Xian Li and Ping Yu and Chunting Zhou and Timo Schick and Luke Zettlemoyer and Omer Levy and Jason Weston and Mike Lewis},
-    year={2023},
-    eprint={2308.06259},
-    archivePrefix={arXiv},
-    primaryClass={cs.CL}
-}
-```
 
 Cite TRL as:
     

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6363ec1a035cd7af9d4beb1c18baaca6aa941b0bb170eb33378fdddea3dbed9c
+oid sha256:69de60651018900fe91a6663e026a0c4d97c115b56e6147eb2cfbef4615d8fb9
 size 4965799096

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b6994d2660bda6dfe7f473f56b27aeb1a78d4b743508b1e6c6ddae996f1f4db8
+oid sha256:7335e946d7197501f57939c4dd520663e0e301bab0bf6faf140a8d59feafd205
 size 1459729952

special_tokens_map.json

@@ -13,11 +13,5 @@
     "rstrip": false,
     "single_word": false
   },
-  "pad_token": {
-    "content": "<|finetune_right_pad_id|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
+  "pad_token": "<|finetune_right_pad_id|>"
 }

tokenizer_config.json

@@ -2053,15 +2053,11 @@
   "chat_template": "{{- bos_token }}\n{% set ns = namespace(system_message='') %}\n{%- for message in messages %}\n    {%- if message['role'] == 'system' %}\n        {% set ns.system_message = message['content'].strip() %}\n    {%- elif message['role'] == 'user' %}\n        {{- '<|start_header_id|>user<|end_header_id|>' + ns.system_message + '\\n' + message['content'].strip() + '<|eot_id|>' }}\n    {%- elif message['role'] == 'assistant' %}\n        {{- '<|start_header_id|>assistant<|end_header_id|>' + message['content'] + '<|eot_id|>' }}\n    {%- endif %}\n{%- endfor %}\n",
   "clean_up_tokenization_spaces": true,
   "eos_token": "<|end_of_text|>",
-  "max_length": 131072,
   "model_input_names": [
     "input_ids",
     "attention_mask"
   ],
   "model_max_length": 131072,
   "pad_token": "<|finetune_right_pad_id|>",
-  "stride": 0,
-  "tokenizer_class": "PreTrainedTokenizerFast",
-  "truncation_side": "right",
-  "truncation_strategy": "longest_first"
+  "tokenizer_class": "PreTrainedTokenizerFast"
 }

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e64bae3fccca4a5921c72056a6283073e78cbbe6cf47e7d312aff49e77f208c6
+oid sha256:870ae2e32c102e49c08b17791d1b79605cb1e4c2926081ec569d9b43c21d8ccd
 size 5560