taylorbobaylor commited on
Commit
1e9e39c
·
1 Parent(s): 4a5cd69

End of training

Browse files
Files changed (1) hide show
  1. README.md +3 -23
README.md CHANGED
@@ -1,9 +1,8 @@
1
  ---
2
  license: bigcode-openrail-m
3
- library_name: peft
4
  tags:
5
  - generated_from_trainer
6
- base_model: bigcode/tiny_starcoder_py
7
  model-index:
8
  - name: peft-lora-starcoder-chat-asst-A100-40GB-colab
9
  results: []
@@ -16,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [bigcode/tiny_starcoder_py](https://huggingface.co/bigcode/tiny_starcoder_py) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.2075
20
 
21
  ## Model description
22
 
@@ -50,7 +49,7 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:----:|:---------------:|
53
- | 2.649 | 0.67 | 100 | 2.2075 |
54
 
55
 
56
  ### Framework versions
@@ -59,22 +58,3 @@ The following hyperparameters were used during training:
59
  - Pytorch 2.0.0
60
  - Datasets 2.15.0
61
  - Tokenizers 0.15.0
62
- ## Training procedure
63
-
64
-
65
- The following `bitsandbytes` quantization config was used during training:
66
- - quant_method: bitsandbytes
67
- - load_in_8bit: False
68
- - load_in_4bit: True
69
- - llm_int8_threshold: 6.0
70
- - llm_int8_skip_modules: None
71
- - llm_int8_enable_fp32_cpu_offload: False
72
- - llm_int8_has_fp16_weight: False
73
- - bnb_4bit_quant_type: nf4
74
- - bnb_4bit_use_double_quant: True
75
- - bnb_4bit_compute_dtype: bfloat16
76
-
77
- ### Framework versions
78
-
79
-
80
- - PEFT 0.6.3.dev0
 
1
  ---
2
  license: bigcode-openrail-m
3
+ base_model: bigcode/tiny_starcoder_py
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: peft-lora-starcoder-chat-asst-A100-40GB-colab
8
  results: []
 
15
 
16
  This model is a fine-tuned version of [bigcode/tiny_starcoder_py](https://huggingface.co/bigcode/tiny_starcoder_py) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.2079
19
 
20
  ## Model description
21
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:----:|:---------------:|
52
+ | 2.6488 | 0.67 | 100 | 2.2079 |
53
 
54
 
55
  ### Framework versions
 
58
  - Pytorch 2.0.0
59
  - Datasets 2.15.0
60
  - Tokenizers 0.15.0