scottsuk0306 commited on
Commit
6df0472
1 Parent(s): 3874afe

Training in progress, step 1000

Browse files
README.md CHANGED
@@ -1,19 +1,54 @@
1
  ---
2
- language:
3
- - ko
4
- - en
5
  tags:
6
- - bge
7
- - m3
8
- - embedding
9
- - korean
10
- license: mit
11
  ---
12
 
13
- # BGE-M3-Korean
 
14
 
15
- This is a Korean fine-tuned version of the BGE-M3 model.
16
 
17
- ## Model Description
18
 
19
- This model is fine-tuned from BAAI/bge-m3 for better Korean language understanding.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
 
 
3
  tags:
4
+ - generated_from_trainer
5
+ model-index:
6
+ - name: bge-m3-ko
7
+ results: []
 
8
  ---
9
 
10
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
+ should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # bge-m3-ko
14
 
15
+ This model was trained from scratch on an unknown dataset.
16
 
17
+ ## Model description
18
+
19
+ More information needed
20
+
21
+ ## Intended uses & limitations
22
+
23
+ More information needed
24
+
25
+ ## Training and evaluation data
26
+
27
+ More information needed
28
+
29
+ ## Training procedure
30
+
31
+ ### Training hyperparameters
32
+
33
+ The following hyperparameters were used during training:
34
+ - learning_rate: 1e-06
35
+ - train_batch_size: 1
36
+ - eval_batch_size: 8
37
+ - seed: 42
38
+ - distributed_type: multi-GPU
39
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
+ - lr_scheduler_type: linear
41
+ - lr_scheduler_warmup_ratio: 0.1
42
+ - num_epochs: 1.0
43
+ - mixed_precision_training: Native AMP
44
+
45
+ ### Training results
46
+
47
+
48
+
49
+ ### Framework versions
50
+
51
+ - Transformers 4.44.2
52
+ - Pytorch 2.4.0+cu121
53
+ - Datasets 2.19.0
54
+ - Tokenizers 0.19.1
config_sentence_transformers.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "2.2.2",
4
+ "transformers": "4.33.0",
5
+ "pytorch": "2.1.2+cu121"
6
+ }
7
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0e24d72bdd0c269873db4265fa0b335c8dddc017c08fc457abe5eec60d20c538
3
  size 1135554344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55c0b5294de835106edefe64998b0ea512b1719c75716d69e64198c25a3d8f8f
3
  size 1135554344
sentence_bert_config.json ADDED
File without changes
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f97c76a329cc35b471496c55846d209d03646f80739d5ccd5cc49e4a6ea5974
3
  size 7544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed27f68abc856e8b7782ba47e59467f4ea34d916bde91a9ab78f3f3d19b1f60a
3
  size 7544