imryanxu commited on
Commit
e02accf
·
verified ·
1 Parent(s): 725f530

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -9,6 +9,8 @@ library_name: transformers
9
  # fin-model-en-v0.1
10
  ## Introduction
11
  This is a BERT model fine-tuned on a high-quality Chinese financial dataset. It generates a financial relevance score for each piece of text, and based on this score, different quality financial data can be filtered by strategically setting thresholds.
 
 
12
  ## Quickstart
13
  Here is an example code snippet for generating financial relevance scores using this model.
14
  ```python
 
9
  # fin-model-en-v0.1
10
  ## Introduction
11
  This is a BERT model fine-tuned on a high-quality Chinese financial dataset. It generates a financial relevance score for each piece of text, and based on this score, different quality financial data can be filtered by strategically setting thresholds.
12
+
13
+ To collect training samples, we use the **Qwen-72B** model to thoroughly annotate small batches of samples extracted from Chinese datasets, and scored them from 0 to 5 based on financial relevance. Given the uneven class distribution in the labeled samples, we apply undersampling techniques to ensure class balance. As a result, the final Chinese training dataset contains nearly **50,000** samples. During the training process, we fix the embedding layer and encoder layer, and save the model parameters that achieve optimal performance based on the **F1 score**.
14
  ## Quickstart
15
  Here is an example code snippet for generating financial relevance scores using this model.
16
  ```python