Update README.md
Browse files
README.md
CHANGED
@@ -9,6 +9,8 @@ library_name: transformers
|
|
9 |
# fin-model-en-v0.1
|
10 |
## Introduction
|
11 |
This is a BERT model fine-tuned on a high-quality Chinese financial dataset. It generates a financial relevance score for each piece of text, and based on this score, different quality financial data can be filtered by strategically setting thresholds.
|
|
|
|
|
12 |
## Quickstart
|
13 |
Here is an example code snippet for generating financial relevance scores using this model.
|
14 |
```python
|
|
|
9 |
# fin-model-en-v0.1
|
10 |
## Introduction
|
11 |
This is a BERT model fine-tuned on a high-quality Chinese financial dataset. It generates a financial relevance score for each piece of text, and based on this score, different quality financial data can be filtered by strategically setting thresholds.
|
12 |
+
|
13 |
+
To collect training samples, we use the **Qwen-72B** model to thoroughly annotate small batches of samples extracted from Chinese datasets, and scored them from 0 to 5 based on financial relevance. Given the uneven class distribution in the labeled samples, we apply undersampling techniques to ensure class balance. As a result, the final Chinese training dataset contains nearly **50,000** samples. During the training process, we fix the embedding layer and encoder layer, and save the model parameters that achieve optimal performance based on the **F1 score**.
|
14 |
## Quickstart
|
15 |
Here is an example code snippet for generating financial relevance scores using this model.
|
16 |
```python
|