
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# output

This model is a fine-tuned version of [zhihan1996/DNA_bert_6](https://huggingface.co/zhihan1996/DNA_bert_6) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0956
- Weighted Accuracy: 0.5700
- Accuracy: 0.6720
- Precision: 0.6857
- Recall: 0.6720
- F1: 0.6629

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 0
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 5

### Training results

| Training Loss | Epoch | Step | Validation Loss | Weighted Accuracy | Accuracy | Precision | Recall | F1     |
|:-------------:|:-----:|:----:|:---------------:|:-----------------:|:--------:|:---------:|:------:|:------:|
| 2.1252        | 0.1   | 500  | 1.8724          | 0.1992            | 0.4278   | 0.3715    | 0.4278 | 0.3541 |
| 1.7093        | 0.2   | 1000 | 1.6105          | 0.3387            | 0.5068   | 0.5441    | 0.5068 | 0.4799 |
| 1.5284        | 0.31  | 1500 | 1.4462          | 0.4009            | 0.5601   | 0.5604    | 0.5601 | 0.5395 |
| 1.4336        | 0.41  | 2000 | 1.3640          | 0.4169            | 0.5813   | 0.5854    | 0.5813 | 0.5618 |
| 1.3521        | 0.51  | 2500 | 1.3419          | 0.4171            | 0.5871   | 0.6076    | 0.5871 | 0.5676 |
| 1.2703        | 0.61  | 3000 | 1.2791          | 0.4782            | 0.6139   | 0.6120    | 0.6139 | 0.6015 |
| 1.2563        | 0.72  | 3500 | 1.2259          | 0.4884            | 0.6282   | 0.6340    | 0.6282 | 0.6096 |
| 1.1832        | 0.82  | 4000 | 1.1811          | 0.5226            | 0.6424   | 0.6505    | 0.6424 | 0.6371 |
| 1.1516        | 0.92  | 4500 | 1.1458          | 0.5238            | 0.6557   | 0.6649    | 0.6557 | 0.6417 |
| 1.1051        | 1.02  | 5000 | 1.0928          | 0.5546            | 0.6693   | 0.6716    | 0.6693 | 0.6605 |
| 0.9916        | 1.12  | 5500 | 1.1496          | 0.5333            | 0.6603   | 0.6629    | 0.6603 | 0.6421 |
| 0.9887        | 1.23  | 6000 | 1.0956          | 0.5700            | 0.6720   | 0.6857    | 0.6720 | 0.6629 |


### Framework versions

- Transformers 4.36.2
- Pytorch 1.10.1+cu113
- Tokenizers 0.15.0

{"tags": ["generated_from_trainer"], "metrics": ["accuracy", "precision", "recall", "f1"], "base_model": "zhihan1996/DNA_bert_6", "model-index": [{"name": "output", "results": []}]}
transformers tensorboard safetensors bert text-classification generated_from_trainer custom_code base_model:zhihan1996/DNA_bert_6 autotrain_compatible endpoints_compatible region:us