
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# codeart_wo_trans_closure-mfc-100c-maxfunc2

This model is a fine-tuned version of [PurCL/codeart_bincorp_ep0.3_wo_trans_closure](https://huggingface.co/PurCL/codeart_bincorp_ep0.3_wo_trans_closure) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0459
- Accuracy: 0.9881
- F1: 0.5153
- Precision: 0.8551
- Recall: 0.3688
- Roc Auc Score: 0.9270

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 4
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- num_devices: 2
- total_train_batch_size: 8
- total_eval_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall | Roc Auc Score |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|:-------------:|
| 0.0862        | 0.23  | 100  | 0.0841          | 0.9828   | 0.0    | 0.0       | 0.0    | 0.6443        |
| 0.0823        | 0.45  | 200  | 0.0838          | 0.9828   | 0.0    | 0.0       | 0.0    | 0.6521        |
| 0.0853        | 0.68  | 300  | 0.0825          | 0.9828   | 0.0    | 0.0       | 0.0    | 0.6606        |
| 0.0794        | 0.9   | 400  | 0.0818          | 0.9828   | 0.0    | 0.0       | 0.0    | 0.6734        |
| 0.0832        | 1.13  | 500  | 0.0803          | 0.9828   | 0.0    | 0.0       | 0.0    | 0.6974        |
| 0.0779        | 1.35  | 600  | 0.0787          | 0.9834   | 0.0665 | 1.0       | 0.0344 | 0.7108        |
| 0.0749        | 1.58  | 700  | 0.0760          | 0.9834   | 0.0665 | 1.0       | 0.0344 | 0.7391        |
| 0.0742        | 1.81  | 800  | 0.0722          | 0.9834   | 0.0665 | 1.0       | 0.0344 | 0.8005        |
| 0.0711        | 2.03  | 900  | 0.0698          | 0.9834   | 0.0833 | 0.875     | 0.0437 | 0.8180        |
| 0.072         | 2.26  | 1000 | 0.0678          | 0.9842   | 0.1746 | 0.8857    | 0.0969 | 0.8332        |
| 0.0662        | 2.48  | 1100 | 0.0662          | 0.9842   | 0.1652 | 0.9355    | 0.0906 | 0.8422        |
| 0.0615        | 2.71  | 1200 | 0.0630          | 0.9844   | 0.1808 | 0.9412    | 0.1    | 0.8695        |
| 0.0558        | 2.93  | 1300 | 0.0607          | 0.9846   | 0.2050 | 0.9024    | 0.1156 | 0.8844        |
| 0.0572        | 3.16  | 1400 | 0.0590          | 0.9844   | 0.1894 | 0.8718    | 0.1062 | 0.8947        |
| 0.0563        | 3.39  | 1500 | 0.0590          | 0.9845   | 0.2088 | 0.8636    | 0.1187 | 0.8990        |
| 0.055         | 3.61  | 1600 | 0.0570          | 0.9847   | 0.2324 | 0.86      | 0.1344 | 0.9051        |
| 0.0551        | 3.84  | 1700 | 0.0560          | 0.9851   | 0.2691 | 0.8644    | 0.1594 | 0.9068        |
| 0.0481        | 4.06  | 1800 | 0.0536          | 0.9854   | 0.2880 | 0.8871    | 0.1719 | 0.9160        |
| 0.054         | 4.29  | 1900 | 0.0523          | 0.9861   | 0.3541 | 0.8765    | 0.2219 | 0.9189        |
| 0.0432        | 4.51  | 2000 | 0.0523          | 0.9851   | 0.2653 | 0.8772    | 0.1562 | 0.9184        |
| 0.0477        | 4.74  | 2100 | 0.0515          | 0.9856   | 0.3241 | 0.8533    | 0.2    | 0.9214        |
| 0.0529        | 4.97  | 2200 | 0.0518          | 0.9858   | 0.3457 | 0.8235    | 0.2188 | 0.9250        |
| 0.0449        | 5.19  | 2300 | 0.0509          | 0.9860   | 0.3564 | 0.8571    | 0.225  | 0.9244        |
| 0.0421        | 5.42  | 2400 | 0.0501          | 0.9865   | 0.4094 | 0.8286    | 0.2719 | 0.9276        |
| 0.0437        | 5.64  | 2500 | 0.0494          | 0.9865   | 0.3913 | 0.8617    | 0.2531 | 0.9239        |
| 0.0451        | 5.87  | 2600 | 0.0486          | 0.9867   | 0.4095 | 0.86      | 0.2687 | 0.9276        |
| 0.0374        | 6.09  | 2700 | 0.0487          | 0.9865   | 0.3863 | 0.8876    | 0.2469 | 0.9263        |
| 0.0383        | 6.32  | 2800 | 0.0482          | 0.9870   | 0.4346 | 0.8611    | 0.2906 | 0.9272        |
| 0.0402        | 6.55  | 2900 | 0.0480          | 0.9868   | 0.4444 | 0.8099    | 0.3063 | 0.9305        |
| 0.0416        | 6.77  | 3000 | 0.0477          | 0.9875   | 0.4811 | 0.8372    | 0.3375 | 0.9308        |
| 0.0367        | 7.0   | 3100 | 0.0474          | 0.9872   | 0.4506 | 0.8522    | 0.3063 | 0.9286        |
| 0.0343        | 7.22  | 3200 | 0.0472          | 0.9875   | 0.4751 | 0.8607    | 0.3281 | 0.9271        |
| 0.0343        | 7.45  | 3300 | 0.0475          | 0.9877   | 0.4900 | 0.8527    | 0.3438 | 0.9289        |
| 0.0352        | 7.67  | 3400 | 0.0472          | 0.9873   | 0.4685 | 0.8387    | 0.325  | 0.9290        |
| 0.0288        | 7.9   | 3500 | 0.0466          | 0.9877   | 0.4865 | 0.8710    | 0.3375 | 0.9280        |
| 0.0333        | 8.13  | 3600 | 0.0461          | 0.9877   | 0.4831 | 0.8699    | 0.3344 | 0.9299        |
| 0.0359        | 8.35  | 3700 | 0.0464          | 0.9878   | 0.5076 | 0.8298    | 0.3656 | 0.9258        |
| 0.0286        | 8.58  | 3800 | 0.0462          | 0.9878   | 0.4922 | 0.8661    | 0.3438 | 0.9266        |
| 0.028         | 8.8   | 3900 | 0.0460          | 0.9882   | 0.5197 | 0.8623    | 0.3719 | 0.9298        |
| 0.0296        | 9.03  | 4000 | 0.0461          | 0.9874   | 0.4753 | 0.8413    | 0.3312 | 0.9286        |
| 0.0279        | 9.26  | 4100 | 0.0461          | 0.9877   | 0.4933 | 0.8538    | 0.3469 | 0.9277        |
| 0.0291        | 9.48  | 4200 | 0.0460          | 0.9880   | 0.5142 | 0.8489    | 0.3688 | 0.9276        |
| 0.0303        | 9.71  | 4300 | 0.0459          | 0.9882   | 0.5249 | 0.8582    | 0.3781 | 0.9272        |
| 0.0275        | 9.93  | 4400 | 0.0459          | 0.9881   | 0.5153 | 0.8551    | 0.3688 | 0.9270        |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.1.0
- Datasets 2.14.5
- Tokenizers 0.14.1

{"tags": ["generated_from_trainer"], "metrics": ["accuracy", "f1", "precision", "recall"], "base_model": "PurCL/codeart_bincorp_ep0.3_wo_trans_closure", "model-index": [{"name": "codeart_wo_trans_closure-mfc-100c-maxfunc2", "results": []}]}
transformers pytorch rabert generated_from_trainer base_model:PurCL/codeart_bincorp_ep0.3_wo_trans_closure endpoints_compatible region:us