transformers tensorboard safetensors t5 text2text-generation generated_from_trainer base_model:google/flan-t5-small license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
base_model: google/flan-t5-small
tags:
- generated_from_trainer
model-index:
- name: t5-dialogue-classification-enriched
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-dialogue-classification-enriched

This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5190
- Classification Report:                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4444    0.3636    0.4000        11
           CC     0.6250    0.4545    0.5263        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.4307    0.4599    0.4305       200
 weighted avg     0.7285    0.7650    0.7398       200


## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step | Validation Loss | Classification Report                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
| No log        | 1.0   | 172  | 0.3910          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4545    0.4545    0.4545        11
           CC     0.5714    0.3636    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     1.0000    0.2500    0.4000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8571    0.9333    0.8936        45
        GENHX     0.8070    0.8679    0.8364        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7500    0.9000    0.8182        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5714    0.8571    0.6857        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8125    0.7647    0.7879        17

     accuracy                         0.7550       200
    macro avg     0.4162    0.3754    0.3781       200
 weighted avg     0.7372    0.7550    0.7356       200
 |
| No log        | 2.0   | 344  | 0.3943          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4286    0.2727    0.3333        11
           CC     0.7143    0.4545    0.5556        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.7833    0.8868    0.8319        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6111    0.7857    0.6875        14
 PASTSURGICAL     0.7000    1.0000    0.8235         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7333    0.6471    0.6875        17

     accuracy                         0.7450       200
    macro avg     0.3467    0.3560    0.3450       200
 weighted avg     0.7003    0.7450    0.7155       200
 |
| 0.0296        | 3.0   | 516  | 0.3963          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.3636    0.4211        11
           CC     0.5714    0.3636    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8571    0.9333    0.8936        45
        GENHX     0.8364    0.8679    0.8519        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7500    0.9000    0.8182        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.9286    0.6500        14
 PASTSURGICAL     0.8750    1.0000    0.9333         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7857    0.6471    0.7097        17

     accuracy                         0.7500       200
    macro avg     0.4254    0.4560    0.4298       200
 weighted avg     0.7192    0.7500    0.7258       200
 |
| 0.0296        | 4.0   | 688  | 0.4452          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3750    0.2727    0.3158        11
           CC     0.8000    0.3636    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.3333    1.0000    0.5000         1
     EDCOURSE     1.0000    0.2500    0.4000         4
         EXAM     1.0000    0.2000    0.3333         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8103    0.8868    0.8468        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6190    0.9286    0.7429        14
 PASTSURGICAL     0.8750    1.0000    0.9333         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7750       200
    macro avg     0.5371    0.5240    0.4860       200
 weighted avg     0.7675    0.7750    0.7494       200
 |
| 0.0296        | 5.0   | 860  | 0.4481          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4286    0.2727    0.3333        11
           CC     0.6250    0.4545    0.5263        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     1.0000    0.2000    0.3333         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7059    0.9057    0.7934        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7273    0.8000    0.7619        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7500       200
    macro avg     0.3898    0.3534    0.3548       200
 weighted avg     0.7110    0.7500    0.7169       200
 |
| 0.0158        | 6.0   | 1032 | 0.4526          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4286    0.2727    0.3333        11
           CC     0.6364    0.6364    0.6364        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8462    0.9778    0.9072        45
        GENHX     0.8571    0.9057    0.8807        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6190    0.9286    0.7429        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7857    0.6471    0.7097        17

     accuracy                         0.7700       200
    macro avg     0.3566    0.3671    0.3572       200
 weighted avg     0.7230    0.7700    0.7403       200
 |
| 0.0158        | 7.0   | 1204 | 0.5002          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.1818    0.2667        11
           CC     0.5000    0.6364    0.5600        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7541    0.8679    0.8070        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7500    0.9000    0.8182        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.5294    0.6207        17

     accuracy                         0.7350       200
    macro avg     0.3657    0.3951    0.3648       200
 weighted avg     0.6985    0.7350    0.7060       200
 |
| 0.0158        | 8.0   | 1376 | 0.5027          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5714    0.3636    0.4444        11
           CC     0.7143    0.4545    0.5556        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7833    0.8868    0.8319        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5714    0.8571    0.6857        14
 PASTSURGICAL     0.7500    0.8571    0.8000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7500       200
    macro avg     0.3737    0.4040    0.3738       200
 weighted avg     0.7158    0.7500    0.7236       200
 |
| 0.0088        | 9.0   | 1548 | 0.4827          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.7143    0.4545    0.5556        11
           CC     0.7143    0.4545    0.5556        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.5000    0.2500    0.3333         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5263    0.7143    0.6061        14
 PASTSURGICAL     0.6364    1.0000    0.7778         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7857    0.6471    0.7097        17

     accuracy                         0.7600       200
    macro avg     0.4165    0.4240    0.4038       200
 weighted avg     0.7399    0.7600    0.7392       200
 |
| 0.0088        | 10.0  | 1720 | 0.4749          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5714    0.3636    0.4444        11
           CC     0.8571    0.5455    0.6667        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8750    0.9333    0.9032        45
        GENHX     0.8182    0.8491    0.8333        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.9286    0.6500        14
 PASTSURGICAL     0.7500    0.8571    0.8000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7500       200
    macro avg     0.4288    0.4591    0.4270       200
 weighted avg     0.7324    0.7500    0.7300       200
 |
| 0.0088        | 11.0  | 1892 | 0.4876          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5556    0.4545    0.5000        11
           CC     0.5556    0.4545    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6471    0.7857    0.7097        14
 PASTSURGICAL     0.7778    1.0000    0.8750         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.3812    0.4180    0.3853       200
 weighted avg     0.7263    0.7650    0.7397       200
 |
| 0.0058        | 12.0  | 2064 | 0.5442          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.2727    0.3529        11
           CC     0.8000    0.3636    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8571    0.9333    0.8936        45
        GENHX     0.7966    0.8868    0.8393        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5417    0.9286    0.6842        14
 PASTSURGICAL     0.7500    0.8571    0.8000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7143    0.5882    0.6452        17

     accuracy                         0.7450       200
    macro avg     0.4281    0.4474    0.4164       200
 weighted avg     0.7180    0.7450    0.7166       200
 |
| 0.0058        | 13.0  | 2236 | 0.5125          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5714    0.3636    0.4444        11
           CC     0.5833    0.6364    0.6087        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.9020    0.8679    0.8846        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5909    0.9286    0.7222        14
 PASTSURGICAL     0.7500    0.8571    0.8000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7857    0.6471    0.7097        17

     accuracy                         0.7700       200
    macro avg     0.4323    0.4686    0.4343       200
 weighted avg     0.7481    0.7700    0.7504       200
 |
| 0.0058        | 14.0  | 2408 | 0.5206          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.6000    0.2727    0.3750        11
           CC     0.7143    0.4545    0.5556        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.7966    0.8868    0.8393        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     0.6667    0.8571    0.7500         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.7059    0.7273        17

     accuracy                         0.7600       200
    macro avg     0.4228    0.4553    0.4228       200
 weighted avg     0.7216    0.7600    0.7309       200
 |
| 0.0038        | 15.0  | 2580 | 0.5211          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4444    0.3636    0.4000        11
           CC     0.5000    0.4545    0.4762        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8364    0.8679    0.8519        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5714    0.8571    0.6857        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7600       200
    macro avg     0.4307    0.4589    0.4302       200
 weighted avg     0.7277    0.7600    0.7372       200
 |
| 0.0038        | 16.0  | 2752 | 0.5276          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.3636    0.4211        11
           CC     0.7143    0.4545    0.5556        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8103    0.8868    0.8468        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5714    0.8571    0.6857        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.7059    0.7273        17

     accuracy                         0.7650       200
    macro avg     0.4404    0.4599    0.4338       200
 weighted avg     0.7314    0.7650    0.7395       200
 |
| 0.0038        | 17.0  | 2924 | 0.4989          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4444    0.3636    0.4000        11
           CC     0.5556    0.4545    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8704    0.8868    0.8785        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6190    0.9286    0.7429        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7700       200
    macro avg     0.4305    0.4634    0.4323       200
 weighted avg     0.7381    0.7700    0.7473       200
 |
| 0.0025        | 18.0  | 3096 | 0.5121          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.3636    0.4211        11
           CC     0.6250    0.4545    0.5263        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.4335    0.4599    0.4316       200
 weighted avg     0.7315    0.7650    0.7409       200
 |
| 0.0025        | 19.0  | 3268 | 0.5190          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4444    0.3636    0.4000        11
           CC     0.6250    0.4545    0.5263        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.4307    0.4599    0.4305       200
 weighted avg     0.7285    0.7650    0.7398       200
 |
| 0.0025        | 20.0  | 3440 | 0.5190          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4444    0.3636    0.4000        11
           CC     0.6250    0.4545    0.5263        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8246    0.8868    0.8545        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.4307    0.4599    0.4305       200
 weighted avg     0.7285    0.7650    0.7398       200
 |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
