transformers tensorboard safetensors t5 text2text-generation generated_from_trainer base_model:google/flan-t5-small license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
base_model: google/flan-t5-small
tags:
- generated_from_trainer
model-index:
- name: t5-dialogue-classification-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-dialogue-classification-2

This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.4154
- Classification Report:                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.5455    0.5455    0.5455        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8462    0.9778    0.9072        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4167    0.7143    0.5263        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7300       200
    macro avg     0.3924    0.3915    0.3863       200
 weighted avg     0.7087    0.7300    0.7116       200


## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step | Validation Loss | Classification Report                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
| No log        | 1.0   | 186  | 0.4012          |                precision    recall  f1-score   support

      ALLERGY     0.9167    0.9167    0.9167        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.0000    0.0000    0.0000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.0000    0.0000    0.0000         5
    FAM/SOCHX     0.7097    0.9778    0.8224        45
        GENHX     0.6267    0.8868    0.7344        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8182    0.9000    0.8571        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.3750    0.4286    0.4000        14
 PASTSURGICAL     0.3889    1.0000    0.5600         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.2941    0.4348        17

     accuracy                         0.6450       200
    macro avg     0.2334    0.2702    0.2363       200
 weighted avg     0.5323    0.6450    0.5621       200
                                                        |
| No log        | 2.0   | 372  | 0.2953          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.3333    0.2727    0.3000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.0000    0.0000    0.0000         5
    FAM/SOCHX     0.8113    0.9556    0.8776        45
        GENHX     0.6111    0.8302    0.7040        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8182    0.9000    0.8571        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.3929    0.7857    0.5238        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.6250    0.2941    0.4000        17

     accuracy                         0.6600       200
    macro avg     0.2796    0.2906    0.2771       200
 weighted avg     0.5794    0.6600    0.6037       200
                                                        |
| 0.6246        | 3.0   | 558  | 0.2934          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.2857    0.3636    0.3200        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8302    0.9778    0.8980        45
        GENHX     0.6716    0.8491    0.7500        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5294    0.6429    0.5806        14
 PASTSURGICAL     0.7000    1.0000    0.8235         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7050       200
    macro avg     0.3008    0.3269    0.3089       200
 weighted avg     0.6229    0.7050    0.6556       200
                                                        |
| 0.6246        | 4.0   | 744  | 0.2946          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2000    0.0909    0.1250        11
           CC     0.2857    0.5455    0.3750        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.6667    0.4000    0.5000         5
    FAM/SOCHX     0.8431    0.9556    0.8958        45
        GENHX     0.8462    0.8302    0.8381        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.7143    0.5882        14
 PASTSURGICAL     0.8750    1.0000    0.9333         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.5294    0.6207        17

     accuracy                         0.7150       200
    macro avg     0.3368    0.3491    0.3351       200
 weighted avg     0.6852    0.7150    0.6911       200
                                                        |
| 0.6246        | 5.0   | 930  | 0.2906          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2000    0.0909    0.1250        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.5000    0.2500    0.3333         4
         EXAM     0.6000    0.6000    0.6000         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.6818    0.8491    0.7563        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.6429    0.5625        14
 PASTSURGICAL     0.7778    1.0000    0.8750         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.5294    0.6207        17

     accuracy                         0.7200       200
    macro avg     0.3611    0.3610    0.3543       200
 weighted avg     0.6698    0.7200    0.6861       200
                                                        |
| 0.1677        | 6.0   | 1116 | 0.2852          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.1667    0.0909    0.1176        11
           CC     0.4444    0.3636    0.4000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.4000    0.3077         5
    FAM/SOCHX     0.8627    0.9778    0.9167        45
        GENHX     0.7857    0.8302    0.8073        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.7143    0.5882        14
 PASTSURGICAL     0.7000    1.0000    0.8235         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7150       200
    macro avg     0.3156    0.3441    0.3247       200
 weighted avg     0.6687    0.7150    0.6859       200
                                                        |
| 0.1677        | 7.0   | 1302 | 0.3229          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.5556    0.4545    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8431    0.9556    0.8958        45
        GENHX     0.7963    0.8113    0.8037        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4138    0.8571    0.5581        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7150       200
    macro avg     0.3365    0.3411    0.3316       200
 weighted avg     0.6837    0.7150    0.6895       200
                                                        |
| 0.1677        | 8.0   | 1488 | 0.3119          |                precision    recall  f1-score   support

      ALLERGY     0.9167    0.9167    0.9167        12
   ASSESSMENT     0.2500    0.0909    0.1333        11
           CC     0.3750    0.5455    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.7963    0.8113    0.8037        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4583    0.7857    0.5789        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17
   Restrained     0.0000    0.0000    0.0000         0

     accuracy                         0.7100       200
    macro avg     0.3099    0.3215    0.3097       200
 weighted avg     0.6743    0.7100    0.6840       200
 |
| 0.1144        | 9.0   | 1674 | 0.2959          |                precision    recall  f1-score   support

      ALLERGY     0.9167    0.9167    0.9167        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.3333    0.5455    0.4138        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7857    0.8302    0.8073        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5556    0.7143    0.6250        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17
   Restrained     0.0000    0.0000    0.0000         0

     accuracy                         0.7200       200
    macro avg     0.3172    0.3328    0.3212       200
 weighted avg     0.6833    0.7200    0.6964       200
 |
| 0.1144        | 10.0  | 1860 | 0.3363          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2857    0.1818    0.2222        11
           CC     0.5556    0.4545    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     1.0000    0.2500    0.4000         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8627    0.9778    0.9167        45
        GENHX     0.8269    0.8113    0.8190        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8182    0.9000    0.8571        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4286    0.8571    0.5714        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7250       200
    macro avg     0.4006    0.3597    0.3628       200
 weighted avg     0.7263    0.7250    0.7122       200
                                                        |
| 0.0772        | 11.0  | 2046 | 0.3538          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2857    0.1818    0.2222        11
           CC     0.3333    0.5455    0.4138        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8627    0.9778    0.9167        45
        GENHX     0.8400    0.7925    0.8155        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4348    0.7143    0.5405        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7150       200
    macro avg     0.3340    0.3487    0.3361       200
 weighted avg     0.6937    0.7150    0.6967       200
                                                        |
| 0.0772        | 12.0  | 2232 | 0.3695          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2500    0.1818    0.2105        11
           CC     0.5455    0.5455    0.5455        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.8333    0.8491    0.8411        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4545    0.7143    0.5556        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7350       200
    macro avg     0.3994    0.4015    0.3968       200
 weighted avg     0.7144    0.7350    0.7194       200
                                                        |
| 0.0772        | 13.0  | 2418 | 0.3666          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.1667    0.0909    0.1176        11
           CC     0.4286    0.5455    0.4800        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.5000    0.2500    0.3333         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8627    0.9778    0.9167        45
        GENHX     0.8431    0.8113    0.8269        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5294    0.6429    0.5806        14
 PASTSURGICAL     0.6000    0.8571    0.7059         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8462    0.6471    0.7333        17

     accuracy                         0.7250       200
    macro avg     0.3755    0.4070    0.3813       200
 weighted avg     0.7044    0.7250    0.7088       200
                                                        |
| 0.0486        | 14.0  | 2604 | 0.3836          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2857    0.1818    0.2222        11
           CC     0.5000    0.5455    0.5217        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.8333    0.8491    0.8411        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5263    0.7143    0.6061        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17
   Restrained     0.0000    0.0000    0.0000         0

     accuracy                         0.7350       200
    macro avg     0.3595    0.3824    0.3639       200
 weighted avg     0.7164    0.7350    0.7206       200
 |
| 0.0486        | 15.0  | 2790 | 0.3881          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2222    0.1818    0.2000        11
           CC     0.4615    0.5455    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8654    1.0000    0.9278        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5882    0.7143    0.6452        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7400       200
    macro avg     0.3955    0.4026    0.3967       200
 weighted avg     0.7160    0.7400    0.7239       200
                                                        |
| 0.0486        | 16.0  | 2976 | 0.3948          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2000    0.0909    0.1250        11
           CC     0.6000    0.5455    0.5714        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8654    1.0000    0.9278        45
        GENHX     0.8333    0.8491    0.8411        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.7143    0.5882        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7350       200
    macro avg     0.3729    0.3981    0.3777       200
 weighted avg     0.7066    0.7350    0.7151       200
                                                        |
| 0.0392        | 17.0  | 3162 | 0.4075          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.2000    0.0909    0.1250        11
           CC     0.5455    0.5455    0.5455        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8491    1.0000    0.9184        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4762    0.7143    0.5714        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7350       200
    macro avg     0.3722    0.3981    0.3766       200
 weighted avg     0.7079    0.7350    0.7144       200
                                                        |
| 0.0392        | 18.0  | 3348 | 0.4103          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.5000    0.5455    0.5217        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8462    0.9778    0.9072        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4762    0.7143    0.5714        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7692    0.5882    0.6667        17

     accuracy                         0.7300       200
    macro avg     0.3899    0.3915    0.3862       200
 weighted avg     0.7049    0.7300    0.7115       200
                                                        |
| 0.0306        | 19.0  | 3534 | 0.4126          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.5455    0.5455    0.5455        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8462    0.9778    0.9072        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4348    0.7143    0.5405        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17
   Restrained     0.0000    0.0000    0.0000         0

     accuracy                         0.7300       200
    macro avg     0.3746    0.3729    0.3686       200
 weighted avg     0.7100    0.7300    0.7126       200
 |
| 0.0306        | 20.0  | 3720 | 0.4154          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.5455    0.5455    0.5455        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8462    0.9778    0.9072        45
        GENHX     0.8491    0.8491    0.8491        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.4167    0.7143    0.5263        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8333    0.5882    0.6897        17

     accuracy                         0.7300       200
    macro avg     0.3924    0.3915    0.3863       200
 weighted avg     0.7087    0.7300    0.7116       200
                                                        |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
