transformers tensorboard safetensors t5 text2text-generation generated_from_trainer base_model:google/flan-t5-base license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
base_model: google/flan-t5-base
tags:
- generated_from_trainer
model-index:
- name: t5-dialogue-classification-enriched-base
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# t5-dialogue-classification-enriched-base

This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9149
- Classification Report:                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.3333    1.0000    0.5000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.7500    0.6000    0.6667         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7931    0.8679    0.8288        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.5227    0.6107    0.5356       200
 weighted avg     0.7412    0.7650    0.7391       200


## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Classification Report                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|:-------------:|:-----:|:-----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
| 0.6076        | 1.0   | 601   | 0.3829          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.2632    0.4545    0.3333        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.6714    0.8868    0.7642        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     0.0000    0.0000    0.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5500    0.7857    0.6471        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.0000    0.0000    0.0000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7143    0.2941    0.4167        17

     accuracy                         0.7050       200
    macro avg     0.3081    0.3258    0.3088       200
 weighted avg     0.6325    0.7050    0.6534       200
                                                        |
| 0.2134        | 2.0   | 1202  | 0.4271          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.6364    0.6364    0.6364        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.4000    0.5000    0.4444         4
         EXAM     1.0000    0.4000    0.5714         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.8103    0.8868    0.8468        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     1.0000    1.0000    1.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5714    0.8571    0.6857        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8571    0.7059    0.7742        17

     accuracy                         0.7850       200
    macro avg     0.5212    0.5440    0.5189       200
 weighted avg     0.7396    0.7850    0.7540       200
                                                        |
| 0.2007        | 3.0   | 1803  | 0.4843          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.8000    0.3636    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2857    0.4000    0.3333         5
    FAM/SOCHX     0.8800    0.9778    0.9263        45
        GENHX     0.7719    0.8302    0.8000        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7222    0.7647    0.7429        17

     accuracy                         0.7600       200
    macro avg     0.5081    0.5601    0.5077       200
 weighted avg     0.7322    0.7600    0.7290       200
                                                        |
| 0.1363        | 4.0   | 2404  | 0.4141          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.5000    0.4545    0.4762        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.2500    1.0000    0.4000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8627    0.9778    0.9167        45
        GENHX     0.8000    0.9057    0.8496        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     0.0000    0.0000    0.0000         1
IMMUNIZATIONS     1.0000    1.0000    1.0000         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.9091    1.0000    0.9524        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5455    0.8571    0.6667        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7600       200
    macro avg     0.4209    0.4937    0.4390       200
 weighted avg     0.6953    0.7600    0.7212       200
                                                        |
| 0.074         | 5.0   | 3005  | 0.5234          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.3846    0.4545    0.4167        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.1667    1.0000    0.2857         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8980    0.8302    0.8627        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.7500    0.8571    0.8000        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.6087    0.8235    0.7000        17

     accuracy                         0.7500       200
    macro avg     0.4302    0.5447    0.4568       200
 weighted avg     0.7086    0.7500    0.7224       200
                                                        |
| 0.0508        | 6.0   | 3606  | 0.5171          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.3333    0.1818    0.2353        11
           CC     0.6667    0.5455    0.6000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     1.0000    1.0000    1.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.4000    0.4000    0.4000         5
    FAM/SOCHX     0.8958    0.9556    0.9247        45
        GENHX     0.9375    0.8491    0.8911        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7368    0.8235    0.7778        17
    restraint     0.0000    0.0000    0.0000         0

     accuracy                         0.7850       200
    macro avg     0.5320    0.5966    0.5489       200
 weighted avg     0.7723    0.7850    0.7724       200
 |
| 0.0362        | 7.0   | 4207  | 0.5621          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.1818    0.2667        11
           CC     0.4545    0.4545    0.4545        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.8182    0.8491    0.8333        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6667    0.8571    0.7500        14
 PASTSURGICAL     1.0000    1.0000    1.0000         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7059    0.7059    0.7059        17

     accuracy                         0.7600       200
    macro avg     0.4563    0.5160    0.4681       200
 weighted avg     0.7286    0.7600    0.7367       200
                                                        |
| 0.0207        | 8.0   | 4808  | 0.5918          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.1818    0.2667        11
           CC     0.3846    0.4545    0.4167        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8958    0.9556    0.9247        45
        GENHX     0.8364    0.8679    0.8519        53
        GYNHX     0.0000    0.0000    0.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7059    0.7059    0.7059        17

     accuracy                         0.7600       200
    macro avg     0.4540    0.5098    0.4677       200
 weighted avg     0.7270    0.7600    0.7359       200
                                                        |
| 0.0119        | 9.0   | 5409  | 0.7718          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.0000    0.0000    0.0000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.6000    0.5455         5
    FAM/SOCHX     0.9318    0.9111    0.9213        45
        GENHX     0.7833    0.8868    0.8319        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.8333    1.0000    0.9091        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5000    0.8571    0.6316        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8571    0.7059    0.7742        17

     accuracy                         0.7550       200
    macro avg     0.5203    0.5595    0.5201       200
 weighted avg     0.7443    0.7550    0.7348       200
                                                        |
| 0.0136        | 10.0  | 6010  | 0.6240          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.4000    0.1818    0.2500        11
           CC     0.7500    0.2727    0.4000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.2000    1.0000    0.3333         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.3333    0.2000    0.2500         5
    FAM/SOCHX     0.8958    0.9556    0.9247        45
        GENHX     0.8214    0.8679    0.8440        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5455    0.8571    0.6667        14
 PASTSURGICAL     0.8571    0.8571    0.8571         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7550       200
    macro avg     0.5103    0.5907    0.5134       200
 weighted avg     0.7406    0.7550    0.7325       200
                                                        |
| 0.0126        | 11.0  | 6611  | 0.7935          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5714    0.3636    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.1667    1.0000    0.2857         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.2500    0.2000    0.2222         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7797    0.8679    0.8214        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6667    0.8571    0.7500        14
 PASTSURGICAL     0.7500    0.8571    0.8000         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7550       200
    macro avg     0.5066    0.5907    0.5151       200
 weighted avg     0.7244    0.7550    0.7252       200
                                                        |
| 0.0018        | 12.0  | 7212  | 0.8006          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.3077    0.3636    0.3333        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8913    0.9111    0.9011        45
        GENHX     0.7797    0.8679    0.8214        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.7500    0.7059    0.7273        17

     accuracy                         0.7500       200
    macro avg     0.5315    0.5985    0.5429       200
 weighted avg     0.7230    0.7500    0.7242       200
                                                        |
| 0.0027        | 13.0  | 7813  | 0.7199          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.1667    1.0000    0.2857         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.4000    0.4444         5
    FAM/SOCHX     0.8958    0.9556    0.9247        45
        GENHX     0.7797    0.8679    0.8214        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     1.0000    1.0000    1.0000         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7600       200
    macro avg     0.5271    0.6007    0.5305       200
 weighted avg     0.7372    0.7600    0.7344       200
                                                        |
| 0.0054        | 14.0  | 8414  | 0.8456          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.3333    0.4545    0.3846        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     1.0000    0.4000    0.5714         5
    FAM/SOCHX     0.8600    0.9556    0.9053        45
        GENHX     0.8519    0.8679    0.8598        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     1.0000    1.0000    1.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6667    0.8571    0.7500        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7700       200
    macro avg     0.5891    0.6553    0.5895       200
 weighted avg     0.7582    0.7700    0.7482       200
                                                        |
| 0.0014        | 15.0  | 9015  | 0.9014          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.0000    0.0000    0.0000        11
           CC     0.5556    0.4545    0.5000        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.1667    1.0000    0.2857         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.5000    0.2000    0.2857         5
    FAM/SOCHX     0.8431    0.9556    0.8958        45
        GENHX     0.8364    0.8679    0.8519        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6667    0.8571    0.7500        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7550       200
    macro avg     0.4735    0.5907    0.4951       200
 weighted avg     0.7150    0.7550    0.7270       200
                                                        |
| 0.0022        | 16.0  | 9616  | 0.8345          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.4545    0.4545    0.4545        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.5000    1.0000    0.6667         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.6667    0.4000    0.5000         5
    FAM/SOCHX     0.8750    0.9333    0.9032        45
        GENHX     0.8519    0.8679    0.8598        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.5455    0.8571    0.6667        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.3333    1.0000    0.5000         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7600       200
    macro avg     0.5148    0.6042    0.5269       200
 weighted avg     0.7456    0.7600    0.7381       200
                                                        |
| 0.0003        | 17.0  | 10217 | 0.8792          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5714    0.3636    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.2500    1.0000    0.4000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.7500    0.6000    0.6667         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.8070    0.8679    0.8364        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6000    0.8571    0.7059        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.5213    0.6107    0.5311       200
 weighted avg     0.7462    0.7650    0.7404       200
                                                        |
| 0.0003        | 18.0  | 10818 | 0.9484          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.3333    1.0000    0.5000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.7500    0.6000    0.6667         5
    FAM/SOCHX     0.8431    0.9556    0.8958        45
        GENHX     0.7931    0.8679    0.8288        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.7059    0.8571    0.7742        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.5247    0.6107    0.5370       200
 weighted avg     0.7387    0.7650    0.7381       200
                                                        |
| 0.0008        | 19.0  | 11419 | 0.9211          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5714    0.3636    0.4444        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.2500    1.0000    0.4000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.7500    0.6000    0.6667         5
    FAM/SOCHX     0.8431    0.9556    0.8958        45
        GENHX     0.8070    0.8679    0.8364        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6667    0.8571    0.7500        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.5229    0.6107    0.5323       200
 weighted avg     0.7431    0.7650    0.7392       200
                                                        |
| 0.0002        | 20.0  | 12020 | 0.9149          |                precision    recall  f1-score   support

      ALLERGY     1.0000    0.9167    0.9565        12
   ASSESSMENT     0.5000    0.0909    0.1538        11
           CC     0.5000    0.3636    0.4211        11
    DIAGNOSIS     0.0000    0.0000    0.0000         1
  DISPOSITION     0.3333    1.0000    0.5000         1
     EDCOURSE     0.0000    0.0000    0.0000         4
         EXAM     0.7500    0.6000    0.6667         5
    FAM/SOCHX     0.8776    0.9556    0.9149        45
        GENHX     0.7931    0.8679    0.8288        53
        GYNHX     1.0000    1.0000    1.0000         1
      IMAGING     0.5000    1.0000    0.6667         1
IMMUNIZATIONS     0.5000    1.0000    0.6667         1
         LABS     0.0000    0.0000    0.0000         1
  MEDICATIONS     0.7692    1.0000    0.8696        10
OTHER_HISTORY     0.0000    0.0000    0.0000         3
PASTMEDICALHX     0.6316    0.8571    0.7273        14
 PASTSURGICAL     1.0000    0.8571    0.9231         7
         PLAN     0.5000    1.0000    0.6667         1
   PROCEDURES     0.0000    0.0000    0.0000         1
          ROS     0.8000    0.7059    0.7500        17

     accuracy                         0.7650       200
    macro avg     0.5227    0.6107    0.5356       200
 weighted avg     0.7412    0.7650    0.7391       200
                                                        |


### Framework versions

- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
