safetensors generated_from_trainer base_model:mistralai/Mistral-7B-v0.1 license:apache-2.0 region:us
---
license: apache-2.0
base_model: mistralai/Mistral-7B-v0.1
tags:
- generated_from_trainer
model-index:
- name: mistral-ehrs-transcription-summary-v2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# mistral-ehrs-transcription-summary-v2

This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6734

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2.5e-05
- train_batch_size: 1
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 1
- training_steps: 500

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 1.1798        | 0.17  | 25   | 0.9513          |
| 0.8126        | 0.34  | 50   | 0.8061          |
| 0.6553        | 0.51  | 75   | 0.7364          |
| 0.5837        | 0.68  | 100  | 0.6550          |
| 0.4432        | 0.85  | 125  | 0.6435          |
| 0.4879        | 1.02  | 150  | 0.6329          |
| 0.3297        | 1.19  | 175  | 0.6310          |
| 0.2869        | 1.36  | 200  | 0.6310          |
| 0.2945        | 1.53  | 225  | 0.6101          |
| 0.221         | 1.7   | 250  | 0.6160          |
| 0.2233        | 1.87  | 275  | 0.6117          |
| 0.242         | 2.04  | 300  | 0.6295          |
| 0.15          | 2.21  | 325  | 0.6303          |
| 0.1496        | 2.38  | 350  | 0.6544          |
| 0.206         | 2.55  | 375  | 0.6508          |
| 0.1516        | 2.72  | 400  | 0.6466          |
| 0.1409        | 2.89  | 425  | 0.6587          |
| 0.1396        | 3.06  | 450  | 0.6656          |
| 0.0848        | 3.23  | 475  | 0.6747          |
| 0.1037        | 3.4   | 500  | 0.6734          |


### Framework versions

- Transformers 4.36.0.dev0
- Pytorch 2.1.1+cu118
- Datasets 2.15.0
- Tokenizers 0.15.0
