
# Model Card for Model ID

Training in progress.


## Model Details

Base MoE is [jtatman/TinyMistral-248m-4x-Moe](https://huggingface.co/jtatman/TinyMistral-248m-4x-Moe), itself a work in progress.

See that model card for MoE details. 

### Model Description

- **Developed by:** jtatman
- **Funded by [Donations from small furry animals gathered together in a cave and grooving with a Pict]:
- **Shared by:** [jtatman](https://huggingface.co/jtatman)
- **Model type:** Fine-tuned MoE
- **Language(s) (NLP):** Mixed according to base model training
- **License:** MIT
- **Finetuned from models:** [jtatman/TinyMistral-248m-4x-Moe](https://huggingface.co/jtatman/TinyMistral-248m-4x-Moe)

### Model Sources 

- **Repositories:**
  - Locutusque/TinyMistral-248M-v2
  - jtatman/tinymistral-v2-pycoder-instruct-248m
  - Locutusque/TinyMistral-248M-v2.5-Instruct
  - Locutusque/TinyMistral-248M-v2-Instruct 

## Uses

- possibly conversational, possibly none
- prefers ChatML format
  - "<|im_start|>user\n(prompt)<|im_end|>\n<|im_start|>assistant\n"

{"library_name": "transformers", "tags": []}
transformers safetensors mixtral text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us