# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
Just testing out LLM Finetuning. Finetuned on [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0) using [argilla/distilabel-intel-orca-dpo-pairs](https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs).
Followed the Google Colab mentioned in this article: [https://towardsdatascience.com/fine-tune-a-mistral-7b-model-with-direct-preference-optimization-708042745aac](https://towardsdatascience.com/fine-tune-a-mistral-7b-model-with-direct-preference-optimization-708042745aac)

{"language": ["en"], "license": "cc-by-nc-4.0", "datasets": ["argilla/distilabel-intel-orca-dpo-pairs"], "base_model": ["upstage/SOLAR-10.7B-Instruct-v1.0"]}
transformers safetensors llama text-generation conversational en dataset:argilla/distilabel-intel-orca-dpo-pairs base_model:upstage/SOLAR-10.7B-Instruct-v1.0 license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us