# NeuralReyna-Mini-1.8B-v0.2
![Reyna image](https://th.bing.com/th/id/OIG3.8IBxuT77hh6Y_r1DZ6WK?dpr=2.6&pid=ImgDetMain)
# Description
Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the Intel/orca_dpo_pairs dataset. 

This model has capabilities in coding, math, science, roleplay, and function calling. 

# Evaluation
Coming soon

# Disclaimer

This model may have overfitted to the DPO training data, and may not perform well. 

# Contributions

Thanks to @aloobun and @Locutusque for their contributions to this model. 
{"language": ["en"], "license": "apache-2.0", "datasets": ["Intel/orca_dpo_pairs", "Locutusque/Hercules-v3.0"]}
transformers safetensors qwen2 text-generation conversational en dataset:Intel/orca_dpo_pairs dataset:Locutusque/Hercules-v3.0 license:apache-2.0 autotrain_compatible endpoints_compatible has_space region:us