GRAG-MISTRAL-7B-v3.0 (German Retrieval Augmented Generation)
Here you can find all the final checkpoints & datasets from training Mistral-7B-v3.0 Model from MistralAI on the GRAG Datasets.
Question Answering • Updated • 35Note This model was trained on 20.7 Million Tokens in ORPO (Odd-Ratio-Preference Optimization) on synthetically generated or enhanced Data. Please see the GRAG-ORPO-Dataset (https://huggingface.co/datasets/avemio/GRAG-ORPO-ShareGPT-HESSIAN-AI) for reference.
avemio/GRAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI
Question Answering • Updated • 59Note This model was trained on 1,5 Billion Tokens in SFT(Supervised Fine-Tuning) on synthetically generated or enhanced Data. Please see the GRAG-SFT-Dataset (https://huggingface.co/datasets/avemio/GRAG-SFT-ShareGPT-HESSIAN-AI) for reference.
avemio/GRAG-MISTRAL-7B-v3.0-CPT-HESSIAN-AI
Question Answering • Updated • 9Note This model was trained on 507,5 Million Tokens in CPT (Continued Pre-Training) on synthetically generated or enhanced Data. Please see the GRAG-CPT-Dataset (https://huggingface.co/datasets/avemio/GRAG-CPT-HESSIAN-AI) for reference.
avemio/GRAG-ORPO-ShareGPT-HESSIAN-AI
Viewer • Updated • 13.7k • 22avemio/GRAG-SFT-ShareGPT-HESSIAN-AI
Viewer • Updated • 1.01M • 15 • 1avemio/GRAG-CPT-HESSIAN-AI
Viewer • Updated • 654k • 10avemio/GRAG-MISTRAL-7B-v3.0-ORPO-HESSIAN-AI-Q8_0-GGUF
Question Answering • Updated • 14avemio/GRAG-MISTRAL-7B-v3.0-SFT-HESSIAN-AI-Q8_0-GGUF
Question Answering • Updated • 14