adapter-transformers pytorch mistral en dataset:Cybernetyx/QZ_ZS_1K region:us
---
datasets:
- Cybernetyx/QZ_ZS_1K
language:
- en
library_name: adapter-transformers
---
# Model Card for QZ_ZS_1K (BrightClass Quiz Generator Zero Shot 1K)

The BrightClass Quiz Generator is a powerful AI tool designed to assist teachers and educators in creating engaging and effective quizes for their students. With the ability to generate customized quizes based on specific learning objectives, grade levels, and subject areas, this model streamlines the lesson planning process and saves educators valuable time.

### Model Description

- **Developed by:** https://huggingface.co/xriminact
- **Model type:** Instruct Model based on 7B parameters
- **Language(s) (NLP):** Python
- **Finetuned from model:** mistralai/Mistral-7B-v0.1

### Training Data
https://huggingface.co/datasets/Cybernetyx/QZ_ZS_1K

### Training Procedure 
autotrain llm --train --model <model_name> --project-name <project_name> --data-path data/ --text-column text --trainer sft --lr 2e-4 --batch-size 16 --epochs 4 --block-size 1024 --warmup-ratio 0.1 --lora-r 16 --lora-alpha 32 --lora-dropout 0.045 --weight-decay 0.01 --gradient-accumulation 4 --mixed-precision fp16 --use-peft --quantization int4 --target_modules q_proj,v_proj --log wandb --logging_steps 100 
## Model Card Authors
https://huggingface.co/xriminact