quant of [jondurbin's](https://huggingface.co/jondurbin) [bagel-dpo-34b-v0.2](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2)

fits into 24gb with 16k context on windows

```
python3 convert.py \
    -i /input/jondurbin_bagel-dpo-34b-v0.2/ \
    -c /input/pippa_cleaned/0000.parquet \
    -o /output/temp/ \
    -cf /output/bagel-dpo-34b-v0.2-4.65bpw-h6-exl2/ \
    -l 8192 \
    -ml 8192 \
    -b 4.65 \
    -hb 6
```
{"license": "other", "datasets": ["ai2_arc", "unalignment/spicy-3.1", "codeparrot/apps", "facebook/belebele", "boolq", "jondurbin/cinematika-v0.1", "drop", "lmsys/lmsys-chat-1m", "TIGER-Lab/MathInstruct", "cais/mmlu", "Muennighoff/natural-instructions", "openbookqa", "piqa", "Vezora/Tested-22k-Python-Alpaca", "cakiki/rosetta-code", "Open-Orca/SlimOrca", "spider", "squad_v2", "migtissera/Synthia-v1.3", "datasets/winogrande", "nvidia/HelpSteer", "Intel/orca_dpo_pairs", "unalignment/toxic-dpo-v0.1", "jondurbin/truthy-dpo-v0.1", "allenai/ultrafeedback_binarized_cleaned", "Squish42/bluemoon-fandom-1-1-rp-cleaned", "LDJnr/Capybara", "JULIELab/EmoBank", "kingbri/PIPPA-shareGPT"], "license_name": "yi-license", "license_link": "https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE"}
transformers safetensors llama text-generation conversational dataset:ai2_arc dataset:unalignment/spicy-3.1 dataset:codeparrot/apps dataset:facebook/belebele dataset:boolq dataset:jondurbin/cinematika-v0.1 dataset:drop dataset:lmsys/lmsys-chat-1m dataset:TIGER-Lab/MathInstruct dataset:cais/mmlu dataset:Muennighoff/natural-instructions dataset:openbookqa dataset:piqa dataset:Vezora/Tested-22k-Python-Alpaca dataset:cakiki/rosetta-code dataset:Open-Orca/SlimOrca dataset:spider dataset:squad_v2 dataset:migtissera/Synthia-v1.3 dataset:datasets/winogrande dataset:nvidia/HelpSteer dataset:Intel/orca_dpo_pairs dataset:unalignment/toxic-dpo-v0.1 dataset:jondurbin/truthy-dpo-v0.1 dataset:allenai/ultrafeedback_binarized_cleaned dataset:Squish42/bluemoon-fandom-1-1-rp-cleaned dataset:LDJnr/Capybara dataset:JULIELab/EmoBank dataset:kingbri/PIPPA-shareGPT license:other autotrain_compatible endpoints_compatible text-generation-inference region:us