dataset:jondurbin/airoboros-2.2.1 license:other region:us
---
license: other
license_name: falcon-180b
license_link: LICENSE
datasets:
- jondurbin/airoboros-2.2.1
---

QLoRA peft adapters at various checkpoints, fine-tuning on the airoboros-2.2.1 dataset with rope_scaling to 4k context.

https://wandb.ai/jondurbin/airoboros-180b-2.2.1/runs/ns3deq73?workspace=user-jondurbin