metadata
library_name: transformers
base_model:
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
datasets:
- jondurbin/gutenberg-dpo-v0.1
license: gemma
gemma2-gutenberg-9B
UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 finetuned on jondurbin/gutenberg-dpo-v0.1.
Method
Finetuned using an RTX 4090 using ORPO for 3 epochs.