Cat
Collection
Roleplay Finetunes of Llama 3.1 8B
•
3 items
•
Updated
Cat0.2
Cat0.2 is a model further fine-tuned from Cat0.1 using an iterative dataset approach. The process involves iterating over the dataset three times, using the previous generation as the next iteration's dataset. This model is based on an 8 billion parameter Llama 3.1 architecture, further quantized to 4 bits for ease of upload. It has been iteratively trained on several hundred examples of data.
Iterative Process
- Generate examples with the base model (Llama 3.1 8B).
- Fine-tune on those examples.
- Generate new examples with the updated model.
- Repeat the process.
Note: The model may exhibit some hallucinations in its output due to the iterative training approach and may be prone to repetition.
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for rwitz/cat0.2
Base model
meta-llama/Llama-3.1-8B