README.md

metadata

base_model: unsloth/Meta-Llama-3.1-8B
language:
  - en
license: llama3.1
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - llama
  - trl
  - sft
datasets:
  - mpasila/Discord-short-sharegpt
library_name: peft

Trained on Discord chatlogs from this dataset.

Uses Llama 3.1 formatting.

LoRA: mpasila/Llama-3.1-Discord-Short-LoRA-8B

Uploaded model

• Developed by: mpasila
• License: Llama 3.1 Community License Agreement
• Finetuned from model : unsloth/Meta-Llama-3.1-8B

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.