peft pytorch llama text-generation ko license:cc-by-nc-4.0 region:us
---
license: cc-by-nc-4.0
language:
- ko
library_name: peft
pipeline_tag: text-generation
---

# Raphael21/Raphael21-SOLAR-10.7B

## Model Details

**Training** 
  A100x8 * 1

**Base Model**
[Edentns/DataVortexS-10.7B-dpo-v1.11](https://huggingface.co/Edentns/DataVortexS-10.7B-dpo-v1.11)

   
# Implementation Code
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "Raphael21/Raphael21-SOLAR-10.7B"
model = AutoModelForCausalLM.from_pretrained(
        repo,
        torch_dtype=torch.float16,
        device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
```