transformers pytorch llama text-generation en license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
language:
- en
pipeline_tag: text-generation
license: cc-by-nc-4.0
---

# WebSquareAI-Instruct-KoSOLAR-10.7b-v0.5.35
  
## Model Details

**Developed by** 
[Inswave Systems](https://www.inswave.com) UI Platform Team

**Base Model**
[yanolja/KoSOLAR-10.7B-v0.2](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.2)

   
# Implementation Code
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "kimwooglae/WebSquareAI-Instruct-KoSOLAR-10.7b-v0.5.35"
model = AutoModelForCausalLM.from_pretrained(
        repo,
        return_dict=True,
        torch_dtype=torch.float16,
        device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)
```

---