
- Loda LLM

```python
from modeling_chatglm import ChatGLMForConditionalGeneration
import torch


torch.set_default_tensor_type(torch.cuda.HalfTensor)
model = ChatGLMForConditionalGeneration.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True, device_map='auto')
```

- Load LoRA

```python
from peft import PeftModel

model = PeftModel.from_pretrained(model, "visual-openllm/visual-openllm-chatglm-6b-rola")
torch.set_default_tensor_type(torch.cuda.FloatTensor)
```
{"license": "apache-2.0", "datasets": ["tatsu-lab/alpaca", "shibing624/alpaca-zh"]}
dataset:tatsu-lab/alpaca dataset:shibing624/alpaca-zh license:apache-2.0 region:us
TAGS
#dataset-tatsu-lab/alpaca #dataset-shibing624/alpaca-zh #license-apache-2.0 #region-us 


- Loda LLM



- Load LoRA


TAGS
#dataset-tatsu-lab/alpaca #dataset-shibing624/alpaca-zh #license-apache-2.0 #region-us 

TAGS
#dataset-tatsu-lab/alpaca #dataset-shibing624/alpaca-zh #license-apache-2.0 #region-us 
