This is a llama-13B based model that has been converted with GPTQ to 4bit quantized model.

Base Model: GPT4-x-Alpaca full fine tune by Chavinlo -> https://huggingface.co/chavinlo/gpt4-x-alpaca  
LORA fine tune using the Roleplay Instruct from GPT4 generated dataset -> https://github.com/teknium1/GPTeacher/tree/main/Roleplay  
LORA Adapter Only: https://huggingface.co/ZeusLabs/gpt4-x-alpaca-rp-lora - The v2 one -

Merged LORA to the model. 

FYI Latest HF Transformers generates BROKEN generations. 
Try this instead if your generations are terrible (first uninstall transformers): pip install git+https://github.com/huggingface/transformers@9eae4aa57650c1dbe1becd4e0979f6ad1e572ac0
More info and possible alternative solutions in these github issues.  
https://github.com/tloen/alpaca-lora/issues/279#issuecomment-1514725886  
https://github.com/oobabooga/text-generation-webui/issues/931#issuecomment-1516215250  

Instructions simply using alpaca format are likely to be of lower quality. If you want pure general instruct capability I reccomend GPT-4-X-Alpaca (the base model of this) - 
The model responds well to giving it a roleplay task in the preprompt, and the actual conversation in the "### Input: " field.

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: https://github.com/teknium1/alpaca-roleplay-discordbot
Here is an example:
```
### Instruction:
Role play as character that is described in the following lines. You always stay in character.
{"Your name is " + name + "." if name else ""}
{"Your backstory and history are: " + background if background else ""}
{"Your personality is: " + personality if personality else ""}
{"Your current circumstances and situation are: " + circumstances if circumstances else ""}
{"Your common greetings are: " + common_greeting if common_greeting else ""}
Remember, you always stay on character. You are the character described above.
{past_dialogue_formatted}
{chat_history if chat_history else "Chatbot: Hello!"}

Always speak with new and unique messages that haven't been said in the chat history.

Respond to this message as your character would:
### Input:
{text}
### Response:
{name}:

```

---
tags:
- llama
- alpaca
- gpt4
---
{"license": "mit"}
transformers pytorch llama text-generation license:mit autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 

This is a llama-13B based model that has been converted with GPTQ to 4bit quantized model.

Base Model: GPT4-x-Alpaca full fine tune by Chavinlo -> URL  
LORA fine tune using the Roleplay Instruct from GPT4 generated dataset -> URL  
LORA Adapter Only: URL - The v2 one -

Merged LORA to the model. 

FYI Latest HF Transformers generates BROKEN generations. 
Try this instead if your generations are terrible (first uninstall transformers): pip install git+URL
More info and possible alternative solutions in these github issues.  
URL  
URL  

Instructions simply using alpaca format are likely to be of lower quality. If you want pure general instruct capability I reccomend GPT-4-X-Alpaca (the base model of this) - 
The model responds well to giving it a roleplay task in the preprompt, and the actual conversation in the "### Input: " field.

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: URL
Here is an example:


---
tags:
- llama
- alpaca
- gpt4
---
### Input: " field.

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: URL
Here is an example:


---
tags:
- llama
- alpaca
- gpt4
---
TAGS
#transformers #pytorch #llama #text-generation #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
 ### Input: " field.

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: URL
Here is an example:


---
tags:
- llama
- alpaca
- gpt4
---
TAGS
#transformers #pytorch #llama #text-generation #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
### Input: " field.

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: URL
Here is an example:


---
tags:
- llama
- alpaca
- gpt4
---