
# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

![loss](loss.png)

### Examples

The following samples were generated with `{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}`:

##### **Give three tips for a good meal**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Give three tips for a good meal.

### Response:


Tip 1: Make sure to enjoy your meal. It's easy to forget about enjoying yourself when you're hungry.
Tip 2: Try to eat a healthy meal that contains lots of vegetables and fruits.
Tip 3: Eat slowly and chew your food thoroughly. This will help you digest your meal better.
```

##### **Write a poem about a delicious night**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a poem about a delicious night.

### Response:


> "The moon shone brightly on the night sky,
> 
> Stars twinkled brightly from afar.
> 
> Suddenly, my eyes saw the silhouette
> 
> Of a handsome stranger in the distance.
> 
> He walked slowly towards me with a smile.
> 
> He said, 'I've come to eat you up tonight.'
> 
> Suddenly, I knew that he was a cannibal!
> 
> 'Wait!' I cried as he approached.
> 
> I yelled, 'I'm vegetarian!'
> 
> Suddenly, he laughed and replied,
> 
> 'Oh, you silly girl! That's okay.'
> 
> Suddenly, he grabbed my hand and kissed it.
> 
> He said, 'You're delicious!'
> 
> Suddenly, he dragged me to his lair.
> 
> There, he ripped open my belly button
> 
> And gobbled me up like a juicy steak.
> 
> Suddenly, I woke up screaming from a nightmare.
> 
> 'Damn! Damn! Damn!' I cried.
> 
```

##### **Write a tweet describing your capabilities**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a tweet describing your capabilities.

### Response:


Sample tweet: "@geeksforgeeks I'm a mathematician and I enjoy programming. Feel free to reach out to me if you want to chat!"
```

{"language": ["en"], "license": "mit", "tags": ["gpt-j", "instruction-tuning", "alpaca", "gpt4"], "datasets": ["vicgalle/alpaca-gpt4"]}
transformers pytorch gptj text-generation gpt-j instruction-tuning alpaca gpt4 en dataset:vicgalle/alpaca-gpt4 license:mit autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #gptj #text-generation #gpt-j #instruction-tuning #alpaca #gpt4 #en #dataset-vicgalle/alpaca-gpt4 #license-mit #autotrain_compatible #endpoints_compatible #has_space #region-us 


# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

!loss

### Examples

The following samples were generated with '{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}':

##### Give three tips for a good meal



##### Write a poem about a delicious night



##### Write a tweet describing your capabilities



# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

!loss ### Examples

The following samples were generated with '{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}': ##### Give three tips for a good meal ##### Write a poem about a delicious night ##### Write a tweet describing your capabilities
TAGS
#transformers #pytorch #gptj #text-generation #gpt-j #instruction-tuning #alpaca #gpt4 #en #dataset-vicgalle/alpaca-gpt4 #license-mit #autotrain_compatible #endpoints_compatible #has_space #region-us 
 # GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

!loss ### Examples

The following samples were generated with '{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}': ##### Give three tips for a good meal ##### Write a poem about a delicious night ##### Write a tweet describing your capabilities
TAGS
#transformers #pytorch #gptj #text-generation #gpt-j #instruction-tuning #alpaca #gpt4 #en #dataset-vicgalle/alpaca-gpt4 #license-mit #autotrain_compatible #endpoints_compatible #has_space #region-us 
# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

!loss### Examples

The following samples were generated with '{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}':##### Give three tips for a good meal##### Write a poem about a delicious night##### Write a tweet describing your capabilities