---
license: mit
datasets:
- vicgalle/alpaca-gpt4
language:
- en
tags:
- gpt-j
- instruction-tuning
- alpaca
- gpt4
---

# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

![loss](loss.png)

### Examples

The following samples were generated with `{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}`:

##### **Give three tips for a good meal**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Give three tips for a good meal.

### Response:


Tip 1: Make sure to enjoy your meal. It's easy to forget about enjoying yourself when you're hungry.
Tip 2: Try to eat a healthy meal that contains lots of vegetables and fruits.
Tip 3: Eat slowly and chew your food thoroughly. This will help you digest your meal better.
```

##### **Write a poem about a delicious night**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a poem about a delicious night.

### Response:


> "The moon shone brightly on the night sky,
> 
> Stars twinkled brightly from afar.
> 
> Suddenly, my eyes saw the silhouette
> 
> Of a handsome stranger in the distance.
> 
> He walked slowly towards me with a smile.
> 
> He said, 'I've come to eat you up tonight.'
> 
> Suddenly, I knew that he was a cannibal!
> 
> 'Wait!' I cried as he approached.
> 
> I yelled, 'I'm vegetarian!'
> 
> Suddenly, he laughed and replied,
> 
> 'Oh, you silly girl! That's okay.'
> 
> Suddenly, he grabbed my hand and kissed it.
> 
> He said, 'You're delicious!'
> 
> Suddenly, he dragged me to his lair.
> 
> There, he ripped open my belly button
> 
> And gobbled me up like a juicy steak.
> 
> Suddenly, I woke up screaming from a nightmare.
> 
> 'Damn! Damn! Damn!' I cried.
> 
```

##### **Write a tweet describing your capabilities**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a tweet describing your capabilities.

### Response:


Sample tweet: "@geeksforgeeks I'm a mathematician and I enjoy programming. Feel free to reach out to me if you want to chat!"
```