vicgalle's picture
Update README.md
bd4fc2c
---
license: mit
datasets:
- vicgalle/alpaca-gpt4
language:
- en
tags:
- gpt-j
- instruction-tuning
- alpaca
- gpt4
---
# GPT-J-6B instruction-tuned on Alpaca-GPT4
This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.
![loss](loss.png)
### Examples
The following samples were generated with `{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}`:
##### **Give three tips for a good meal**
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
Give three tips for a good meal.
### Response:
Tip 1: Make sure to enjoy your meal. It's easy to forget about enjoying yourself when you're hungry.
Tip 2: Try to eat a healthy meal that contains lots of vegetables and fruits.
Tip 3: Eat slowly and chew your food thoroughly. This will help you digest your meal better.
```
##### **Write a poem about a delicious night**
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
Write a poem about a delicious night.
### Response:
> "The moon shone brightly on the night sky,
>
> Stars twinkled brightly from afar.
>
> Suddenly, my eyes saw the silhouette
>
> Of a handsome stranger in the distance.
>
> He walked slowly towards me with a smile.
>
> He said, 'I've come to eat you up tonight.'
>
> Suddenly, I knew that he was a cannibal!
>
> 'Wait!' I cried as he approached.
>
> I yelled, 'I'm vegetarian!'
>
> Suddenly, he laughed and replied,
>
> 'Oh, you silly girl! That's okay.'
>
> Suddenly, he grabbed my hand and kissed it.
>
> He said, 'You're delicious!'
>
> Suddenly, he dragged me to his lair.
>
> There, he ripped open my belly button
>
> And gobbled me up like a juicy steak.
>
> Suddenly, I woke up screaming from a nightmare.
>
> 'Damn! Damn! Damn!' I cried.
>
```
##### **Write a tweet describing your capabilities**
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
Write a tweet describing your capabilities.
### Response:
Sample tweet: "@geeksforgeeks I'm a mathematician and I enjoy programming. Feel free to reach out to me if you want to chat!"
```