File size: 2,323 Bytes
1105bb4
 
 
 
 
 
 
 
 
 
 
f0dde05
 
00715c9
 
 
 
bd4fc2c
00715c9
bd4fc2c
 
 
 
 
00715c9
0162f1d
 
 
 
 
 
 
 
 
 
 
 
 
 
bd4fc2c
0162f1d
26b2740
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bd4fc2c
f0dde05
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
---
license: mit
datasets:
- vicgalle/alpaca-gpt4
language:
- en
tags:
- gpt-j
- instruction-tuning
- alpaca
- gpt4
---

# GPT-J-6B instruction-tuned on Alpaca-GPT4

This model was finetuned on GPT-4 generations of the Alpaca prompts, using LoRA for 30.000 steps (batch size of 128), taking over 7 hours in four V100S.

![loss](loss.png)

### Examples

The following samples were generated with `{"temperature" : 0.7, "top_p" : 0.92, "top_k" : 0}`:

##### **Give three tips for a good meal**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Give three tips for a good meal.

### Response:


Tip 1: Make sure to enjoy your meal. It's easy to forget about enjoying yourself when you're hungry.
Tip 2: Try to eat a healthy meal that contains lots of vegetables and fruits.
Tip 3: Eat slowly and chew your food thoroughly. This will help you digest your meal better.
```

##### **Write a poem about a delicious night**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a poem about a delicious night.

### Response:


> "The moon shone brightly on the night sky,
> 
> Stars twinkled brightly from afar.
> 
> Suddenly, my eyes saw the silhouette
> 
> Of a handsome stranger in the distance.
> 
> He walked slowly towards me with a smile.
> 
> He said, 'I've come to eat you up tonight.'
> 
> Suddenly, I knew that he was a cannibal!
> 
> 'Wait!' I cried as he approached.
> 
> I yelled, 'I'm vegetarian!'
> 
> Suddenly, he laughed and replied,
> 
> 'Oh, you silly girl! That's okay.'
> 
> Suddenly, he grabbed my hand and kissed it.
> 
> He said, 'You're delicious!'
> 
> Suddenly, he dragged me to his lair.
> 
> There, he ripped open my belly button
> 
> And gobbled me up like a juicy steak.
> 
> Suddenly, I woke up screaming from a nightmare.
> 
> 'Damn! Damn! Damn!' I cried.
> 
```

##### **Write a tweet describing your capabilities**

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a tweet describing your capabilities.

### Response:


Sample tweet: "@geeksforgeeks I'm a mathematician and I enjoy programming. Feel free to reach out to me if you want to chat!"
```