linkanjarad commited on
Commit
31fd03e
1 Parent(s): 559488f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +84 -6
README.md CHANGED
@@ -12,21 +12,99 @@ should probably proofread and complete it, then remove this comment. -->
12
 
13
  # GPT2-Medium-Alpaca-355m
14
 
15
- This model is a fine-tuned version of [gpt2-medium](https://huggingface.co/gpt2-medium) on an unknown dataset.
16
 
17
  ## Model description
18
 
19
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
  ## Intended uses & limitations
22
 
23
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
 
25
- ## Training and evaluation data
 
 
26
 
27
- More information needed
28
 
29
- ## Training procedure
30
 
31
  ### Training hyperparameters
32
 
 
12
 
13
  # GPT2-Medium-Alpaca-355m
14
 
15
+ This model is a fine-tuned version of [gpt2-medium](https://huggingface.co/gpt2-medium) on the [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca) dataset. This is a test to check if the concept of Databrick's [databricks/dolly-v1-6b](https://huggingface.co/databricks/dolly-v1-6b) can be applied to smaller models.
16
 
17
  ## Model description
18
 
19
+ This is an LLM trained to follow instructions, similar to ChatGPT, except much much smaller.
20
+
21
+ ## Sample Use
22
+
23
+ ```python
24
+ from transformers import pipeline
25
+
26
+ generator = pipeline('text-generation', model='linkanjarad/GPT2-Medium-Alpaca-355m')
27
+
28
+ prompt = '''### Instruction:
29
+ Who is the first person on the moon?
30
+
31
+ ### Response:'''
32
+
33
+ output = generator(prompt, do_sample=True, min_length=10, max_length=50, temperature=0.5)
34
+ print(output[0]['generated_text'])
35
+ ```
36
 
37
  ## Intended uses & limitations
38
 
39
+ The model works best when given input in the format of the dataset it was trained on. Here is an example of the format of the [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca) dataset:
40
+
41
+ ```
42
+ ### Instruction:
43
+ What are the three primary colors?
44
+
45
+ ### Response:
46
+ The three primary colors are red, blue, and yellow.
47
+ ```
48
+
49
+ Here are a few sample model outputs:
50
+
51
+ ```
52
+ ### Instruction:
53
+ List some steps to take for a project plan regarding the implementation of a food drive.
54
+
55
+ ### Response:
56
+ To implement a food drive, it is important to set concrete goals and objectives. These goals and objectives should include:
57
+ 1. Collecting the necessary supplies to provide the hungry
58
+ 2. Setting up the food banks to store the produce
59
+ 3. Organizing distribution of the produce
60
+ 4. Reducing waste and reducing waste disposal
61
+ 5. Monitoring the progress of the plan and ensuring it is executed correctly
62
+ 6. Leveraging the existing community, resources, and resources to implement the plan
63
+ 7. Monitoring the effectiveness of the plan and providing feedback on progress
64
+ 8. Establishing and reviewing financial milestones (when required)
65
+ 9. Creating and running training sessions for staff and volunteers
66
+ 10. Responding to feedback from customers and visitors
67
+ 11. Establishing guidelines and standards in the program
68
+ 12. Keeping up to date with the latest nutrition information and trends
69
+ 13. Developing sustainability plans and strategies to maintain a healthy kitchen environment
70
+ 14. Developing a business plan for marketing and selling the produce, ingredients, and products
71
+ 15. Responding to customer feedback and implementing them
72
+ 16. Evaluating customer satisfaction levels and improving the program, especially when the program is not effective
73
+ 17. Having regular meetings with the board and stakeholders to discuss progress and recommendations
74
+ 18. Reviewing the program and taking steps to improve it as time goes on
75
+ ```
76
+
77
+ ```
78
+ ### Instruction:
79
+ Generate a short horror story about evil teddy bears.
80
+
81
+ ### Response:
82
+ A young girl named Elizabeth wandered down a dark and mysterious alley in London. At the end of the alley, her nose ran into a strange-looking teddy bear. It was covered in dark fur and had a dark and unsettling smell. Elizabeth slowly noticed that he was shaking and didn't want to sleep. He seemed extremely tense and scared and she decided to take him in her arms and bring him home. Despite all the fear and fear this strange and scary bear held, Elizabeth was determined to help him. She went through the alley as quickly and quietly as possible, avoiding people and animals alike to avoid getting lost. She eventually found her way back home and was deeply moved by the bear's kindness. She wanted to make sure that this strange bear that she encountered was still there whenever she needed it.
83
+
84
+ Eventually Elizabeth was able to convince the bear to stay, and he kept him safe by staying with her without saying a word. Elizabeth thanked her for the gift and promised to help to make sure he always had safe haven, and the bear was thankful and soon accepted her offer.
85
+
86
+ Elizabeth made sure to take this teddy to see him the next time she visited London and he quickly became something of a friend when she returned. He has since become so fond of the small bear that he always wears around their home and has even been named after Elizabeth.
87
+ ```
88
+
89
+ ```
90
+ ### Instruction:
91
+ Who discovered gravity?
92
+
93
+ ### Response:
94
+ The first person to discover gravity was an Italian mathematician, Leonardo da Vinci. He coined the term 'gravity' in 1584. Da Vinci's discovery was so revolutionary that it was eventually used in textbooks by 19th century geologists and astronomers. Since then, scientists have been discovering numerous other forces, like electromagnetic waves, magnetism, gravity, and friction. In recent years, numerous scientists have used the term 'gravity
95
+ ```
96
+
97
+ ```
98
+ ### Instruction:
99
+ Explain the process of how a star is formed.
100
 
101
+ ### Response:
102
+ A star is a star that is formed from a gas and dust cloud of gas and dust, known as a disk, that is surrounded by a dense outer disk. The outer disk surrounds an energy-rich, liquid-filled outer crust. The density of the disk is very high, increasing the amount of material it contains, which creates the gravitational pull of the planet within it. The outer crust is filled with a high degree of material-rich metals, carbon, and iron, which are the building blocks for the stars and planets in our solar system. When the disk is fully formed, the metal-rich layers of the outer disk are ejected outwards into space, creating a star. Stars are the primary means of transporting matter from the outer disk to the core of the planet. The core of a planet is composed of layers of mostly metals, with some oxygen in the center of the core
103
+ ```
104
 
105
+ ## Training Procedure
106
 
107
+ The model was trained with Huggingface's 🤗 Trainer for about half an epoch.
108
 
109
  ### Training hyperparameters
110