roneneldan commited on
Commit
2254993
1 Parent(s): 6fb5cbb

Create readme.md

Browse files
Files changed (1) hide show
  1. readme.md +22 -0
readme.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ This model was trained on the TinyStories dataset - https://arxiv.org/abs/2305.07759
2
+
3
+ In order to use the model, put the files config.json and pytorch_model.pt in any folder, and then run the following code:
4
+
5
+ from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
6
+
7
+ model = AutoModelForCausalLM.from_pretrained('path to folder here') # REPLACE BY PATH
8
+
9
+ tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neo-125M")
10
+
11
+ prompt = "Once upon a time there was"
12
+
13
+ input_ids = tokenizer.encode(prompt, return_tensors="pt")
14
+
15
+ # Generate completion
16
+ output = model.generate(input_ids, max_length = 1000, num_beams=1, generation_config = generation_config)
17
+
18
+ # Decode the completion
19
+ output_text = tokenizer.decode(output[0], skip_special_tokens=True)
20
+
21
+ # Print the generated text
22
+ print(output_text)