flexudy commited on
Commit
d9179db
1 Parent(s): bf6dbe6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -3
README.md CHANGED
@@ -51,10 +51,27 @@ outputs = model.generate(
51
  for i in range(4):
52
  print(tokenizer.decode(outputs[i], skip_special_tokens=True, clean_up_tokenization_spaces=True))
53
 
54
- # The mechanical engineering field requires an understanding of core areas including mechanics, dynamics, thermodynamics, materials science, structural analysis, and electricity.
55
- # > Cheapity3 continuing:
 
 
 
 
56
  # ... Developing the knowledge base for these core areas will enable engineers to build their capabilities rapidly and efficiently. ...
57
  # ... The field of mechanics offers a variety and broad range for applications throughout the engineering/technological fields. ...
58
  # ... Mechanics generally is not understood by students. While they can be employed in the field, mechanical engineering ...
59
  # ... Introduction to mechanical engineering and core fields including chemical products, materials science, structural analysis, and geomatics ...
60
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  for i in range(4):
52
  print(tokenizer.decode(outputs[i], skip_special_tokens=True, clean_up_tokenization_spaces=True))
53
 
54
+ # INPUT: The mechanical engineering field requires an understanding of core areas including mechanics, dynamics, thermodynamics, materials science, structural analysis, and electricity.
55
+
56
+ # > Cheapity3 continues with beam search:
57
+ # ... The field of mechanical engineering is a broad field that includes many core areas of engineering.
58
+
59
+ # > Cheapity3 continues with sampling and top_k=50:
60
  # ... Developing the knowledge base for these core areas will enable engineers to build their capabilities rapidly and efficiently. ...
61
  # ... The field of mechanics offers a variety and broad range for applications throughout the engineering/technological fields. ...
62
  # ... Mechanics generally is not understood by students. While they can be employed in the field, mechanical engineering ...
63
  # ... Introduction to mechanical engineering and core fields including chemical products, materials science, structural analysis, and geomatics ...
64
+ ```
65
+
66
+ ## Pretty decent right?
67
+
68
+ Hence, whenever you feel like GPT3 is too expensive, Cheapity3 comes to the rescue 🤗.
69
+
70
+ ## Model Training FYI
71
+ - T5-base model
72
+ - Trained on only 1M sentences from English, French and German text
73
+ - Mostly text from wikipedia, arxiv and QA datasets
74
+ - Learning rate: 0.00003
75
+ - 2 epochs
76
+ - Max input: 512 tokens
77
+ - Max output: 128 tokens