Update README.md
Browse files
README.md
CHANGED
@@ -51,10 +51,27 @@ outputs = model.generate(
|
|
51 |
for i in range(4):
|
52 |
print(tokenizer.decode(outputs[i], skip_special_tokens=True, clean_up_tokenization_spaces=True))
|
53 |
|
54 |
-
# The mechanical engineering field requires an understanding of core areas including mechanics, dynamics, thermodynamics, materials science, structural analysis, and electricity.
|
55 |
-
|
|
|
|
|
|
|
|
|
56 |
# ... Developing the knowledge base for these core areas will enable engineers to build their capabilities rapidly and efficiently. ...
|
57 |
# ... The field of mechanics offers a variety and broad range for applications throughout the engineering/technological fields. ...
|
58 |
# ... Mechanics generally is not understood by students. While they can be employed in the field, mechanical engineering ...
|
59 |
# ... Introduction to mechanical engineering and core fields including chemical products, materials science, structural analysis, and geomatics ...
|
60 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
51 |
for i in range(4):
|
52 |
print(tokenizer.decode(outputs[i], skip_special_tokens=True, clean_up_tokenization_spaces=True))
|
53 |
|
54 |
+
# INPUT: The mechanical engineering field requires an understanding of core areas including mechanics, dynamics, thermodynamics, materials science, structural analysis, and electricity.
|
55 |
+
|
56 |
+
# > Cheapity3 continues with beam search:
|
57 |
+
# ... The field of mechanical engineering is a broad field that includes many core areas of engineering.
|
58 |
+
|
59 |
+
# > Cheapity3 continues with sampling and top_k=50:
|
60 |
# ... Developing the knowledge base for these core areas will enable engineers to build their capabilities rapidly and efficiently. ...
|
61 |
# ... The field of mechanics offers a variety and broad range for applications throughout the engineering/technological fields. ...
|
62 |
# ... Mechanics generally is not understood by students. While they can be employed in the field, mechanical engineering ...
|
63 |
# ... Introduction to mechanical engineering and core fields including chemical products, materials science, structural analysis, and geomatics ...
|
64 |
+
```
|
65 |
+
|
66 |
+
## Pretty decent right?
|
67 |
+
|
68 |
+
Hence, whenever you feel like GPT3 is too expensive, Cheapity3 comes to the rescue 🤗.
|
69 |
+
|
70 |
+
## Model Training FYI
|
71 |
+
- T5-base model
|
72 |
+
- Trained on only 1M sentences from English, French and German text
|
73 |
+
- Mostly text from wikipedia, arxiv and QA datasets
|
74 |
+
- Learning rate: 0.00003
|
75 |
+
- 2 epochs
|
76 |
+
- Max input: 512 tokens
|
77 |
+
- Max output: 128 tokens
|