Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
navjordj
/
gpt2_no
like
0
Text Generation
Transformers
PyTorch
JAX
TensorBoard
gpt2
text-generation-inference
Inference Endpoints
Model card
Files
Files and versions
Metrics
Training metrics
Community
1
Train
Deploy
Use this model
navjordj
commited on
Nov 17, 2021
Commit
f3c46a3
•
1 Parent(s):
4eb31e9
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+8
-0
README.md
ADDED
Viewed
@@ -0,0 +1,8 @@
1
+
3 epoch på norsk oscar corpus.
2
+
3
+
warmup_steps = 1000
4
+
learning_rate = 5e-3
5
+
block_size =512
6
+
per_device_train_batch_size = 64
7
+
8
+
cirka 1,5 time på TPU v3-8 per epoch