navjordj
/

gpt2_no

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

navjordj commited on Nov 17, 2021

Commit

f3c46a3

•

1 Parent(s): 4eb31e9

Create README.md

Files changed (1) hide show

README.md +8 -0

README.md ADDED Viewed

	@@ -0,0 +1,8 @@

+3 epoch på norsk oscar corpus.
+warmup_steps = 1000
+learning_rate = 5e-3
+block_size =512
+per_device_train_batch_size = 64
+cirka 1,5 time på TPU v3-8 per epoch