lysandre HF staff commited on
Commit
b7e919f
1 Parent(s): 1088516

Update dimensions

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -36,6 +36,14 @@ This way, the model learns an inner representation of the English language that
36
  useful for downstream tasks: if you have a dataset of labeled sentences for instance, you can train a standard
37
  classifier using the features produced by the BERT model as inputs.
38
 
 
 
 
 
 
 
 
 
39
  ## Intended uses & limitations
40
 
41
  You can use the raw model for either masked language modeling or next sentence prediction, but it's mostly intended to
 
36
  useful for downstream tasks: if you have a dataset of labeled sentences for instance, you can train a standard
37
  classifier using the features produced by the BERT model as inputs.
38
 
39
+ This model has the following configuration:
40
+
41
+ - 24-layer
42
+ - 1024 hidden dimension
43
+ - 16 attention heads
44
+ - 336M parameters.
45
+
46
+
47
  ## Intended uses & limitations
48
 
49
  You can use the raw model for either masked language modeling or next sentence prediction, but it's mostly intended to