Update README.md

README.md

@@ -6,6 +6,45 @@ language:
 library_name: transformers
 ---
 
+Roberta base model trained on Azerbaijani subset of OSCAR corpus.
+```json
+attention_probs_dropout_prob:0.1
+bos_token_id:0
+classifier_dropout:null
+eos_token_id:2
+gradient_checkpointing:false
+hidden_act:"gelu"
+hidden_dropout_prob:0.1
+hidden_size:768
+initializer_range:0.02
+intermediate_size:3072
+layer_norm_eps:1e-12
+max_position_embeddings:514
+model_type:"roberta"
+num_attention_heads:12
+num_hidden_layers:6
+pad_token_id:1
+position_embedding_type:"absolute"
+torch_dtype:"float32"
+transformers_version:"4.10.0"
+type_vocab_size:1
+use_cache:true
+vocab_size:52000
+```
+
+## Usage
+```python
+from transformers import AutoTokenizer, AutoModelWithLMHead
+
+tokenizer = AutoTokenizer.from_pretrained("iamdenay/roberta-azerbaijani")
+
+model = AutoModelWithLMHead.from_pretrained("iamdenay/roberta-azerbaijani")
+```
+```python
+from transformers import pipeline
+model_mask = pipeline('fill-mask', model='iamdenay/roberta-azerbaijani')
+model_mask("Le tweet <mask>.")
+```
 
 ## Examples
 ```python