Ahmet commited on
Commit
47feb38
1 Parent(s): 96330a6

update model

Browse files
Files changed (3) hide show
  1. README.md +15 -9
  2. config.json +1 -1
  3. pytorch_model.bin +1 -1
README.md CHANGED
@@ -21,6 +21,12 @@ This model was adapted from [ytu-ce-cosmos/turkish-base-bert-uncased](https://hu
21
  - [nli_tr](https://huggingface.co/datasets/nli_tr)
22
  - [emrecan/stsb-mt-turkish](https://huggingface.co/datasets/emrecan/stsb-mt-turkish)
23
 
 
 
 
 
 
 
24
  ## Usage (Sentence-Transformers)
25
 
26
  Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
@@ -85,10 +91,10 @@ print(sentence_embeddings)
85
  Achieved results on the [STS-b](https://huggingface.co/datasets/emrecan/stsb-mt-turkish) test split are given below:
86
 
87
  ```txt
88
- Cosine-Similarity : Pearson: 0.7408 Spearman: 0.7274
89
- Manhattan-Distance: Pearson: 0.7113 Spearman: 0.7146
90
- Euclidean-Distance: Pearson: 0.7106 Spearman: 0.7140
91
- Dot-Product-Similarity: Pearson: 0.7144 Spearman: 0.7025
92
  ```
93
 
94
 
@@ -97,9 +103,9 @@ The model was trained with the parameters:
97
 
98
  **DataLoader**:
99
 
100
- `torch.utils.data.dataloader.DataLoader` of length 180 with parameters:
101
  ```
102
- {'batch_size': 32, 'sampler': 'torch.utils.data.sampler.RandomSampler', 'batch_sampler': 'torch.utils.data.sampler.BatchSampler'}
103
  ```
104
 
105
  **Loss**:
@@ -109,8 +115,8 @@ The model was trained with the parameters:
109
  Parameters of the fit()-Method:
110
  ```
111
  {
112
- "epochs": 5,
113
- "evaluation_steps": 90,
114
  "evaluator": "sentence_transformers.evaluation.EmbeddingSimilarityEvaluator.EmbeddingSimilarityEvaluator",
115
  "max_grad_norm": 1,
116
  "optimizer_class": "<class 'torch.optim.adamw.AdamW'>",
@@ -119,7 +125,7 @@ Parameters of the fit()-Method:
119
  },
120
  "scheduler": "WarmupLinear",
121
  "steps_per_epoch": null,
122
- "warmup_steps": 72,
123
  "weight_decay": 0.01
124
  }
125
  ```
 
21
  - [nli_tr](https://huggingface.co/datasets/nli_tr)
22
  - [emrecan/stsb-mt-turkish](https://huggingface.co/datasets/emrecan/stsb-mt-turkish)
23
 
24
+ :warning: **All texts were manually lowercased,** [as stated](https://huggingface.co/ytu-ce-cosmos/turkish-base-bert-uncased#%E2%9A%A0-uncased-use-requires-manual-lowercase-conversion) by the model's authors:
25
+
26
+ ```python
27
+ text.replace("I", "ı").lower()
28
+ ```
29
+
30
  ## Usage (Sentence-Transformers)
31
 
32
  Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
 
91
  Achieved results on the [STS-b](https://huggingface.co/datasets/emrecan/stsb-mt-turkish) test split are given below:
92
 
93
  ```txt
94
+ Cosine-Similarity : Pearson: 0.8401 Spearman: 0.8410
95
+ Manhattan-Distance: Pearson: 0.8256 Spearman: 0.8261
96
+ Euclidean-Distance: Pearson: 0.8261 Spearman: 0.8268
97
+ Dot-Product-Similarity: Pearson: 0.7823 Spearman: 0.7723
98
  ```
99
 
100
 
 
103
 
104
  **DataLoader**:
105
 
106
+ `torch.utils.data.dataloader.DataLoader` of length 90 with parameters:
107
  ```
108
+ {'batch_size': 64, 'sampler': 'torch.utils.data.sampler.RandomSampler', 'batch_sampler': 'torch.utils.data.sampler.BatchSampler'}
109
  ```
110
 
111
  **Loss**:
 
115
  Parameters of the fit()-Method:
116
  ```
117
  {
118
+ "epochs": 4,
119
+ "evaluation_steps": 9,
120
  "evaluator": "sentence_transformers.evaluation.EmbeddingSimilarityEvaluator.EmbeddingSimilarityEvaluator",
121
  "max_grad_norm": 1,
122
  "optimizer_class": "<class 'torch.optim.adamw.AdamW'>",
 
125
  },
126
  "scheduler": "WarmupLinear",
127
  "steps_per_epoch": null,
128
+ "warmup_steps": 36,
129
  "weight_decay": 0.01
130
  }
131
  ```
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "/content/drive/MyDrive/models/e4_b32_turkish_base_bert_uncased-mean-nli-stsb/",
3
  "architectures": [
4
  "BertModel"
5
  ],
 
1
  {
2
+ "_name_or_path": "output/ytu_ce_cosmos-turkish_base_bert_uncased-b64-e4-nli/",
3
  "architectures": [
4
  "BertModel"
5
  ],
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a20bab3e0a305feb348e8cfb630e17e1d694ba9ccff89f80286e2f2cd4e087cf
3
  size 442541034
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d14328e5385c0743dccf01fc30292d193e29d5a81d2c1460e386d33db762ee5
3
  size 442541034