akdeniz27 commited on
Commit
de01f6d
1 Parent(s): 1f56ac4

Upload model

Browse files
Files changed (2) hide show
  1. README.md +3 -38
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -1,45 +1,10 @@
1
  ---
2
  library_name: peft
3
- language: tr
4
- widget:
5
- - text: "Mustafa Kemal Atatürk 19 Mayıs 1919'da Samsun'a çıktı."
6
  ---
7
  ## Training procedure
8
 
9
- This is a fine-tuned model of base model "dbmdz/bert-base-turkish-cased" using the Parameter Efficient Fine Tuning (PEFT) with Low-Rank Adaptation (LoRA) technique
10
- using a reviewed version of well known Turkish NER dataset
11
- (https://github.com/stefan-it/turkish-bert/files/4558187/nerdata.txt).
12
 
13
- # Fine-tuning parameters:
14
- ```
15
- task = "ner"
16
- model_checkpoint = "dbmdz/bert-base-turkish-cased"
17
- batch_size = 16
18
- label_list = ['O', 'B-PER', 'I-PER', 'B-ORG', 'I-ORG', 'B-LOC', 'I-LOC']
19
- max_length = 512
20
- learning_rate = 1e-3
21
- num_train_epochs = 10
22
- weight_decay = 0.01
23
- ```
24
- # PEFT Parameters
25
- ```
26
- inference_mode=False
27
- r=16
28
- lora_alpha=16
29
- lora_dropout=0.1
30
- bias="all"
31
- ```
32
- # How to use:
33
- ```
34
- model = AutoModelForTokenClassification.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
35
- tokenizer = AutoTokenizer.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
36
- ner = pipeline('ner', model=model, tokenizer=tokenizer, aggregation_strategy="first")
37
- ner("your text here")
38
- ```
39
- Pls refer "https://huggingface.co/transformers/_modules/transformers/pipelines/token_classification.html" for entity grouping with aggregation_strategy parameter.
40
 
41
- # Reference test results:
42
- * accuracy: 0.993104
43
- * f1: 0.948413
44
- * precision: 0.939789
45
- * recall: 0.957196
 
1
  ---
2
  library_name: peft
 
 
 
3
  ---
4
  ## Training procedure
5
 
6
+ ### Framework versions
 
 
7
 
8
+ - PEFT 0.4.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
+ - PEFT 0.4.0
 
 
 
 
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f659b8a7762588a2f3cf829b48dcecba6411814f7010389e29a9518f6849a41
3
  size 2842333
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be6df4f79f116f8651dc696d0b7e2c58587b401cf02d207e17e0236d96d4efc9
3
  size 2842333