alsubari commited on
Commit
d8c3284
1 Parent(s): a2b1fe1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -23
README.md CHANGED
@@ -7,7 +7,6 @@ pipeline_tag: text-generation
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
10
- This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
11
 
12
  ## Model Details
13
 
@@ -20,37 +19,26 @@ This modelcard aims to be a base template for new models. It has been generated
20
  - **Developed by:** [More Information Needed]
21
  - **Shared by [optional]:** [More Information Needed]
22
  - **Model type:** [More Information Needed]
23
- - **Language(s) (NLP):** [More Information Needed]
24
  - **License:** [More Information Needed]
25
- - **Finetuned from model [optional]:** [More Information Needed]
26
 
27
- ### Model Sources [optional]
28
 
29
- <!-- Provide the basic links for the model. -->
30
-
31
- - **Repository:** [More Information Needed]
32
- - **Paper [optional]:** [More Information Needed]
33
- - **Demo [optional]:** [More Information Needed]
34
 
35
  ## Uses
36
 
37
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 
 
38
 
39
- ### Direct Use
40
-
41
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
42
-
43
- [More Information Needed]
44
-
45
- ### Downstream Use [optional]
46
-
47
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
48
-
49
- [More Information Needed]
50
 
51
  ### Out-of-Scope Use
52
 
53
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
 
 
 
 
54
 
55
  [More Information Needed]
56
 
@@ -94,20 +82,25 @@ generation_args = {
94
  'do_sample': True,
95
  'repetition_penalty':2.0
96
  }
 
 
97
  input_text = f'<|startoftext|>Instruction: {prml[1]} {text}<|pad|>Answer:'
98
  input_ids = tokenizer.encode(input_text, return_tensors='pt').to("cuda")
99
  output_ids = model.generate(input_ids=input_ids,**generation_args)
100
  output_text = tokenizer.decode(output_ids[0],skip_special_tokens=True).split('Answer:')[1]
101
  answer_pose=pyarabic.trans.delimite_language(output_text, start="<token>", end="</token>")
102
 
103
- print(answer_pose)# <token>تعلم : تعلم</token> : Verb <token>من : من</token> : Relative pronoun <token>أخطائك : اخطا</token> : Noun <token>ك</token> : Personal pronunction
 
104
 
 
105
  input_text = f'<|startoftext|>Instruction: {prml[0]} {text}<|pad|>Answer:'
106
  input_ids = tokenizer.encode(input_text, return_tensors='pt').to("cuda")
107
  output_ids = model.generate(input_ids=input_ids,**generation_args)
108
  output_text = tokenizer.decode(output_ids[0],skip_special_tokens=True).split('Answer:')[1]
109
 
110
- print(output_text)#تعلم : تعلم : فعل ، مفرد المخاطب للمذكر ، فعل مضارع ، مرفوع من : من : حرف جر أخطائك : اخطا : اسم ، جمع المذكر ، مجرور ك : ضمير ، مفرد المتكلم
 
111
  ```
112
 
113
  ## Training Details
@@ -233,4 +226,4 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
233
 
234
  ## Model Card Contact
235
 
236
- [More Information Needed]
 
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
 
10
 
11
  ## Model Details
12
 
 
19
  - **Developed by:** [More Information Needed]
20
  - **Shared by [optional]:** [More Information Needed]
21
  - **Model type:** [More Information Needed]
22
+ - **Language(s) (NLP):** [Arabic]
23
  - **License:** [More Information Needed]
24
+ - **Finetuned from model :** [https://huggingface.co/aubmindlab/aragpt2-mega]
25
 
 
26
 
 
 
 
 
 
27
 
28
  ## Uses
29
 
30
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
31
+ 1. The model can be helpful for the arabic langauge students/researchers, since it provide the full sentence anaylsis (اعراب الجملة ) in arabic language.
32
+ 2.
33
 
 
 
 
 
 
 
 
 
 
 
 
34
 
35
  ### Out-of-Scope Use
36
 
37
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
38
+ 1. This model can't be use for grammar check, since it dail with high level of arabic correct sentence as input
39
+ 2. Don't use arabic dailects in input sentence.
40
+ 3.
41
+ 4.
42
 
43
  [More Information Needed]
44
 
 
82
  'do_sample': True,
83
  'repetition_penalty':2.0
84
  }
85
+
86
+ ##Pose Tagging
87
  input_text = f'<|startoftext|>Instruction: {prml[1]} {text}<|pad|>Answer:'
88
  input_ids = tokenizer.encode(input_text, return_tensors='pt').to("cuda")
89
  output_ids = model.generate(input_ids=input_ids,**generation_args)
90
  output_text = tokenizer.decode(output_ids[0],skip_special_tokens=True).split('Answer:')[1]
91
  answer_pose=pyarabic.trans.delimite_language(output_text, start="<token>", end="</token>")
92
 
93
+ print(answer_pose)
94
+ # <token>تعلم : تعلم</token> : Verb <token>من : من</token> : Relative pronoun <token>أخطائك : اخطا</token> : Noun <token>ك</token> : Personal pronunction
95
 
96
+ ##Arabic Sentence Analysis
97
  input_text = f'<|startoftext|>Instruction: {prml[0]} {text}<|pad|>Answer:'
98
  input_ids = tokenizer.encode(input_text, return_tensors='pt').to("cuda")
99
  output_ids = model.generate(input_ids=input_ids,**generation_args)
100
  output_text = tokenizer.decode(output_ids[0],skip_special_tokens=True).split('Answer:')[1]
101
 
102
+ print(output_text)
103
+ #تعلم : تعلم : فعل ، مفرد المخاطب للمذكر ، فعل مضارع ، مرفوع من : من : حرف جر أخطائك : اخطا : اسم ، جمع المذكر ، مجرور ك : ضمير ، مفرد المتكلم
104
  ```
105
 
106
  ## Training Details
 
226
 
227
  ## Model Card Contact
228
 
229
+ [akram.alsubari87@gmail.com]