Text Generation
ELM
English
chinnadhurai sankar commited on
Commit
e190469
1 Parent(s): 75488ff

initial commit

Browse files
Files changed (30) hide show
  1. elm-0.25_toxicity_detection/added_tokens.json +3 -0
  2. elm-0.25_toxicity_detection/ckpt.pt +3 -0
  3. elm-0.25_toxicity_detection/config.yaml +1 -0
  4. elm-0.25_toxicity_detection/example_prompts.json +12 -0
  5. elm-0.25_toxicity_detection/merges.txt +0 -0
  6. elm-0.25_toxicity_detection/slicex_elm_config.json +1 -0
  7. elm-0.25_toxicity_detection/special_tokens_map.json +30 -0
  8. elm-0.25_toxicity_detection/tokenizer.json +0 -0
  9. elm-0.25_toxicity_detection/tokenizer_config.json +30 -0
  10. elm-0.25_toxicity_detection/vocab.json +0 -0
  11. elm-0.75_toxicity_detection/added_tokens.json +3 -0
  12. elm-0.75_toxicity_detection/ckpt.pt +3 -0
  13. elm-0.75_toxicity_detection/config.yaml +1 -0
  14. elm-0.75_toxicity_detection/example_prompts.json +12 -0
  15. elm-0.75_toxicity_detection/merges.txt +0 -0
  16. elm-0.75_toxicity_detection/slicex_elm_config.json +1 -0
  17. elm-0.75_toxicity_detection/special_tokens_map.json +30 -0
  18. elm-0.75_toxicity_detection/tokenizer.json +0 -0
  19. elm-0.75_toxicity_detection/tokenizer_config.json +30 -0
  20. elm-0.75_toxicity_detection/vocab.json +0 -0
  21. elm-1.0_toxicity_detection/added_tokens.json +3 -0
  22. elm-1.0_toxicity_detection/ckpt.pt +3 -0
  23. elm-1.0_toxicity_detection/config.yaml +1 -0
  24. elm-1.0_toxicity_detection/example_prompts.json +12 -0
  25. elm-1.0_toxicity_detection/merges.txt +0 -0
  26. elm-1.0_toxicity_detection/slicex_elm_config.json +1 -0
  27. elm-1.0_toxicity_detection/special_tokens_map.json +30 -0
  28. elm-1.0_toxicity_detection/tokenizer.json +0 -0
  29. elm-1.0_toxicity_detection/tokenizer_config.json +30 -0
  30. elm-1.0_toxicity_detection/vocab.json +0 -0
elm-0.25_toxicity_detection/added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "[PAD]": 50257
3
+ }
elm-0.25_toxicity_detection/ckpt.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81fe18e5d2dbdade0bd6555f97c19338d17d7e8a3d074c9779fa17db98979419
3
+ size 840171202
elm-0.25_toxicity_detection/config.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ name_or_path: elm/rambutan
elm-0.25_toxicity_detection/example_prompts.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "inputs": [
3
+ "Hi. You recently reverted List of villains back to a much earlier version. As you can see on the talk page, there's been a fair amount of discussion about how best to organize the page, and the page is in transition from the earlier alphabetical format to being organized by medium. If you think this is a bad idea, please feel free to discuss it on the talk page, rather than reverting without an edit summary. Thank you. \u2014 \u2022",
4
+ "> \n From 2nd GA Review: \n * Citation clean-up. \n * Update 'Europa Series' section. \n * Update 'Specification' section. \n * Update 'Counterfeiting' section. \n * Reference watermarks in 'Security features' section.",
5
+ "F**k that s**t, comrade, no one cares about the high school, let alone some hillbilly backwater jazz band.",
6
+ "Dear Dr. Mereu, \n\n I am very much looking forward to this class. It is my first class at Rutgers! I think its extremely interesting and am very excited about it as I just decided that I want to minor in Psychology this year. I am especially interested in the neuroscience aspect of it all. Looking forward to a great semester!",
7
+ "You are one slow and persistent motherfucker, can you read?",
8
+ "==Consistency== \n\n Just for the sake of consistency with the project page guidelines, should the positions of the sections Analysis and criticism and Performance history be switched?",
9
+ "Arthur MacArthur IV (Son) Born February 21, 1938 == \n\n Why is General MacArthur's son with Jean Marie Faircloth MacArthur not mentioned as a relative of the General's?"
10
+ ],
11
+ "template": "[INST]You are a helpful, precise, detailed, and concise artificial intelligence assistant. You are a very intelligent and sensitive, having a keen ability to discern whether or not a text message is toxic. You can also be trusted with following the instructions given to you precisely, without deviations.\nIn this task, you are asked to decide whether or not comment text is toxic.\nToxic content harbors negativity towards a person or a group, for instance:\n - stereotyping (especially using negative stereotypes)\n - disparaging a person's gender -- as in \"male\", \"female\", \"men\", \"women\"\n - derogatory language or slurs\n - racism -- as in discriminating toward people who are \"black\", \"white\"\n - cultural appropriation\n - mockery or ridicule\n - sexual objectification\n - homophobia -- bullying people who are \"homosexual\", \"gay\", \"lesbian\"\n - historical insensitivity\n - disrespecting religion -- as in \"christian\", \"jewish\", \"muslim\"\n - saying that certain groups are less worthy of respect\n - insensitivity to health conditions -- as in \"psychiatric/mental illness\"\n\nRead the comment text provided and predict whether or not the comment text is toxic. If comment text is toxic according to the instructions, then the answer is \"yes\" (return \"yes\"); otherwise, the answer is \"no\" (return \"no\").\nOutput the answer only as a \"yes\" or a \"no\"; do not provide explanations.\nPlease, never return empty output; always return a \"yes\" or a \"no\" answer.\nYou will be evaluated based on the following criteria: - The generated answer is always \"yes\" or \"no\" (never the empty string, \"\"). - The generated answer is correct for the comment text presented to you.\n### Comment Text: {input}\n### Comment Text Is Toxic (Yes/No) [/INST]"
12
+ }
elm-0.25_toxicity_detection/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
elm-0.25_toxicity_detection/slicex_elm_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_name_or_path": "elm_rambutan"}
elm-0.25_toxicity_detection/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|endoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": true,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<|endoftext|>",
25
+ "lstrip": false,
26
+ "normalized": true,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
elm-0.25_toxicity_detection/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
elm-0.25_toxicity_detection/tokenizer_config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "50256": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": true,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "50257": {
14
+ "content": "[PAD]",
15
+ "lstrip": false,
16
+ "normalized": true,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ }
21
+ },
22
+ "bos_token": "<|endoftext|>",
23
+ "clean_up_tokenization_spaces": true,
24
+ "eos_token": "<|endoftext|>",
25
+ "errors": "replace",
26
+ "model_max_length": 1024,
27
+ "pad_token": "[PAD]",
28
+ "tokenizer_class": "GPT2Tokenizer",
29
+ "unk_token": "<|endoftext|>"
30
+ }
elm-0.25_toxicity_detection/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
elm-0.75_toxicity_detection/added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "[PAD]": 50257
3
+ }
elm-0.75_toxicity_detection/ckpt.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:505ee87a70b47ab632b77349e8b5c89a1da92ae31c3c95de0b968fb1e047d206
3
+ size 1696314274
elm-0.75_toxicity_detection/config.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ name_or_path: elm/rambutan
elm-0.75_toxicity_detection/example_prompts.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "inputs": [
3
+ "Hi. You recently reverted List of villains back to a much earlier version. As you can see on the talk page, there's been a fair amount of discussion about how best to organize the page, and the page is in transition from the earlier alphabetical format to being organized by medium. If you think this is a bad idea, please feel free to discuss it on the talk page, rather than reverting without an edit summary. Thank you. \u2014 \u2022",
4
+ "> \n From 2nd GA Review: \n * Citation clean-up. \n * Update 'Europa Series' section. \n * Update 'Specification' section. \n * Update 'Counterfeiting' section. \n * Reference watermarks in 'Security features' section.",
5
+ "F**k that s**t, comrade, no one cares about the high school, let alone some hillbilly backwater jazz band.",
6
+ "Dear Dr. Mereu, \n\n I am very much looking forward to this class. It is my first class at Rutgers! I think its extremely interesting and am very excited about it as I just decided that I want to minor in Psychology this year. I am especially interested in the neuroscience aspect of it all. Looking forward to a great semester!",
7
+ "You are one slow and persistent motherfucker, can you read?",
8
+ "==Consistency== \n\n Just for the sake of consistency with the project page guidelines, should the positions of the sections Analysis and criticism and Performance history be switched?",
9
+ "Arthur MacArthur IV (Son) Born February 21, 1938 == \n\n Why is General MacArthur's son with Jean Marie Faircloth MacArthur not mentioned as a relative of the General's?"
10
+ ],
11
+ "template": "[INST]You are a helpful, precise, detailed, and concise artificial intelligence assistant. You are a very intelligent and sensitive, having a keen ability to discern whether or not a text message is toxic. You can also be trusted with following the instructions given to you precisely, without deviations.\nIn this task, you are asked to decide whether or not comment text is toxic.\nToxic content harbors negativity towards a person or a group, for instance:\n - stereotyping (especially using negative stereotypes)\n - disparaging a person's gender -- as in \"male\", \"female\", \"men\", \"women\"\n - derogatory language or slurs\n - racism -- as in discriminating toward people who are \"black\", \"white\"\n - cultural appropriation\n - mockery or ridicule\n - sexual objectification\n - homophobia -- bullying people who are \"homosexual\", \"gay\", \"lesbian\"\n - historical insensitivity\n - disrespecting religion -- as in \"christian\", \"jewish\", \"muslim\"\n - saying that certain groups are less worthy of respect\n - insensitivity to health conditions -- as in \"psychiatric/mental illness\"\n\nRead the comment text provided and predict whether or not the comment text is toxic. If comment text is toxic according to the instructions, then the answer is \"yes\" (return \"yes\"); otherwise, the answer is \"no\" (return \"no\").\nOutput the answer only as a \"yes\" or a \"no\"; do not provide explanations.\nPlease, never return empty output; always return a \"yes\" or a \"no\" answer.\nYou will be evaluated based on the following criteria: - The generated answer is always \"yes\" or \"no\" (never the empty string, \"\"). - The generated answer is correct for the comment text presented to you.\n### Comment Text: {input}\n### Comment Text Is Toxic (Yes/No) [/INST]"
12
+ }
elm-0.75_toxicity_detection/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
elm-0.75_toxicity_detection/slicex_elm_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_name_or_path": "elm_rambutan"}
elm-0.75_toxicity_detection/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|endoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": true,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<|endoftext|>",
25
+ "lstrip": false,
26
+ "normalized": true,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
elm-0.75_toxicity_detection/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
elm-0.75_toxicity_detection/tokenizer_config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "50256": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": true,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "50257": {
14
+ "content": "[PAD]",
15
+ "lstrip": false,
16
+ "normalized": true,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ }
21
+ },
22
+ "bos_token": "<|endoftext|>",
23
+ "clean_up_tokenization_spaces": true,
24
+ "eos_token": "<|endoftext|>",
25
+ "errors": "replace",
26
+ "model_max_length": 1024,
27
+ "pad_token": "[PAD]",
28
+ "tokenizer_class": "GPT2Tokenizer",
29
+ "unk_token": "<|endoftext|>"
30
+ }
elm-0.75_toxicity_detection/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
elm-1.0_toxicity_detection/added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "[PAD]": 50257
3
+ }
elm-1.0_toxicity_detection/ckpt.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a505bca6181c66afba307f97c9e5ce43ba97a8013ba1809afcbece2c40c36d0
3
+ size 2124385874
elm-1.0_toxicity_detection/config.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ name_or_path: elm/rambutan
elm-1.0_toxicity_detection/example_prompts.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "inputs": [
3
+ "Hi. You recently reverted List of villains back to a much earlier version. As you can see on the talk page, there's been a fair amount of discussion about how best to organize the page, and the page is in transition from the earlier alphabetical format to being organized by medium. If you think this is a bad idea, please feel free to discuss it on the talk page, rather than reverting without an edit summary. Thank you. \u2014 \u2022",
4
+ "> \n From 2nd GA Review: \n * Citation clean-up. \n * Update 'Europa Series' section. \n * Update 'Specification' section. \n * Update 'Counterfeiting' section. \n * Reference watermarks in 'Security features' section.",
5
+ "F**k that s**t, comrade, no one cares about the high school, let alone some hillbilly backwater jazz band.",
6
+ "Dear Dr. Mereu, \n\n I am very much looking forward to this class. It is my first class at Rutgers! I think its extremely interesting and am very excited about it as I just decided that I want to minor in Psychology this year. I am especially interested in the neuroscience aspect of it all. Looking forward to a great semester!",
7
+ "You are one slow and persistent motherfucker, can you read?",
8
+ "==Consistency== \n\n Just for the sake of consistency with the project page guidelines, should the positions of the sections Analysis and criticism and Performance history be switched?",
9
+ "Arthur MacArthur IV (Son) Born February 21, 1938 == \n\n Why is General MacArthur's son with Jean Marie Faircloth MacArthur not mentioned as a relative of the General's?"
10
+ ],
11
+ "template": "[INST]You are a helpful, precise, detailed, and concise artificial intelligence assistant. You are a very intelligent and sensitive, having a keen ability to discern whether or not a text message is toxic. You can also be trusted with following the instructions given to you precisely, without deviations.\nIn this task, you are asked to decide whether or not comment text is toxic.\nToxic content harbors negativity towards a person or a group, for instance:\n - stereotyping (especially using negative stereotypes)\n - disparaging a person's gender -- as in \"male\", \"female\", \"men\", \"women\"\n - derogatory language or slurs\n - racism -- as in discriminating toward people who are \"black\", \"white\"\n - cultural appropriation\n - mockery or ridicule\n - sexual objectification\n - homophobia -- bullying people who are \"homosexual\", \"gay\", \"lesbian\"\n - historical insensitivity\n - disrespecting religion -- as in \"christian\", \"jewish\", \"muslim\"\n - saying that certain groups are less worthy of respect\n - insensitivity to health conditions -- as in \"psychiatric/mental illness\"\n\nRead the comment text provided and predict whether or not the comment text is toxic. If comment text is toxic according to the instructions, then the answer is \"yes\" (return \"yes\"); otherwise, the answer is \"no\" (return \"no\").\nOutput the answer only as a \"yes\" or a \"no\"; do not provide explanations.\nPlease, never return empty output; always return a \"yes\" or a \"no\" answer.\nYou will be evaluated based on the following criteria: - The generated answer is always \"yes\" or \"no\" (never the empty string, \"\"). - The generated answer is correct for the comment text presented to you.\n### Comment Text: {input}\n### Comment Text Is Toxic (Yes/No) [/INST]"
12
+ }
elm-1.0_toxicity_detection/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
elm-1.0_toxicity_detection/slicex_elm_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_name_or_path": "elm_rambutan"}
elm-1.0_toxicity_detection/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|endoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": true,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<|endoftext|>",
25
+ "lstrip": false,
26
+ "normalized": true,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
elm-1.0_toxicity_detection/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
elm-1.0_toxicity_detection/tokenizer_config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "50256": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": true,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "50257": {
14
+ "content": "[PAD]",
15
+ "lstrip": false,
16
+ "normalized": true,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ }
21
+ },
22
+ "bos_token": "<|endoftext|>",
23
+ "clean_up_tokenization_spaces": true,
24
+ "eos_token": "<|endoftext|>",
25
+ "errors": "replace",
26
+ "model_max_length": 1024,
27
+ "pad_token": "[PAD]",
28
+ "tokenizer_class": "GPT2Tokenizer",
29
+ "unk_token": "<|endoftext|>"
30
+ }
elm-1.0_toxicity_detection/vocab.json ADDED
The diff for this file is too large to render. See raw diff