Japanese
japanese-stablelm
causal-lm
RioShiina commited on
Commit
e5f6e70
1 Parent(s): ee5b015

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +81 -1
README.md CHANGED
@@ -1,3 +1,83 @@
1
  ---
2
- license: llama2
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ja
4
+ tags:
5
+ - japanese-stablelm
6
+ - causal-lm
7
+ datasets:
8
+ - kunishou/hh-rlhf-49k-ja
9
+ - kunishou/databricks-dolly-15k-ja
10
+ - kunishou/oasst1-89k-ja
11
+ license:
12
+ - llama2
13
  ---
14
+
15
+ **[4.0bpw](https://huggingface.co/rioshiina/japanese-stablelm-instruct-ja_vocab-beta-7b-exl2/tree/4.0bpw)**
16
+ **[6.0bpw](https://huggingface.co/rioshiina/japanese-stablelm-instruct-ja_vocab-beta-7b-exl2/tree/6.0bpw)**
17
+ **[8.0bpw](https://huggingface.co/rioshiina/japanese-stablelm-instruct-ja_vocab-beta-7b-exl2/tree/8.0bpw)**
18
+
19
+ # japanese-stablelm-instruct-ja_vocab-beta-7b-exl2
20
+ - Model creator: [Stability AI](https://huggingface.co/stabilityai)
21
+ - Original model: [japanese-stablelm-instruct-ja_vocab-beta-7b](https://huggingface.co/stabilityai/japanese-stablelm-instruct-ja_vocab-beta-7b)
22
+
23
+ ## Prompt template: Japanese-StableLM-Llama-2-Chat
24
+
25
+ ```
26
+ <s>[INST] <<SYS>>
27
+ あなたは役立つアシスタントです。
28
+ <<SYS>>
29
+
30
+ {prompt} [/INST]
31
+
32
+ ```
33
+
34
+ ## Licensing
35
+
36
+ The creator of the source model has listed its license as `['llama2']`, and this quantization has therefore used that same license.
37
+
38
+ As this model is based on Llama 2, it is also subject to the Meta Llama 2 license terms, and the license files for that are additionally included. It should therefore be considered as being claimed to be licensed under both licenses. I contacted Hugging Face for clarification on dual licensing but they do not yet have an official position. Should this change, or should Meta provide any feedback on this situation, I will update this section accordingly.
39
+
40
+ In the meantime, any questions regarding licensing, and in particular how these two licenses might interact, should be directed to the original model repository: [Stability AI's Japanese StableLM Instruct Beta 70B](https://huggingface.co/stabilityai/japanese-stablelm-instruct-beta-70b).
41
+
42
+ ## Model Details
43
+
44
+ * **Model type**: `japanese-stablelm-instruct-ja_vocab-beta-7b` model is an auto-regressive language model based on the Llama2 transformer architecture.
45
+ * **Language(s)**: Japanese
46
+ * **License**: [Llama2 Community License](https://ai.meta.com/llama/license/).
47
+ * **Contact**: For questions and comments about the model, please join [Stable Community Japan](https://discord.gg/StableJP). For future announcements / information about Stability AI models, research, and events, please follow https://twitter.com/StabilityAI_JP.
48
+
49
+ ## Training Dataset
50
+
51
+ The following datasets were used for the instruction training. Note these are Japanese translated versions of the original datasets, shared by [kunishou](https://huggingface.co/kunishou).
52
+
53
+ - [Anthropic HH-RLHF](https://huggingface.co/datasets/kunishou/hh-rlhf-49k-ja)
54
+ - [Databricks Dolly 15-k](https://huggingface.co/datasets/kunishou/databricks-dolly-15k-ja)
55
+ - [OpenAssistant Conversations Dataset](https://huggingface.co/datasets/kunishou/oasst1-89k-ja)
56
+
57
+ ## Use and Limitations
58
+
59
+ ### Intended Use
60
+
61
+ The model is intended to be used by all individuals as a foundation for application-specific fine-tuning without strict limitations on commercial use.
62
+
63
+ ### Limitations and bias
64
+
65
+ The pre-training dataset may have contained offensive or inappropriate content even after applying data cleansing filters which can be reflected in the model generated text. We recommend users exercise reasonable caution when using these models in production systems. Do not use the model for any applications that may cause harm or distress to individuals or groups.
66
+
67
+ ## Authors
68
+ This model was developed by the Research & Development team at Stability AI Japan, and the development was co-led by [Takuya Akiba](https://huggingface.co/iwiwi) and [Meng Lee](https://huggingface.co/leemeng). The members of the team are as follows:
69
+
70
+ - [Meng Lee](https://huggingface.co/leemeng)
71
+ - [Fujiki Nakamura](https://huggingface.co/fujiki)
72
+ - [Makoto Shing](https://huggingface.co/mkshing)
73
+ - [Paul McCann](https://huggingface.co/polm-stability)
74
+ - [Takuya Akiba](https://huggingface.co/iwiwi)
75
+ - [Naoki Orii](https://huggingface.co/mrorii)
76
+
77
+ ## Acknowledgements
78
+
79
+ We thank Meta Research for releasing Llama 2 under an open license for others to build on.
80
+
81
+ We are grateful for the contributions of the EleutherAI Polyglot-JA team in helping us to collect a large amount of pre-training data in Japanese. Polyglot-JA members includes Hyunwoong Ko (Project Lead), Fujiki Nakamura (originally started this project when he commited to the Polyglot team), Yunho Mo, Minji Jung, KeunSeok Im, and Su-Kyeong Jang.
82
+
83
+ We are also appreciative of [AI Novelist/Sta (Bit192, Inc.)](https://ai-novel.com/index.php) and the numerous contributors from [Stable Community Japan](https://discord.gg/VPrcE475HB) for assisting us in gathering a large amount of high-quality Japanese textual data for model training.