Upload README.md

README.md

@@ -1,3 +1,67 @@
 ---
+language:
+- en
+datasets:
+- garage-bAInd/Open-Platypus
+library_name: transformers
+pipeline_tag: text-generation
 license: cc-by-nc-sa-4.0
 ---
+
+# **PlatYi-34B-200K-Q**  
+<img src='./PlatYi.png' width=256>
+
+## Model Details
+
+**Model Developers** Kyujin Han (kyujinpy)
+
+**Input** Models input text only.
+
+**Output** Models generate text only.
+
+**Model Architecture**   
+PlatYi-34B-200K-Q is an auto-regressive language model based on the Yi-34B transformer architecture.
+
+**Blog Link**  
+Blog: [Coming soon...]  
+Github: [Coming soon...]  
+
+**Base Model**    
+[01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B)   
+
+**Training Dataset**    
+[garage-bAInd/Open-Platypus](https://huggingface.co/datasets/garage-bAInd/Open-Platypus).  
+
+**Notice**  
+While training, I used QLoRA.  
+But, `lora_r` values is 64.   
+
+# **Model Benchmark**
+
+## Open leaderboard
+- Follow up as [link](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).  
+
+| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
+| --- | --- | --- | --- | --- | --- | --- | --- |
+| **PlatYi-34B-200K-Q** | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
+| PlatYi-34B-Q | 69.86 | 66.89 | 85.14 | 77.66 | 53.03 | 82.48 | 53.98 |
+| [01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B) | 69.42 | 64.59 | 85.69 | 76.35 | 56.23 | 83.03 | 50.64 |
+| [01-ai/Yi-34B-200K](https://huggingface.co/01-ai/Yi-34B-200K) | 70.81 | 65.36 | 85.58 | 76.06 | 53.64 | 82.56 | 61.64 |
+   
+# Implementation Code
+```python
+### KO-Platypus
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+repo = "kyujinpy/PlatYi-34B-200K-Q"
+OpenOrca = AutoModelForCausalLM.from_pretrained(
+        repo,
+        return_dict=True,
+        torch_dtype=torch.float16,
+        device_map='auto'
+)
+OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
+```
+
+---