Upload 2 files

README.md

@@ -1,3 +1,69 @@
 ---
+language:
+- en
+datasets:
+- garage-bAInd/Open-Platypus
+library_name: transformers
+pipeline_tag: text-generation
 license: cc-by-nc-sa-4.0
 ---
+
+# **PlatYi-34B-200k-Q-FastChat**  
+<img src='./PlatYi.png' width=256>
+
+## Model Details
+
+**Model Developers** Kyujin Han (kyujinpy)
+
+**Input** Models input text only.
+
+**Output** Models generate text only.
+
+**Model Architecture**   
+PlatYi-34B-200k-Q-FastChat is an auto-regressive language model based on the Yi-34B transformer architecture.
+
+**Blog Link**  
+Blog: [Coming soon...]  
+Github: [Coming soon...]  
+
+**Base Model**    
+[01-ai/Yi-34B-200K](https://huggingface.co/01-ai/Yi-34B-200K)  
+  
+**Training Dataset**    
+[garage-bAInd/Open-Platypus](https://huggingface.co/datasets/garage-bAInd/Open-Platypus).  
+
+**Notice**  
+While training, I used QLoRA.  
+`lora_r` values is 64.   
+
+**Apply prompting**  
+References by [FastChat](https://github.com/lm-sys/FastChat/blob/daa2b9abe20597ebf34dc5df164d450456610c74/fastchat/conversation.py#L198-L229).   
+  
+# **Model Benchmark**
+
+## Open leaderboard
+- Follow up as [link](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).  
+
+| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
+| --- | --- | --- | --- | --- | --- | --- | --- |
+| **PlatYi-34B-200k-Q-FastChat** | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
+| PlatYi-34B-Llama-Q-FastChat | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
+| [Yi-34B](https://huggingface.co/01-ai/Yi-34B) | 69.42 | 64.59 | 85.69 | 76.35 | 56.23 | 83.03 | 50.64 |  
+   
+# Implementation Code
+```python
+### KO-Platypus
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+repo = "kyujinpy/PlatYi-34B-200k-Q-FastChat"
+OpenOrca = AutoModelForCausalLM.from_pretrained(
+        repo,
+        return_dict=True,
+        torch_dtype=torch.float16,
+        device_map='auto'
+)
+OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
+```
+
+---