Update README.md

README.md

@@ -1,6 +1,7 @@
 ---
 library_name: transformers
-tags: []
+language:
+- ko
 ---
 
 # Model Card for Model ID
@@ -17,61 +18,61 @@ readme coming soon
 
 This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
+- **Developed by:** 4n3mone (YongSang Yoo)
+- **Model type:** chatglm
+- **Language(s) (NLP):** Korean
+- **License:** glm-4
+- **Finetuned from model [optional]:** THUDM/glm-4-9b-chat
 
 ### Model Sources [optional]
 
 <!-- Provide the basic links for the model. -->
 
-- **Repository:** [More Information Needed]
+- **Repository:** THUDM/glm-4-9b-chat
 - **Paper [optional]:** [More Information Needed]
 - **Demo [optional]:** [More Information Needed]
 
-## Uses
 
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
+## How to Get Started with the Model
 
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+Use the code below to get started with the model.
+```python
+from transformers import AutoTokenizer
+from vllm import LLM, SamplingParams
 
-[More Information Needed]
 
-## Bias, Risks, and Limitations
+# GLM-4-9B-Chat
+# If you encounter OOM (Out of Memory) issues, it is recommended to reduce max_model_len or increase tp_size.
+max_model_len, tp_size = 131072, 1
+model_name = "4n3mone/glm-4-ko-9b-chat-preview"
+prompt = [{"role": "user", "content": "피카츄랑 아구몬 중에서 누가 더 귀여워?"}]
 
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
+llm = LLM(
+    model=model_name,
+    tensor_parallel_size=tp_size,
+    max_model_len=max_model_len,
+    trust_remote_code=True,
+    enforce_eager=True,
+    # If you encounter OOM (Out of Memory) issues, it is recommended to enable the following parameters.
+    # enable_chunked_prefill=True,
+    # max_num_batched_tokens=8192
+)
+stop_token_ids = [151329, 151336, 151338]
+sampling_params = SamplingParams(temperature=0.95, max_tokens=1024, stop_token_ids=stop_token_ids)
 
-[More Information Needed]
+inputs = tokenizer.apply_chat_template(prompt, tokenize=False, add_generation_prompt=True)
+outputs = llm.generate(prompts=inputs, sampling_params=sampling_params)
 
-### Recommendations
+print(outputs[0].outputs[0].text)
 
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+model.generate(prompt)
 
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+```
 
-## How to Get Started with the Model
 
-Use the code below to get started with the model.
 
-[More Information Needed]
 
 ## Training Details