gguf 4bit

.gitattributes

@@ -34,4 +34,3 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 ggml-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
-openthaigpt-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text

Modelfile

@@ -1,4 +0,0 @@
-FROM ./openthaigpt-Q4_K_M.gguf
-TEMPLATE """[INST] <<SYS>>{{ .System }}<</SYS>>
-
-{{ .Prompt }} [/INST]"""

README.md

@@ -1,5 +1,5 @@
 ---
-license: llama2
+license: apache-2.0
 language:
 - th
 - en
@@ -44,17 +44,6 @@ Thai language multiple choice exams, Test on unseen test sets, Zero-shot learnin
 
 (Updated on: 7 April 2024)
 
-## Benchmark on M3Exam evaluated by an external party (Float16.cloud)
-
-| **Models**          | **ENGLISH (M3EXAM)** | **THAI (M3EXAM)** |
-|---------------------|------------------|---------------|
-| <b style="color:blue">OTG-7b</b>               | <b style="color:blue">40.92 %</b>           | <b style="color:blue">25.14 %</b>        |
-| OTG-13b            | 53.69 %        | 36.49 %       |
-| OTG-70b            | 72.58 %<        | 48.29 %       |
-| GPT-3.5-turbo-0613* | -                | 34.1 %        |
-| GPT-4-0613*         | -                | 56.0 %        |
-More information: https://blog.float16.cloud/the-first-70b-thai-llm/
-
 ## Licenses
 **Source Code**: License Apache Software License 2.0.<br>
 **Weight**: Research and **Commercial uses**.<br>
@@ -236,20 +225,6 @@ curl --location 'http://localhost:8000/completion' \
 }'
 ```
 
-### Ollama
-
-There are two ways to run on ollama
-
-1. From this repo Modelfile and 4 bit quantized gguf
-```bash
-ollama create -f ./Modelfile
-```
-
-2. From Ollama CLI
-```bash
-ollama run pacozaa/openthaigpt
-```
-
 ### GPU Memory Requirements
 | **Number of Parameters** | **FP 16 bits** | **8 bits (Quantized)** | **4 bits (Quantized)** | **Example Graphic Card for 4 bits** |
 |------------------|----------------|------------------------|------------------------|---------------------------------------------|
@@ -275,4 +250,4 @@ ollama run pacozaa/openthaigpt
 * Kriangkrai Saetan (kraitan.ss21@gmail.com)
 * Pitikorn Khlaisamniang (pitikorn32@gmail.com)
 
-<i>Disclaimer: Provided responses are not guaranteed.</i>
+<i>Disclaimer: Provided responses are not guaranteed.</i>

openthaigpt-Q4_K_M.gguf

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:7c9fe7f5dfb4adaac2211b8159297d3689abb9c94259a9e8b75a86348cf6fdda
-size 4132760544