Upload folder using huggingface_hub

.gitattributes

@@ -1,35 +1,5 @@
-*.7z filter=lfs diff=lfs merge=lfs -text
-*.arrow filter=lfs diff=lfs merge=lfs -text
-*.bin filter=lfs diff=lfs merge=lfs -text
-*.bz2 filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
-*.ftz filter=lfs diff=lfs merge=lfs -text
-*.gz filter=lfs diff=lfs merge=lfs -text
-*.h5 filter=lfs diff=lfs merge=lfs -text
-*.joblib filter=lfs diff=lfs merge=lfs -text
-*.lfs.* filter=lfs diff=lfs merge=lfs -text
-*.mlmodel filter=lfs diff=lfs merge=lfs -text
-*.model filter=lfs diff=lfs merge=lfs -text
-*.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
-*.onnx filter=lfs diff=lfs merge=lfs -text
-*.ot filter=lfs diff=lfs merge=lfs -text
-*.parquet filter=lfs diff=lfs merge=lfs -text
-*.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
-*.pt filter=lfs diff=lfs merge=lfs -text
-*.pth filter=lfs diff=lfs merge=lfs -text
-*.rar filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-saved_model/**/* filter=lfs diff=lfs merge=lfs -text
-*.tar.* filter=lfs diff=lfs merge=lfs -text
-*.tar filter=lfs diff=lfs merge=lfs -text
-*.tflite filter=lfs diff=lfs merge=lfs -text
-*.tgz filter=lfs diff=lfs merge=lfs -text
-*.wasm filter=lfs diff=lfs merge=lfs -text
-*.xz filter=lfs diff=lfs merge=lfs -text
-*.zip filter=lfs diff=lfs merge=lfs -text
-*.zst filter=lfs diff=lfs merge=lfs -text
-*tfevents* filter=lfs diff=lfs merge=lfs -text
+Nxcode-CQ-7B-orpo-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Nxcode-CQ-7B-orpo-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nxcode-CQ-7B-orpo-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Nxcode-CQ-7B-orpo-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Nxcode-CQ-7B-orpo-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Nxcode-CQ-7B-orpo-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe58ab59ab170babc341a5e68e0a0c6ae3539cb63161c8db089c10df020eb1e4
+size 3986819168

Nxcode-CQ-7B-orpo-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d58ec20e67dd7b57c89718a199878f2b990e54c4ae5ec99f33ce290d82256f57
+size 4738590816

Nxcode-CQ-7B-orpo-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:631827df7962423638878a4a84f01201de6b546c036cdded5dc697141b3c4f13
+size 5428160608

Nxcode-CQ-7B-orpo-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ded4ee8f1297012f1084d4b12a5118333b4535f7be004512927d190687cdf3e0
+size 6377588832

Nxcode-CQ-7B-orpo-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7bcb190bf99470b17c53460eae35fa3d3cd2e0a6eee08c932ddf29e744b0335
+size 7706773600

README.md

@@ -0,0 +1,95 @@
+---
+license: mit
+tags:
+- code
+pipeline_tag: text-generation
+---
+
+<a href="https://ntq.com.vn" target="_blank"><img src="https://cdn-uploads.huggingface.co/production/uploads/5ee1b417636bdb3834e2da19/etbfTJuVdAub2evNP_E4g.png" width="200"/></a>
+
+## Introduction
+
+Nxcode-CQ-7B-orpo is an [Monolithic Preference Optimization without Reference Model](https://arxiv.org/abs/2403.07691) fine-tune of Qwen/CodeQwen1.5-7B on 100k samples of high-quality ranking data.
+
+## [Evalplus](https://github.com/evalplus/evalplus)
+
+| EvalPlus | pass@1 |
+| --- | --- |
+| HumanEval | 86.6 |
+| HumanEval+ | 83.5 |
+| MBPP(v0.2.0) | 82.3 |
+| MBPP+(v0.2.0) | 70.4 |
+
+We use a simple template to generate the solution for evalplus:
+
+```python
+"Complete the following Python function:\n{prompt}"
+```
+
+[Evalplus Leaderboard](https://evalplus.github.io/leaderboard.html)
+| Models | HumanEval | HumanEval+|
+|------ | ------  | ------ |
+| GPT-4-Turbo (April 2024)|  90.2| 86.6|
+| GPT-4 (May 2023)|  88.4| 81.17|
+| GPT-4-Turbo (Nov 2023)|  85.4| 79.3| 
+| CodeQwen1.5-7B-Chat|  83.5| 78.7| 
+| claude-3-opus (Mar 2024)|  82.9| 76.8|
+| DeepSeek-Coder-33B-instruct|  81.1| 75.0|
+| WizardCoder-33B-V1.1|  79.9| 73.2|
+| OpenCodeInterpreter-DS-33B|  79.3| 73.8|
+| speechless-codellama-34B-v2.0|  77.4| 72|
+| GPT-3.5-Turbo (Nov 2023)| 76.8| 70.7|
+| Llama3-70B-instruct| 76.2| 70.7|
+
+## Bigcode Leaderboard
+
+[Bigcode Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
+
+**09/05/2024**
+
+Top 1 average score.
+
+Top 2 winrate.
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/5ee1b417636bdb3834e2da19/OQonD6a7aNjnN9SsTkFp-.png)
+
+
+## Quickstart
+
+Here provides a code snippet with `apply_chat_template` to show you how to load the tokenizer and model and how to generate contents. You should upgrade the transformers if you receive an error when loading the tokenizer
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+device = "cuda" # the device to load the model onto
+
+model = AutoModelForCausalLM.from_pretrained(
+    "NTQAI/Nxcode-CQ-7B-orpo",
+    torch_dtype="auto",
+    device_map="auto"
+)
+tokenizer = AutoTokenizer.from_pretrained("NTQAI/Nxcode-CQ-7B-orpo")
+
+prompt = """Complete the following Python function:
+from typing import List
+
+
+def has_close_elements(numbers: List[float], threshold: float) -> bool:
+    """ Check if in given list of numbers, are any two numbers closer to each other than
+    given threshold.
+    >>> has_close_elements([1.0, 2.0, 3.0], 0.5)
+    False
+    >>> has_close_elements([1.0, 2.8, 3.0, 4.0, 5.0, 2.0], 0.3)
+    True
+    """
+"""
+messages = [
+    {"role": "user", "content": prompt}
+]
+
+inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
+outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, top_k=50, top_p=0.95, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id)
+res = tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True)
+
+```
+
+### Contact information
+For personal communication related to this project, please contact Nha Nguyen Van (nha.nguyen@ntq-solution.com.vn).