xmadai
/

Llama-3.1-8B-Instruct-xMADai-INT4

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Oscar Wu commited on Oct 23, 2024

Commit

78b264a

·

1 Parent(s): c6bd367

Updated README

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -20,11 +20,11 @@ This repository contains [`meta-llama/Llama-3.1-8B-Instruct`](https://huggingfac
 ## Table 1: xMAD vs. Unsloth vs. Meta
-|                                                                                                                   | MMLU      | Arc Challenge | Arc Easy | LAMBADA Standard | LAMBADA OpenAI | *PIQA     | Winogrande | HellaSwag |
-| ----------------------------------------------------------------------------------------------------------------- | --------- | -------------- | --------- | ---------------- | -------------- | --------- | ---------- | --------- |
-| [xmadai/Llama-3.1-8B-Instruct-xMADai-INT4](https://huggingface.co/xmadai/Llama-3.1-8B-Instruct-xMADai-INT4)       | **66.83** | **52.3**       | **82.11** | **65.73**        | **73.30**       | **79.88** | **72.77**  | **58.49** |
-| [unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit) | 65.91     | 51.37          | 80.89     | 63.98            | 71.49          | 79.43     | 73.80      | 58.51     |
-| [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)                       | 68.05     | 51.71          | 81.9      | 66.18            | 73.55          | 79.87     | 73.72      | 59.10      |

 ## Table 1: xMAD vs. Unsloth vs. Meta
+|                                                                                                                   | MMLU      | Arc Challenge | Arc Easy  | LAMBADA Standard | LAMBADA OpenAI | PIQA      | Winogrande | HellaSwag |
+| ----------------------------------------------------------------------------------------------------------------- | --------- | ------------- | --------- | ---------------- | -------------- | --------- | ---------- | --------- |
+| [xmadai/Llama-3.1-8B-Instruct-xMADai-INT4](https://huggingface.co/xmadai/Llama-3.1-8B-Instruct-xMADai-INT4)       | **66.83** | **52.3**      | **82.11** | **65.73**        | **73.30**      | **79.88** | **72.77**  | **58.49** |
+| [unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit) | 65.91     | 51.37         | 80.89     | 63.98            | 71.49          | 79.43     | 73.80      | 58.51     |
+| [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)                       | 68.05     | 51.71         | 81.9      | 66.18            | 73.55          | 79.87     | 73.72      | 59.10     |