bobig
/

Qwen2.5-14B-Instruct-1M-Q4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

bobig commited on 5 days ago

Commit

0f07de6

·

verified ·

1 Parent(s): d21ddcf

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -12,9 +12,9 @@ tags:
 - mlx
 ---
-# bobig/Qwen2.5-14B-Instruct-1M-4.5bit
-The Model [bobig/Qwen2.5-14B-Instruct-1M-4.5bit](https://huggingface.co/bobig/Qwen2.5-14B-Instruct-1M-4.5bit) was
 converted to MLX format from [unsloth/Qwen2.5-14B-Instruct-1M](https://huggingface.co/unsloth/Qwen2.5-14B-Instruct-1M)
 using mlx-lm version **0.21.4**.
@@ -27,7 +27,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("bobig/Qwen2.5-14B-Instruct-1M-4.5bit")
 prompt = "hello"

 - mlx
 ---
+# bobig/Qwen2.5-14B-Instruct-1M-Q4
+The Model [bobig/Qwen2.5-14B-Instruct-1M-Q4](https://huggingface.co/bobig/Qwen2.5-14B-Instruct-1M-Q4) was
 converted to MLX format from [unsloth/Qwen2.5-14B-Instruct-1M](https://huggingface.co/unsloth/Qwen2.5-14B-Instruct-1M)
 using mlx-lm version **0.21.4**.
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("bobig/Qwen2.5-14B-Instruct-1M-Q4")
 prompt = "hello"