Upload folder using huggingface_hub (#2)
Browse files- 5ab464943f4e6abeffe1f67a264915da5b09562e9e77d129b51f4db180342adf (41272feec52c76abebf26cf2df71920582982d7c)
- 8fbd1e3bafcc8eba95584bebe3afecf1550e1bd311b468d581eac56a5f635f92 (e2f0820cfc11d0188c6e797a633c287fe0220bc5)
- 2504112f55e02cc1fb33dde37ae0fa35d3ce55a3ba38f90ccc1f285d466c42de (c45cbbf33637149cf2381e57b2ebfebae2b25f20)
- 01a8e46a2ef574bb42087adad2aa51498babbad459abd5e50754e983431e28b1 (076ec4e81a69fb25370009175a8e5ac46477998a)
- de5675e01abc780752ba8da6688aed6f3e07c294e1d2c098a27d146b094da159 (dc6ffbee6ece24b58fcc501293d747ca618b77ef)
- 86e12490c60109f0e31b7880c06f15c679795a8ac0dff0f90e406704eb9a6f13 (9d090cf4911badc4301c1c27ffba506f2efc4587)
- 13bdce86b0955d967a47195ca680795ab0d7dbc92554a711a8d70573d1703d34 (f92d79e4ba6c349d0a34c4ebfea7760c57e948df)
- 464c01e70325659332c29a1953ea28d395b5d3df44d49e2c2b735c61949d868b (bfdae1d51817beead1790159568f5842d34afb18)
- ae362b929321e78dac00be23203737cbe27de9ffb3e77d8c79669ad3bc6da06e (42297394ac8ae27819d99163ed23fc9f8c571f96)
- README.md +7 -7
- model-00001-of-00008.safetensors +1 -1
- model-00002-of-00008.safetensors +1 -1
- model-00003-of-00008.safetensors +1 -1
- model-00004-of-00008.safetensors +1 -1
- model-00005-of-00008.safetensors +1 -1
- model-00006-of-00008.safetensors +1 -1
- model-00007-of-00008.safetensors +1 -1
- model-00008-of-00008.safetensors +1 -1
- quant_strategy.json +1 -1
@@ -1,13 +1,13 @@
|
|
1 |
-
---
|
2 |
-
base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0
|
3 |
-
license: apache-2.0
|
4 |
-
tags:
|
5 |
-
- mlx
|
6 |
-
---
|
7 |
|
8 |
# GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
|
9 |
|
10 |
-
This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0
|
11 |
Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
|
12 |
|
13 |
## Use with mlx
|
|
|
1 |
+
---
|
2 |
+
base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0
|
3 |
+
license: apache-2.0
|
4 |
+
tags:
|
5 |
+
- mlx
|
6 |
+
---
|
7 |
|
8 |
# GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
|
9 |
|
10 |
+
This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0`](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) using gbx-lm version **0.3.4**.
|
11 |
Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
|
12 |
|
13 |
## Use with mlx
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5366037748
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fff571e481b7144bf7faa8a3e34d9502857365e1595257cde3f620144d3d600f
|
3 |
size 5366037748
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5253675996
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:828b025774c6797ab478fb7cb2154ad2148fff1ba527fc8c9456cb91ccc3ef51
|
3 |
size 5253675996
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5333976637
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d3a03bafa972d157b3221aef2993fb50ddd600aca425af977a72c3e71810458b
|
3 |
size 5333976637
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5334058518
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c87cd17127e9fbf3ab66a1ae5f3845e110db0ebea404452e5b362f9edd07abad
|
3 |
size 5334058518
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5253676013
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bd1cd1f3cc01068100a6b1242775bed23171475ea95c2aa60c9cc4aa4d0245b0
|
3 |
size 5253676013
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5333976679
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a84fd497cce8df36b1212f2a389be57f405f0b40951d9b7b43bba852dc970a5f
|
3 |
size 5333976679
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5334058518
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:671d264c953c967fd6e877e822c3a37c6ac071154eb1f5b14860c1638f478b7d
|
3 |
size 5334058518
|
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3385731500
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5e72acc0ec794fdede30b92587457e6ce961f698922eecfe49b4e1b1f96c185b
|
3 |
size 3385731500
|
@@ -7601,4 +7601,4 @@
|
|
7601 |
}
|
7602 |
}
|
7603 |
}
|
7604 |
-
}
|
|
|
7601 |
}
|
7602 |
}
|
7603 |
}
|
7604 |
+
}
|