NicoNico commited on
Commit
a6e4f22
1 Parent(s): db3dbf9

Upload folder using huggingface_hub (#2)

Browse files

- 5ab464943f4e6abeffe1f67a264915da5b09562e9e77d129b51f4db180342adf (41272feec52c76abebf26cf2df71920582982d7c)
- 8fbd1e3bafcc8eba95584bebe3afecf1550e1bd311b468d581eac56a5f635f92 (e2f0820cfc11d0188c6e797a633c287fe0220bc5)
- 2504112f55e02cc1fb33dde37ae0fa35d3ce55a3ba38f90ccc1f285d466c42de (c45cbbf33637149cf2381e57b2ebfebae2b25f20)
- 01a8e46a2ef574bb42087adad2aa51498babbad459abd5e50754e983431e28b1 (076ec4e81a69fb25370009175a8e5ac46477998a)
- de5675e01abc780752ba8da6688aed6f3e07c294e1d2c098a27d146b094da159 (dc6ffbee6ece24b58fcc501293d747ca618b77ef)
- 86e12490c60109f0e31b7880c06f15c679795a8ac0dff0f90e406704eb9a6f13 (9d090cf4911badc4301c1c27ffba506f2efc4587)
- 13bdce86b0955d967a47195ca680795ab0d7dbc92554a711a8d70573d1703d34 (f92d79e4ba6c349d0a34c4ebfea7760c57e948df)
- 464c01e70325659332c29a1953ea28d395b5d3df44d49e2c2b735c61949d868b (bfdae1d51817beead1790159568f5842d34afb18)
- ae362b929321e78dac00be23203737cbe27de9ffb3e77d8c79669ad3bc6da06e (42297394ac8ae27819d99163ed23fc9f8c571f96)

README.md CHANGED
@@ -1,13 +1,13 @@
1
- ---
2
- base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-test
3
- license: apache-2.0
4
- tags:
5
- - mlx
6
- ---
7
 
8
  # GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
9
 
10
- This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-test`](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) using gbx-lm version **0.3.4**.
11
  Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
12
 
13
  ## Use with mlx
 
1
+ ---
2
+ base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0
3
+ license: apache-2.0
4
+ tags:
5
+ - mlx
6
+ ---
7
 
8
  # GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
9
 
10
+ This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0`](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) using gbx-lm version **0.3.4**.
11
  Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
12
 
13
  ## Use with mlx
model-00001-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29c33287e19285bab608e076255e3296e0086ff1f18c15482792a748719ccf76
3
  size 5366037748
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fff571e481b7144bf7faa8a3e34d9502857365e1595257cde3f620144d3d600f
3
  size 5366037748
model-00002-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:655ebf2689d01f98e2a6cf57df9008c3cdd1760b1591af04dbcc44a00e348d6a
3
  size 5253675996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:828b025774c6797ab478fb7cb2154ad2148fff1ba527fc8c9456cb91ccc3ef51
3
  size 5253675996
model-00003-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec6e39f1633c532a0e9def452c259917cdfbeaadc5742be5164d4d4d6b8725b1
3
  size 5333976637
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3a03bafa972d157b3221aef2993fb50ddd600aca425af977a72c3e71810458b
3
  size 5333976637
model-00004-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d0185bce06229d4b141d62f08570d2ccf1ff8e4816b9eaee124b1adadb8371a
3
  size 5334058518
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87cd17127e9fbf3ab66a1ae5f3845e110db0ebea404452e5b362f9edd07abad
3
  size 5334058518
model-00005-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c8872a3f6f272a6cc970273f8ec690a45316d8f22a16cf87c5702c6acb507561
3
  size 5253676013
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd1cd1f3cc01068100a6b1242775bed23171475ea95c2aa60c9cc4aa4d0245b0
3
  size 5253676013
model-00006-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02258a5e24a97aa4f7a4e134f19627456f6e0cc857ee2241fa38ea54a89caf86
3
  size 5333976679
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a84fd497cce8df36b1212f2a389be57f405f0b40951d9b7b43bba852dc970a5f
3
  size 5333976679
model-00007-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7994b580cfbeab2eb1d4398d275a7e23a0bf90ca1428e9639cd4e3abcba31bd5
3
  size 5334058518
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:671d264c953c967fd6e877e822c3a37c6ac071154eb1f5b14860c1638f478b7d
3
  size 5334058518
model-00008-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ada61dd265817735bfb1d3174978d45adbc1368ca9315b1ba20c5517d729797a
3
  size 3385731500
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e72acc0ec794fdede30b92587457e6ce961f698922eecfe49b4e1b1f96c185b
3
  size 3385731500
quant_strategy.json CHANGED
@@ -7601,4 +7601,4 @@
7601
  }
7602
  }
7603
  }
7604
- }
 
7601
  }
7602
  }
7603
  }
7604
+ }