Hugging Face's logo

ISTA-DASLab
/
Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
aqlm
Model card Files Community
SpiridonSunRotator commited on
Commit
c5c2ca6
•
1 Parent(s): 00d2f33

Uploaded improved version of quantized model

Browse files
Files changed (6) hide show
  1. config.json +1 -1
  2. model-00001-of-00005.safetensors +1 -1
  3. model-00002-of-00005.safetensors +1 -1
  4. model-00003-of-00005.safetensors +1 -1
  5. model-00004-of-00005.safetensors +1 -1
  6. model-00005-of-00005.safetensors +1 -1
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "/slot/sandbox/j/_tmp/data4z_83ne6",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
 
1
  {
2
+ "_name_or_path": "/slot/sandbox/j/_tmp/data4v0q57a2",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
model-00001-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f657801f06458e8741bd9f0aa2ceba83d7d265de1bc9bdd7877cc15a4b9b1d15
3
  size 4999125768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c29074efcaba33a6fd7f6645e9c45e5d657fe799bef2836e11f368529a2edad
3
  size 4999125768
model-00002-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e2c44098f602ca52d6d4e6a0ab555bc258b78a6beed5b157c21033245834019
3
  size 4955928968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4d97e9b7b03b5293f83aec455a501458a58a96123903f5b3c2be38d332a25e6
3
  size 4955928968
model-00003-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:737c62dbfa706250e7ff37238d29ea08708d954b30e849b0e45d3ce2d4434974
3
  size 4991608736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:270208116fba996d650e3609aa300ee8f0a5706666936af19525b5fe61a7274f
3
  size 4991608736
model-00004-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec67620666a87e8b98d9fce594044d454d36b76853431df02d8c5b00d3d47763
3
  size 4870931440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:323bb37059d3db903d4a9e31c0220ece65615ea457dfca424623258f36708bb6
3
  size 4870931440
model-00005-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:71bf669ada633128d96c63794744e592f01f8c08b8ad5aca8b25941451f7ca39
3
  size 2101346432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f655b7c59ec75af854e9c3b6201851233f9a32040ec1bffb59f8eef91c7cb58
3
  size 2101346432