Hugging Face's logo

vilm
/
VinaLlama2-14B-GPTQ-Int4

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
qnguyen3 commited on
Commit
186194f
•
1 Parent(s): ba395e2

Upload Qwen2ForCausalLM

Browse files
Files changed (3) hide show
  1. config.json +1 -1
  2. model-00001-of-00002.safetensors +2 -2
  3. model-00002-of-00002.safetensors +2 -2
config.json CHANGED
@@ -173,7 +173,7 @@
173
  "rope_theta": 1000000.0,
174
  "sliding_window": 32768,
175
  "tie_word_embeddings": false,
176
- "torch_dtype": "bfloat16",
177
  "transformers_version": "4.40.2",
178
  "use_cache": true,
179
  "use_sliding_window": false,
 
173
  "rope_theta": 1000000.0,
174
  "sliding_window": 32768,
175
  "tie_word_embeddings": false,
176
+ "torch_dtype": "float16",
177
  "transformers_version": "4.40.2",
178
  "use_cache": true,
179
  "use_sliding_window": false,
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15e50a58b33369213bdd458e6f42ae68176232f4d56b5f1a78c097845c7b0446
3
- size 4966296864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aae4197690954c033d5b6ab91245b8e6641505aa3d883f31e6b055b20cd0685b
3
+ size 4966296824
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b0eb8d4822bffac5219034eb03e67996c11685f98590e8754f13802333d41f65
3
- size 4711150208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c20ae5569cb1ee6407dd2c566b482a58bb7ec5ac9e7ff1604ec0d4d6c6a62915
3
+ size 4711150160