Hugging Face's logo

fakezeta
/
openchat-3.5-0106-openvino-int4

Text Generation
Transformers
OpenVINO
mistral
openchat
conversational
Inference Endpoints
Model card Files Community
fakezeta commited on
Commit
19430f2
•
1 Parent(s): e5f7974

Upload 8 files

Browse files

converted with OpenVINO 2024

Files changed (3) hide show
  1. config.json +1 -1
  2. openvino_model.bin +2 -2
  3. openvino_model.xml +0 -0
config.json CHANGED
@@ -20,7 +20,7 @@
20
  "sliding_window": 4096,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "bfloat16",
23
- "transformers_version": "4.37.2",
24
  "use_cache": true,
25
  "vocab_size": 32002
26
  }
 
20
  "sliding_window": 4096,
21
  "tie_word_embeddings": false,
22
  "torch_dtype": "bfloat16",
23
+ "transformers_version": "4.38.2",
24
  "use_cache": true,
25
  "vocab_size": 32002
26
  }
openvino_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2d6f7474b985cd9227fb296af510f99cf6ed9a724728e972f2c4fe444fc958ba
3
- size 4577260488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a6a43f55d882683795adf805a336662b97b833bec3b4e4a08f2872af1b40e84
3
+ size 4577260452
openvino_model.xml CHANGED
The diff for this file is too large to render. See raw diff