AIFunOver
/

Llama-3.1-70B-Instruct-openvino-4bit

Text Generation

4-bit precision

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-70B-Instruct-openvino-4bit

1 contributor

History: 15 commits

AIFunOver's picture

Upload README.md with huggingface_hub

127ff3e verified 13 days ago

.gitattributes

1.52 kB

initial commit 13 days ago
README.md

14.6 kB

Upload README.md with huggingface_hub 13 days ago
config.json

930 Bytes

Upload config.json with huggingface_hub 13 days ago
generation_config.json

184 Bytes

Upload generation_config.json with huggingface_hub 13 days ago
model.safetensors.index.json

59.6 kB

Upload model.safetensors.index.json with huggingface_hub 13 days ago
openvino_config.json

581 Bytes

Upload openvino_config.json with huggingface_hub 13 days ago
openvino_detokenizer.bin

1.35 MB
LFS

Upload openvino_detokenizer.bin with huggingface_hub 13 days ago
openvino_detokenizer.xml

14.3 kB

Upload openvino_detokenizer.xml with huggingface_hub 13 days ago
openvino_model.bin

37.7 GB
LFS

Upload openvino_model.bin with huggingface_hub 13 days ago
openvino_model.xml

6.9 MB

Upload openvino_model.xml with huggingface_hub 13 days ago
openvino_tokenizer.bin

5.64 MB
LFS

Upload openvino_tokenizer.bin with huggingface_hub 13 days ago
openvino_tokenizer.xml

28.6 kB

Upload openvino_tokenizer.xml with huggingface_hub 13 days ago
special_tokens_map.json

296 Bytes

Upload special_tokens_map.json with huggingface_hub 13 days ago
tokenizer.json

9.09 MB

Upload tokenizer.json with huggingface_hub 13 days ago
tokenizer_config.json

55.4 kB

Upload tokenizer_config.json with huggingface_hub 13 days ago