ZeroWw
/

Test

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Test

1 contributor

History: 6 commits

ZeroWw's picture

Upload Mistral-7B-Instruct-v0.3.f16.q5.gguf with huggingface_hub

8376d1c verified 7 months ago

.gitattributes

1.81 kB

Upload Mistral-7B-Instruct-v0.3.f16.q5.gguf with huggingface_hub 7 months ago
Mistral-7B-Instruct-v0.3.f16.gguf

14.5 GB
LFS

Upload Mistral-7B-Instruct-v0.3.f16.gguf with huggingface_hub 7 months ago
Mistral-7B-Instruct-v0.3.f16.q4.gguf

4.27 GB
LFS

Upload Mistral-7B-Instruct-v0.3.f16.q4.gguf with huggingface_hub 7 months ago
Mistral-7B-Instruct-v0.3.f16.q4.q3.gguf

4.53 GB
LFS

Upload Mistral-7B-Instruct-v0.3.f16.q4.q3.gguf with huggingface_hub 7 months ago
Mistral-7B-Instruct-v0.3.f16.q5.gguf

5.47 GB
LFS

Upload Mistral-7B-Instruct-v0.3.f16.q5.gguf with huggingface_hub 7 months ago
README.md

24 Bytes

initial commit 7 months ago
config.json

1.13 kB

Upload folder using huggingface_hub 7 months ago
generation_config.json

111 Bytes

Upload folder using huggingface_hub 7 months ago
model-00001-of-00002.safetensors

4.95 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00002-of-00002.safetensors

2.57 GB
LFS

Upload folder using huggingface_hub 7 months ago
model.safetensors.index.json

61.2 kB

Upload folder using huggingface_hub 7 months ago
special_tokens_map.json

414 Bytes

Upload folder using huggingface_hub 7 months ago
tokenizer.json

1.96 MB

Upload folder using huggingface_hub 7 months ago
tokenizer.model

587 kB
LFS

Upload folder using huggingface_hub 7 months ago
tokenizer_config.json

137 kB

Upload folder using huggingface_hub 7 months ago