mudler
/

Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

1 contributor

History: 4 commits

mudler's picture

Create README.md

90763ab verified about 1 month ago

.gitattributes

1.52 kB

initial commit about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q2_k.bin
3.18 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_l.bin
4.32 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_m.bin
4.02 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_s.bin
3.67 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_0.bin
4.66 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_m.bin
4.92 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_s.bin
4.69 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_0.bin
5.6 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_m.bin
5.73 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_s.bin
5.6 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q6_k.bin
6.6 GB
LFS

Upload folder using huggingface_hub about 1 month ago
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q8_0.bin
8.54 GB
LFS

Upload folder using huggingface_hub about 1 month ago
README.md

1.01 kB

Create README.md about 1 month ago
localai.yaml

1.58 kB

Create localai.yaml about 1 month ago