CodeRoasted
/

sift-explain-model

Model card Files Files and versions

Phi-3.5-mini-instruct — Q4_K_M GGUF (CodeRoast redistribution)

GGUF quantization of microsoft/Phi-3.5-mini-instruct (© Microsoft, MIT), used by the CodeRoast Sift --explain local-narrative feature.

Modification (MIT): quantized to GGUF Q4_K_M (no importance matrix) by CodeRoast from microsoft/Phi-3.5-mini-instruct @ 2fe192450127e6a83f7441aef6e3ca586c338b77 using llama.cpp b9672. Reproducible: insight-eidos/scripts/quantize_phi35.sh.

File: phi-3.5-mini-instruct-Q4_K_M.gguf
SHA-256: c5347cbd620330a7c051c3d2fcad156b2c606340682f3d09c92df5bcfb9deaba
License: MIT (the upstream LICENSE + NOTICE.md are included in this repo, unmodified).

Downloads last month: 8

GGUF

Model size

4B params

Architecture

phi3

Hardware compatibility

Log In to add your hardware

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for CodeRoasted/sift-explain-model

Base model

microsoft/Phi-3.5-mini-instruct

Quantized

(194)

this model