notes
experimental NVFP4A16 (confirmed forking with vLLM)
Please report if you find any issue with the model.
Any feedbacks are welcome!
'Make knowledge free for everyone'
Quantized version of: meta-llama/Meta-Llama-3-8B-Instruct
- Downloads last month
- 1
Model tree for DevQuasar/meta-llama.Meta-Llama-3-8B-Instruct-NVFP4A16
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct