YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
        # TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged-q8_0-gguf
        
        This is a GGUF quantized version (Q8_0) of the original model TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged.
        
        ## Quantization Details
        - Original Model: TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged
        - Quantization Type: Q8_0
        - File Format: GGUF
        
Downloads last month
34
GGUF
Model size
3.21B params
Architecture
llama

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.