No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 88,164

Safetensors

Model size

11.3B params

Tensor type

I32

FP16

Text Generation

This model is incompatible with the Inference API (serverless): The model casperhansen/llama-3-70b-instruct-awq is too large to be loaded automatically (39GB > 10GB). Please use Spaces (https://huggingface.co/spaces) or Inference Endpoints (https://huggingface.co/inference-endpoints).
Please open a Discussion in the Community tab.

casperhansen
/

llama-3-70b-instruct-awq

Spaces using casperhansen/llama-3-70b-instruct-awq 2