File size: 274 Bytes
18fb5e2 cca428a 18fb5e2 cca428a 18fb5e2 cca428a |
1 2 3 4 5 6 7 8 9 10 11 |
---
library_name: transformers
tags: []
---
# Model Card for dolphin-2.9.1-llama-3-70b-<u>awq</u>
AWQ Quantized version of [cognitivecomputations/dolphin-2.9.1-llama-3-70b](/cognitivecomputations/dolphin-2.9.1-llama-3-70b).
For use with vllm and other inference engines. |