Llama Quantized - bnb
Collection
Contains Llama Models Quantized using bitsandbytes. • 8 items • Updated
lierseleow/Meta-Llama-3-70B-Instruct-bnb-8bit (Quantized)
This repository contains quantized weights for meta-llama/Meta-Llama-3-70B-Instruct.
License & Attribution
Built with Meta Llama 3.
This model is a derivative work of Meta's Llama 3 and is governed by the Llama 3 Community License Agreement.
- Official License: Llama 3 Community License
- Acceptable Use Policy: Meta Llama Acceptable Use Policy
By downloading, copying, or using these quantized weights, you agree to compliance with the terms, conditions, and restrictions outlined in the official license.
Quantization Details
- Quantization Method: bitsandbytes
- Bits/Precision: 8bit
- Base Model: meta-llama/Meta-Llama-3-70B-Instruct
Dependencies Details
- transformers version: 5.14.1
- bitsandbytes version: 0.50.0
- Downloads last month
- 11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for lierseleow/Meta-Llama-3-70B-Instruct-bnb-8bit
Base model
meta-llama/Meta-Llama-3-70B Finetuned
meta-llama/Meta-Llama-3-70B-Instruct