Llama Quantized - bnb
Collection
Contains Llama Models Quantized using bitsandbytes. • 8 items • Updated
lierseleow/Llama-3.1-70B-Instruct-bnb-8bit (Quantized)
This repository contains quantized weights for meta-llama/Llama-3.1-70B-Instruct.
License & Attribution
Built with Meta Llama 3.1.
This model is a derivative work of Meta's Llama 3.1 and is governed by the Llama 3.1 Community License Agreement.
- Official License: Llama 3.1 Community License
- Acceptable Use Policy: Meta Llama Acceptable Use Policy
By downloading, copying, or using these quantized weights, you agree to compliance with the terms, conditions, and restrictions outlined in the official license.
Quantization Details
- Quantization Method: bitsandbytes
- Bits/Precision: 8bit
- Base Model: meta-llama/Llama-3.1-70B-Instruct
Dependencies Details
- transformers version: 5.14.1
- bitsandbytes version: 0.50.0
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for lierseleow/Llama-3.1-70B-Instruct-bnb-8bit
Base model
meta-llama/Llama-3.1-70B Finetuned
meta-llama/Llama-3.1-70B-Instruct