llmixer
/

BigWeave-v9-90b-4.0bpw-h8-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

BigWeave-v9-90b-4.0bpw-h8-exl2 / README.md

llmixer's picture

Create README.md

e0bf4b6 verified 5 months ago

|

raw history blame contribute delete

No virus

297 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 4.0bpw
  - h8
  - exl2

Exllamav2 4.0bpw h8 quant for BigWeave-v9-90b.

Calibration dataset: llmixer/20k_random_data