waldie
/

Yi-34B-200K-DARE-merge-v5-4.65bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

quant of brucethemoose's Yi-34B-200K-DARE-merge-v5

fits into 24gb with 16k context on windows

pippa_cleaned used for calibration, with 8192 token length

Downloads last month: 1