Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 BF16 fcf33ff verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 BF16 090b668 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 F16 61666cf verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 F16 633b230 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q8_0 c2a1740 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q6_K 1293908 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q4_0 8f8d047 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q4_K_M 797f590 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q3_K_M c54f4fb verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q3_K_S f7a0637 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q2_K b4cac29 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q5_K_M d026ec7 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16 3010772 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16 5ee9445 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 8c21d0b verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 9f10d3e verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q8_0 28ed3f4 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q6_K b321c10 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q4_0 0191dbf verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q4_K_M 9b394eb verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_M 36cda63 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_S 5f8e853 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q2_K f10030f verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q5_K_M cfaef25 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q3_K_M 037ef6b verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q4_K_M a3f90ca verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q2_K 5011535 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q4_0 08e9ed0 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q8_0 5d66eb9 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q5_K_M 8e1afb3 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q4_1 ad02117 verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q4_0 9839b2c verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q8_0 a148472 verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q5_K_M e1327cb verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q6_K 1579f58 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q3_K_M 07d717f verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q5_0 de09952 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_K_M 90b10c0 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_1 96782d0 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_0 728a067 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q8_0 39e66f6 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q5_K_M 824195f verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_1 18d5826 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_0 8f950e1 verified jartine commited on Apr 1
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q8_0 ad4453f verified jartine commited on Apr 1
Wrap mixtral-8x7b-instruct-v0.1.Q8_0.gguf with llamafile v0.6.2 ae89c80 verified jartine commited on Jan 28
Wrap mixtral-8x7b-instruct-v0.1.Q6_K.gguf with llamafile v0.6.2 c2dfafc verified jartine commited on Jan 28
Wrap mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf with llamafile v0.6.2 c73c6e5 verified jartine commited on Jan 28
jartine
commited on
