Is integer quantization of the input used?

#1
by K2C1 - opened

Thanks for your research.

I have one question

Bitnet uses Integer 8bit Absmax Quantization for Bitlinear Input.

Does FBI-LLM also quantize the input to Integer 8bit?

Thanks

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment