Is integer quantization of the input used?

by K2C1 - opened Jul 15

K2C1

Jul 15

Thanks for your research.

I have one question

Bitnet uses Integer 8bit Absmax Quantization for Bitlinear Input.

Does FBI-LLM also quantize the input to Integer 8bit?

Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment