Is integer quantization of the input used?

by K2C1 - opened Jul 15, 2024

K2C1

Jul 15, 2024

Thanks for your research.

I have one question

Bitnet uses Integer 8bit Absmax Quantization for Bitlinear Input.

Does FBI-LLM also quantize the input to Integer 8bit?

Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment