This is a 800M parameters model pre-trained with QuEST over 80B C4 tokens in INT4 format (W4A4).

The code to verify that this model works in INT4 can be found here.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train ISTA-DASLab/QuEST-800M-INT4

Collection including ISTA-DASLab/QuEST-800M-INT4