Lamma2 4 bit Quantize model for chatbot.