Adding Q4_0, Q4_1, Q4_K_M, Q4_K_S, Q5_0, Q_1 quantization

Adding Q2_K, Q3_K_L, Q3_K_M, Q3_K_S quantization

Update README.md

Create README.md

initial commit