Quantize Test Repo Orignal Model: mlabonne/NeuralBeagle14-7B
Note: This is an Experiment and not Tested
4-bit
5-bit