Adds the first quantization, type:2 q4_0

Begins with pickled h5 converted to GGML f16, doing this in pieces this time so it doesn't take 8 hours to upload

initial commit