Quantized ONNX (CPU) pplx-embed-v2-late 0.6B and 9B: one token space, so index with the 9B and query with the 0.6B.
Nynefold
community
AI & ML interests
Datasets, quantization, model compression, open-source tools...
Datasets, quantization, model compression, open-source tools...