bhasha-embed-v0 (int8 OpenVINO)

Fork of AkshitaS/bhasha-embed-v0 (Apache 2.0, developed by Akshita Sukhlecha), with a pre-converted int8-quantized OpenVINO artifact added for faster inference.

Usage

from sentence_transformers import SentenceTransformer

model = SentenceTransformer(
    "ts-goonj/bhasha-embed-v0",
    revision="<pin-a-commit-sha>",
    backend="openvino",
    model_kwargs={"file_name": "openvino_model_qint8_quantized.xml"},
)

Downloads last month: -

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support