Bheri/ithasa-e5-large-en-sa

English–Sanskrit multilingual E5-large with Mitrasamgraha

SentenceTransformer fine-tuned from intfloat/multilingual-e5-large on cleaned English–Sanskrit parallel text, including all retained Mitrasamgraha training pairs. This run starts from the listed pretrained base encoder.

• Embedding dimension: 1024
• Maximum input length: 512 tokens
• Pooling: mean pooling
• Similarity: cosine
• Training objective: CachedMultipleNegativesRankingLoss with duplicate-free batches

Usage

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Bheri/ithasa-e5-large-en-sa")
sentences = ["The teacher speaks.", "गुरुः वदति।"]
embeddings = model.encode(sentences, normalize_embeddings=True)
print(embeddings @ embeddings.T)

The model uses a symmetric query: prefix by default for both English and Sanskrit inputs.

Training data

609,187 training pairs. Source files were normalized, checked for structural and script problems, deduplicated, and separated from validation and test by normalized sentence identity. Mitrasamgraha uses the original source split assignments. Unfiltered NLLB was excluded.

Source	Training pairs
Mitrasamgraha	376,925
Translation data	120,557
BPCC	94,441
Sanskrit Llama	17,264

Script and length filtering do not certify the semantic correctness of every translation. One representative per sentence side was retained for contrastive training. Raw source datasets were preserved locally.

Validation results

Validation contains 2,000 pairs: 500 per source. Each source is evaluated separately with a 500-candidate translation pool, in both English-to-Sanskrit and Sanskrit-to-English directions. Values below average the two directions.

Source	Mean bidirectional accuracy
BPCC	0.9990
Sanskrit Llama	0.7750
Translation data	0.9780
Mitrasamgraha	0.9600
Macro average	0.92800

These are validation results used for checkpoint selection, not held-out test results or general semantic-search benchmark scores.

Held-out test results

Evaluated on 2,000 separate test pairs, 500 per source, using a separate 500-candidate pool per source and both translation-retrieval directions. These records were excluded from training and checkpoint selection.

Source	Mean bidirectional accuracy
BPCC	0.9980
Sanskrit Llama	0.7500
Translation data	0.9770
Mitrasamgraha	0.9590
Macro average	0.92100

Evaluation identifier: 20261029T182019472923Z. The macro test accuracy is 92.100%. These are translation-retrieval results, not a general semantic-search or NER benchmark.

Training configuration

• Learning rate: 5e-06
• Maximum epoch budget: 3; early stopping enabled
• Contrastive batch size: 128
• Cached forward mini-batch size: 4
• Seed: 42
• Selected checkpoint: step 8,000; run stopped at step 8,750 (epoch 1.838).
• Run identifier: 20261025T123448536017Z

The validation gate compares against the starting base model. Passing it does not establish superiority over the trained control. Assess the per-source results and your actual retrieval queries when selecting a deployment model.