multilingual-e5-large-instruct finetuned on PLOTS

intfloat/multilingual-e5-large-instruct finetuned on PLOTS, pairs of independently written Wikipedia plot summaries of the same film (English plot paired with its plot in another language), to match stories rather than words or names.

Training

197,694 training pairs; symmetric in-batch contrastive loss (InfoNCE in both directions) with gradient caching, batch 128, 1 epoch, learning rate 2e-05, maximum input length 512 tokens, seed 13. Films of SemEval-2026 Task 4 and TREC ToT 2023 (train and dev targets) are excluded from training.

Results

NS: accuracy on the 355 leak-free SemEval-2026 Task 4 track-B test triples. PLOTS-IR: nDCG@10 on the test queries (M: entity-masked). ToT: TREC ToT 2023 dev queries.

	NS acc.	Full	Full M	First	Last	Last M	ToT nDCG@10	ToT R@100
this model	0.654	0.994	0.905	0.842	0.448	0.121	0.204	0.507
multilingual-e5-large-instruct, zero-shot	0.696	0.875	0.610	0.615	0.231	0.067	0.047	0.213

Usage

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Jgmorenof/plots-multilingual-e5-large-instruct", trust_remote_code=True)
queries = ["<plot summary or description of a film, in any language>"]
documents = ["<English plot summary>"]
q = model.encode(queries, prompt="Instruct: Given a story summary, retrieve the plot summary of the same film\nQuery: ")
D = model.encode(documents, prompt="")
scores = model.similarity(q, D)

For tip-of-the-tongue requests we used the query prompt "Instruct: Given a description of a movie someone half-remembers, retrieve the movie's Wikipedia page\nQuery: "; for symmetric story-to-story similarity (SemEval) "Instruct: Retrieve semantically similar text\nQuery: " on both sides.

License

The weights keep the license of the base model (mit). The training data (PLOTS) is CC BY-SA 4.0.

Citation

@misc{moreno2026plots,
  title        = {{PLOTS} -- Same Story, Different Words: Paired Plot Outlines for Narrative Similarity and Retrieval},
  author       = {Moreno, Jose G. and Hamdi, Ahmed and Boros, Emanuela and Jatowt, Adam and Bordea, Georgeta and Gonz{\'a}lez-Gallardo, Carlos-Emiliano and Doucet, Antoine},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/datasets/Jgmorenof/PLOTS}}
}