Before revision:   We recommend providing oracle scores alongside the zero-shot results: still fine-tune using English  , but choose a checkpoint with the target dev set.
After revision:  These reproducibility issues are also present for other tasks with different pre-trained embeddings (e.g., MLQA with XLM-R). We recommend providing oracle scores alongside the zero-shot results: still fine-tune using English , but choose a checkpoint with the target dev set.