Q: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
The graphs in figure 1 show the distances between duplicate and non-duplicate questions using different embedding systems. Large achieved a F1 score of 0.71 for this task without any specific training, simply by choosing a threshold below which all sentence pairs are considered duplicates. In order to test whether these results generalised to our domain, we devised a test that would make use of what little data we had to evaluate.
Question: How is the accuracy of the system measured?
A:
F1 score of 0.71 for this task without any specific training, simply by choosing a threshold below which all sentence pairs are considered duplicates distances between duplicate and non-duplicate questions using different embedding systems