Question about hard negative sample synthesis
#4
by majfu - opened
Hello!
Thank you for your work and the technical report. The report is very detailed, but while reading it, a few questions came to me about the hard negatives generation process. Since the report is so thorough, I was hoping you might be willing to answer these as well:
- Could you share what model was used for the data generation?
- The text mentions that for hard negative mining "top-10 to top-30 ranked results were selected". Does this mean that the top 10 samples were discarded? Or does it mean a range of top 10 to 30 samples was chosen - if so, what determines the number of chosen samples? And is a positive-aware negative mining strategy involved?
- It is stated that 4 hard negative samples are used in training - are they sampled from the bigger pool of negatives obtained from mining or was there additional ranking applied before selecting the final 4?
- The paper also says that you "filter out samples with low query-pos scores" - what is the threshold?
Any brief insights would be very helpful for understanding the pipeline.
Thank you! 😄