About private test-set
Hi,
Thanks for the interesting dataset and the very stimulating challenge!
I would like to finalize the submissions on the private test, but it's a bit difficult; I think there's some confusion. First of all, I would like to ask for confirmation on:
- Do you have to use the private CSV in this dataset, right? (link: https://huggingface.co/datasets/wyzelabs/RuleRecommendation/tree/main)
- The private scores will only be revealed on November 11th, right?
I would also like to ask if it is convenient to concatenate the results obtained on the public/private test set in the submissions.
Thank you!
I think I will concatenate public and private as well !
Thanks
@VincentSchuler
!
Did you use "test_device_private.csv" and "test_rule_private.csv" for your final submissions?
Yes, they made it clear in this discussion : https://huggingface.co/spaces/competitions/wyze-rule-recommendation/discussions/5
In other words, I applied my model on "test_device.csv" + "test_rule.csv" for the public LB, and "test_device_private.csv" + "test_rule_private.csv" for the private LB.
Hi. As
@VincentSchuler
mentioned, you need to have the results for the private datasets in the submission using test_device_private.csv + test_rule_private.csv. Even if you concatenate private and public results, for the private score the code will only use the private part and you are fine. Let me know if you have any questions and thanks for your participation.
Is it normal that we can still send submissions ? Or is it officially closed ?
I think it should be closed by the end of today.