Failed Submission
We are getting a public score of -1 & status as failed for our submission. The format of submission is similar to the sample submission here.
As the model predicts multiple small areas of burned predictions, rle_mask & index are comparatively large & the submission file is around ~117MB. Is there a limit to the file size or number of burned polygons in a chip?
Sharing the head of submission.csv for your reference:
id,rle_mask,index
0ff249de-784d-4760-a039-ed9f92eca60c_0,205,0
0ff249de-784d-4760-a039-ed9f92eca60c_0,58,1
0ff249de-784d-4760-a039-ed9f92eca60c_0,102,2
0ff249de-784d-4760-a039-ed9f92eca60c_0,44,3
0ff249de-784d-4760-a039-ed9f92eca60c_0,303,4
0ff249de-784d-4760-a039-ed9f92eca60c_0,1,5
0ff249de-784d-4760-a039-ed9f92eca60c_0,3,6
0ff249de-784d-4760-a039-ed9f92eca60c_0,8,7
0ff249de-784d-4760-a039-ed9f92eca60c_0,3,8
0ff249de-784d-4760-a039-ed9f92eca60c_0,48,9
Thanks in advance for the help!
I have checked one of your submissions from two days ago:
The problem is that many predictions do not have the correct size. Each image is 512x512, so the flattened array must have a length of 262144.
For example, one of your predictions returns an array of size 2097152.
Thanks
@DarthReca
I have pushed a fix & made new submission with id: d3c2a344-c37d-4289-afa3-ef43d1eb84c9 - the status is in a pending state & I am getting a score of -1. Although I am able to reconstruct the predicted masks from rle_mask column of the submission file.
Your submission is now marked as done, so it was correct. The system has taken only some time to process the file.
awesome, Thanks!
@DarthReca I made another submission yesterday & it is still in a pending state - I think it takes a day or two to process a submission, can that be sped up?
it doesnt take more than a couple of minutes normally. when there is some queue, it might take longer. is your submission done now?
Yes, it is done now - but my previous two submissions took around a days time :-)