Repository: Cloud-CV/EvalAI
Issue: Submission status stuck at "submitted" and no results file
Root cause: Resource Mishandling

Hi,
we recently submitted a file on the Eval AI server for the[ Argoverse 2 motion prediction challenge](https://eval.ai/web/challenges/challenge-page/1719/overview), but the submission status stuck at "submitted" and no result files for almost two days, is there anything extra that needs to be done?

<img width="1824" height="431" alt="Image" src="https://github.com/user-attachments/assets/e5af39ac-17ce-4e4a-ab22-eb2f6b8f0f01" />

Thank you so much!

We observed the same phenomenon consistently across other tasks.

<img width="1736" height="711" alt="Image" src="https://github.com/user-attachments/assets/13b98fa7-977c-437d-9b24-afff427f93c3" />

same here here other task [ScanQA](https://eval.ai/web/challenges/challenge-page/1715/)

my nuscenes detect task is also stuck at “submited”.

I tried the previously successful zip package but it is still stuck in the submitted state

> I tried the previously successful zip package but it is still stuck in the submitted state

It seems to be still in the process of being queued up for processing. Maybe it needs to wait for a while

> Hi, we recently submitted a file on the Eval AI server for the[ Argoverse 2 motion prediction challenge](https://eval.ai/web/challenges/challenge-page/1719/overview), but the submission status stuck at "submitted" and no result files for almost two days, is there anything extra that needs to be done?
> 
> <img alt="Image" width="1824" height="431" src="https://private-user-images.githubusercontent.com/100913463/474802096-e5af39ac-17ce-4e4a-ab22-eb2f6b8f0f01.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTU1OTYwNzYsIm5iZiI6MTc1NTU5NTc3NiwicGF0aCI6Ii8xMDA5MTM0NjMvNDc0ODAyMDk2LWU1YWYzOWFjLTE3Y2UtNGU0YS1hYjIyLWViMmY2YjhmMGYwMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwODE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDgxOVQwOTI5MzZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hYmE1YTQ1ODI4MzBlODg4ZGIxMzRiMmZlZjU2YmRjNDYwZWNhZDAxMmMzNDAzMTE0MGQ4NTVjMTc2NTg5NjM2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.2f0toUB5sILSoMngPhGYR8w9leSu9D2Jy-J9gkGgTEc">
> Thank you so much!

Hi, did you get your results on the Argoverse 2 motion prediction challenge? I also face the same situation on this challenge. And if you got it, how long does it usually take?

> > Hi, we recently submitted a file on the Eval AI server for the[ Argoverse 2 motion prediction challenge](https://eval.ai/web/challenges/challenge-page/1719/overview), but the submission status stuck at "submitted" and no result files for almost two days, is there anything extra that needs to be done?
> > <img alt="Image" width="1824" height="431" src="https://private-user-images.githubusercontent.com/100913463/474802096-e5af39ac-17ce-4e4a-ab22-eb2f6b8f0f01.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTU1OTYwNzYsIm5iZiI6MTc1NTU5NTc3NiwicGF0aCI6Ii8xMDA5MTM0NjMvNDc0ODAyMDk2LWU1YWYzOWFjLTE3Y2UtNGU0YS1hYjIyLWViMmY2YjhmMGYwMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwODE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDgxOVQwOTI5MzZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hYmE1YTQ1ODI4MzBlODg4ZGIxMzRiMmZlZjU2YmRjNDYwZWNhZDAxMmMzNDAzMTE0MGQ4NTVjMTc2NTg5NjM2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.2f0toUB5sILSoMngPhGYR8w9leSu9D2Jy-J9gkGgTEc">
> > Thank you so much!
> 
> Hi, did you get your results on the Argoverse 2 motion prediction challenge? I also face the same situation on this challenge. And if you got it, how long does it usually take?

Hi, before August 3rd,the results would be available just a few seconds.But after that, the status always stuck at "submitted".

> > > Hi, we recently submitted a file on the Eval AI server for the[ Argoverse 2 motion prediction challenge](https://eval.ai/web/challenges/challenge-page/1719/overview), but the submission status stuck at "submitted" and no result files for almost two days, is there anything extra that needs to be done?
> > > <img alt="Image" width="1824" height="431" src="https://private-user-images.githubusercontent.com/100913463/474802096-e5af39ac-17ce-4e4a-ab22-eb2f6b8f0f01.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTU1OTYwNzYsIm5iZiI6MTc1NTU5NTc3NiwicGF0aCI6Ii8xMDA5MTM0NjMvNDc0ODAyMDk2LWU1YWYzOWFjLTE3Y2UtNGU0YS1hYjIyLWViMmY2YjhmMGYwMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwODE5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDgxOVQwOTI5MzZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hYmE1YTQ1ODI4MzBlODg4ZGIxMzRiMmZlZjU2YmRjNDYwZWNhZDAxMmMzNDAzMTE0MGQ4NTVjMTc2NTg5NjM2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.2f0toUB5sILSoMngPhGYR8w9leSu9D2Jy-J9gkGgTEc">
> > > Thank you so much!
> > 
> > 
> > Hi, did you get your results on the Argoverse 2 motion prediction challenge? I also face the same situation on this challenge. And if you got it, how long does it usually take?
> 
> Hi, before August 3rd,the results would be available just a few seconds.But after that, the status always stuck at "submitted".

Thanks for your relpy! Seems there is no other possibility but to wait

> > I tried the previously successful zip package but it is still stuck in the submitted state
> 
> It seems to be still in the process of being queued up for processing. Maybe it needs to wait for a while

I started waiting on August 12 and resubmitted twice, but it still didn't work. I found that the latest submission date on the leaderboard of nuscenes detection is August 9th

> same here here other task [ScanQA](https://eval.ai/web/challenges/challenge-page/1715/)这里也是，其他任务 ScanQA

Hi, I encountered the same issue on ScanQA. Have you received any results for your submission? My previous submission on August 3rd was still able to be tested normally. However, I haven't received any results for the submission I made yesterday.

> > same here here other task [ScanQA](https://eval.ai/web/challenges/challenge-page/1715/)这里也是，其他任务 ScanQA
> 
> Hi, I encountered the same issue on ScanQA. Have you received any results for your submission? My previous submission on August 3rd was still able to be tested normally. However, I haven't received any results for the submission I made yesterday.

Hi, has your issue been resolved? And is ScanQA now able to conduct evaluations normally? The submission I made on August 28th has been stuck in the "Submitted" status until now. Do you happen to know the reason for this?

Same issue! We would greatly appreciate it if this issue could be resolved promptly. Thank you for your hard work and support! @gchhablani @RishabhJain2018