Repository: Cloud-CV/EvalAI
Issue: Fix Error Message while validating Challenge Config
Root cause: Validation Gap

## From #4278 

I am following the instructions from https://eval.ai/web/challenge-create and https://evalai.readthedocs.io/en/latest/host_challenge.html#host-challenge-using-github to host a challenge on https://eval.ai/, but I am getting the following error during the Actions in the build step during 'Validate challenge':

Traceback (most recent call last):
  File "github/challenge_processing_script.py", line 74, in <module>
    response.raise_for_status()
  File "/opt/hostedtoolcache/Python/3.7.5/x64/lib/python3.7/site-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://eval.ai/api/challenges/challenge/challenge_host_team/3109/validate_challenge_config/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "github/challenge_processing_script.py", line 81, in <module>
    error = response.json()["error"]
KeyError: 'error'
Error: Process completed with exit code 1.


## Fix:
The EvalAI token had expired. You can check if your token is still valid in Profile -> Auth Token and if it is expired, try generating a new one with Refresh Token.

## Deliverable:
- [ ] Fix the error message to make it more informative for the user so that the user can resolve this error.



@RishabhJain2018 will work on it!

@RishabhJain2018  I want to work on this issue @chiruu12 are you working on this issue??

@SHRISHTISHUKLA-0 I have been assigned some other issue! go ahead 


@chiruu12 ok sure )

Hi maintainers,
@RishabhJain2018 @chiruu12 

I came across this issue and found it interesting. Since there are only two days left before the GSoC deadline, I’d love to contribute quickly and gain hands-on experience with the EvalAI codebase.

Could you confirm if this issue is still open for contribution? If yes, I’d be happy to submit a PR ASAP! Also, any pointers on reproducing the error would be greatly appreciated.

Looking forward to your response. Thanks in advance! 🚀

Hey @Daniyalhash , It is already assigned to @SHRISHTISHUKLA-0 . Please pick any other issue.

Hey @SHRISHTISHUKLA-0 Any updates on this?

> Hey @SHRISHTISHUKLA-0 Any updates on this?

Hi Rishabh,

I'm currently working on debugging the issue. I have analyzed the traceback and I'm checking the challenge processing script for potential errors. I'm also verifying the challenge config validation process and ensuring that all dependencies are properly set up

Hi, is this still open? or is there already a PR on this?

Hey @DaffyTheDuck , Yes, I think so. This is open for now since there is no PR in 2 weeks.

> Hey @DaffyTheDuck , Yes, I think so. This is open for now since there is no PR in 2 weeks.

Thanks I will look into this then 😄

Hey @RishabhJain2018, the deliverable in this issue expects some output like;

The authentication token has expired or is invalid. Please regenerate your token from your EvalAI profile and update it in the GitHub Actions secrets.

right? something like this?

Correct!

Hi! again, I know it might be a silly question, but I just wanted to clear my understanding of the project and it's working.

The error message comes from the file `challenge_processing_script.py` which resides in the github folder of `EvalAI-Starters` repo which is a kind of helper to the main backend repo of EvalAI, so technically this issue belongs to that repo right?

Yes, you are right. 

@RishabhJain2018 
Is this issue still open ? can i contribute here ?



Hello @RishabhJain2018 , I’m interested in tackling this issue. Is it available to pick up? Please assign it to me if it’s free; otherwise, could you point me to other good starter issues? Thank you!



i am new open source contribution , i am interested in contributing this issue if the issue is still not completed




Sir @RishabhJain2018  can you please look my pr , Fixed Error Message while validating Challenge Config #4490 #131

as , challenge_processing_script.py is part of EvalAi starters repo , so  made changes to it ? can you please look into it?

@RishabhJain2018  Is this issue still open? If yes, I would like to take it.

Hi, I’m Shashank. I’m exploring CloudCV with the intention of applying for GSoC 2026 and would like to start contributing early.
I’m interested in working on this issue if it’s available. Please let me know if I can proceed.


@SHRISHTISHUKLA-0 I see this issue is assigned to you, but there hasn't been activity for a while. Are you still working on this?


> @SHRISHTISHUKLA-0 I see this issue is assigned to you, but there hasn't been activity for a while. Are you still working on this?
> 
No


Hello @RishabhJain2018 
I’d love to work on this issue and help improve the error message for expired EvalAI tokens.

If the issue is still available, could you please assign it to me?
If not, I’d appreciate it if you could suggest other beginner-friendly issues to get started with EvalAI.

Thanks!