Repository: Cloud-CV/EvalAI
Issue: error while executing evaluation script
Root cause: Environment Incompatibility

#2200 
I still  couldn't have a result after the submission.In fact I tried to restart the python worker But I still have the same error. Could any one help me please ?

@nadzma Did you approve the challenge first before restarting the worker. Here is the documentation: https://evalai.readthedocs.io/en/latest/approve_challenge.html

@RishabhJain2018  Yes I followed all the steps in the official documentation but when I approve the challenge and restart the submission worker I have this error on the terminal : 
worker_1  | ModuleNotFoundError: No module named 'challenge_data.challenge_2'
evalaibis_worker_1 exited with code 1

docker-compose restart worker 
/Library/Python/2.7/site-packages/requests/__init__.py:80: RequestsDependencyWarning: urllib3 (1.23) or chardet (3.0.4) doesn't match a supported version!
  RequestsDependencyWarning)
Restarting evalai_worker_1 ... donee

@RishabhJain2018  PS : I managed to fix the problem But every time I approve a new challenge and before restarting the worker I should execute  : 

sudo pip uninstall requests
sudo pip install requests
sudo pip uninstall docopt
sudo pip install docopt

Could you help me to solve the problem definitely ?

hey, @nadzma Don't worry, we'll be able to fix it. Which challenge config are you using? The one given in EvalAI-Starters or something custom.

Hey @RishabhJain2018  I am using the one given in EvalAI-Starters and I am facing several problems each time I would like to restart the worker

I'm not sure what errors are you getting. Can you please post the screenshot here?

Hey @RishabhJain2018    So after approving the challenge and restarting the worker I get this errors. @RishabhJain2018  could you please help me since I am blocked
<img width="1369" alt="Capture d’écran 2019-03-22 à 14 53 31" src="https://user-images.githubusercontent.com/33626402/54828368-54150a00-4cb4-11e9-86a4-6d8f0dfecbbf.png">



this piece of code in the submission worker is generating the error 

     try:
        # import the challenge after everything is finished
        challenge_module=importlib.import_module(CHALLENGE_IMPORT_STRING.format(challenge_id=challenge.id))
        EVALUATION_SCRIPTS[challenge.id] = challenge_module
    except:
        logger.exception('Exception raised while creating Python module for challenge_id: %s' % (challenge.id))
        raise



@nadzma its ok for evalai_worker_1 to fail like that. Just go to: `localhost:8888` and check if the EvalAI website is rendered. 

If you want to make worker running(which is needed when submitting challenge entries). Go to another terminal and run the command: `docker-compose restart`. To get your submissions to be shown in leaderboard, submit evaluation_script.zip when worker is still up. This usually works for me and helped in solving #2097 

@kurianbenoy  Thank you for your answer. Unfortunately I couldn't solve the problem
I did like this
1)Run the EvalAI dev setup using docker-compose up in the EvalAI folder where docker-compose.yml is present.
2)Check if all the 5 containers are running using docker ps
3)Create a challenge by logging in using host account using the EvalAI-Starters repository.
4)Approve the challenge using Django Admin on http://127.0.0.1:8000/admin
5)Restart the worker container using docker-compose restart worker
6)Go to another terminal and run the command: docker-compose restart
7)Create a submission by logging in using participant account and it should be evaluated successfully

But I still have the same error and the submission worker doesn't work. So I have the status of the submission : submitted and not finished. could you help me through your experience with this issue.

Please ensure you pull from upstream and run command `docker compose up --build` before running.

As your challenge is already approved, go to this page:
![image](https://user-images.githubusercontent.com/24592806/55331288-973f5c00-54b0-11e9-9e6b-8a43cf2a3807.png)

Then upload evaluation_script.zip as submission:
![Screenshot-2019-4-1 EvalAI Evaluating state of the art in AI](https://user-images.githubusercontent.com/24592806/55331483-fe5d1080-54b0-11e9-8ca2-1e9f85d29bef.png)

![Screenshot_20190401_190938](https://user-images.githubusercontent.com/24592806/55331872-d4f0b480-54b1-11e9-9077-5e15f5135068.png)


Before submitting, go to terminal and run 

> docker ps

Ensure that evalai_worker is running. Incase its not working and showing a evalai_worker exit code. Go ahead and run:

> docker-compose restart worker

Then upload submission and ensure _evalai_worker has not Exited during this time_. Then go to submission tab and click option for show entry in leaderboard. Now go ahead and look leaderboard for test_phase.

If you are still facing any issues, just comment here




@kurianbenoy  I've followed all the steps . when I submit I get an other error on the terminal and the status is submitted and not finished.   ERROR Exception while receiving message from submission queue with error 'NoneType' object has no attribute 'get
<img width="1334" alt="Capture d’écran 2019-04-02 à 11 55 23" src="https://user-images.githubusercontent.com/33626402/55393944-7d4c5a80-553e-11e9-90b0-24646ebd5e81.png">


@RishabhJain2018 now the submission worker abruptly stops in development environment. Also why is there two workers: remote_worker and evalai_worker?


@kurianbenoy   Do you have this error while submitting a solution ?

I think that the 2 workers have to do with the fact that the host should be able to evaluate the submission on a remote server of their own if they choose so (this will be different from the EC2 container of the submission worker on the same instance as of the other containers). It's a new feature I think.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This is resolved, closing it.