Repository: Cloud-CV/EvalAI
Issue: Export challenge data in different formats.
Root cause: Unimplemented Feature Gap

**Description:** Currently EvalAI supports exporting the submissions using csv only, but we want to extend this support to `json`, `xlsx`, `xls`, `yaml`, `html` .

I want to work on this issue.

sure! go ahead.

@RishabhJain2018 @deshraj If this hasn't been implemented yet, I would like to work on it 

No, it isn't. You can work on it.

@RishabhJain2018  While approving a challenge, reload won't work since docker-compose doesn't have any reload command. I tried restart with evalai_worker_1 (the name that was alloted by me to the container) but after restarting the worker, it won't display the new challenge

I am finished with the json part. Is this the output desired ? @RishabhJain2018 
![screenshot_20181206_030109](https://user-images.githubusercontent.com/19976688/49545368-689ae580-f903-11e8-8f75-e7034f3af45e.png)


@RishabhJain2018 @deshraj  HTML is done as well. Please confirm if everything's okay . 
Also, do I also need to inject/apply styling to the html as well or base is okay ?
![screenshot_20181207_011718](https://user-images.githubusercontent.com/19976688/49608124-e3c0d200-f9bd-11e8-87cf-e7628a4a4280.png)


Hi @yashdusing 
> While approving a challenge, reload won't work since docker-compose doesn't have any reload command. I tried restart with evalai_worker_1 (the name that was alloted by me to the container) but after restarting the worker, it won't display the new challenge

I didn't get this point very clearly here. What do you want to ask? if you are looking for approving a challenge and reloading a submission worker then are the docs https://evalai.readthedocs.io/en/latest/approve_challenge.html

> I am finished with the json part. Is this the output desired ?

How are outputs structured? Ascending order or descending order. Also, What does 0, 1 signify there?

> HTML is done as well. Please confirm if everything's okay .
Also, do I also need to inject/apply styling to the html as well or base is okay ?

Can you please briefly tell why do we need this HTML file. Am I missing some context here?



1. I followed the given link for approving. In the second step it has an instruction ‘docker-compose reload worker’.  This command doesn’t work (I searched for reload for docker-compose on google and couldn’t find any such commands)
(Edit : I tried ‘restart’ instead because that’s the only other instruction I found which seems similar but it won’t work as well)
2. They are structured according to their index which starts from 0. The ‘0’, ‘1’ signify the indices of the submissions table.
3. The task is to code the support for exporting in html, json, xlsx, xls, yaml formats. The outputs I’ve posted are the results of the formats which I’ve currently coded (i.e. html and json)

>I followed the given link for approving. In the second step it has an instruction ‘docker-compose reload worker’. This command doesn’t work (I searched for reload for docker-compose on google and couldn’t find any such commands)
(Edit : I tried ‘restart’ instead because that’s the only other instruction I found which seems similar but it won’t work as well)

Thanks for pointing it out. Since we have removed the container name from docker compose file, that's why it didn't work. I will update the documentation for it. for now you can use:
1. `docker ps` : It will list all the running containers
2. Copy the cointainer ID of worker container.
3. Run `docker stop <container_id>`
4. Run `docker start <container_id>`

> They are structured according to their index which starts from 0. The ‘0’, ‘1’ signify the indices of the submissions table.

Just to confirm, you meant how they are structured under My Submissions table. If that is a case then can we please start from `1`. `O` looks confusing on user's end.

> The task is to code the support for exporting in HTML, JSON, xlsx, xls, yaml formats. The outputs I’ve posted are the results of the formats which I’ve currently coded (i.e. HTML and JSON)

I see. I think having HTML as output downloadable file won't be of greater use since most people will prefer JSON or CSV over it. What are your views?



1. Thanks, I will try these commands
2. Yes, they’re from the my submissions table. I’ll update the logic for ‘1’ based indexing
3. I’m not really sure about that. Having a file offline could help but that doesn’t make much sense. Anyways, could you also tell me finally what all extensions we actually need 

@RishabhJain2018 could you tell me about the extensions needed ? Do we need xlsx, xls, yaml or not ? 

Hey, I missed this one. yeah, all others we will definitely need.
Also, were you able to restart your worker container?

@RishabhJain2018 For yaml, is this correct ?
P.S: For YAML parsing, javascript needs another extension, so instead I parsed the yaml entirely on the python end and passed the entire string to javascript end. Is that okay ?
![screenshot_20181210_201702](https://user-images.githubusercontent.com/19976688/49739746-a065ac80-fcb8-11e8-9440-080bd0d53b3f.png)


@RishabhJain2018 I was able to reload the worker fine and all approved were shown in the browser. But I can't submit any submissions, the phase button is frozen.
(Edit : I changed final submission data to 2020 and that is not reflected and I've used the test_submissions.zip from the examples folder)
![screenshot-0 0 0 0-8888-2018 12 10-20-28-30](https://user-images.githubusercontent.com/19976688/49740822-10753200-fcbb-11e8-904d-f57b2482336f.png)


@RishabhJain2018 I added xlsxwriter to common.txt but I got this error
![screenshot_20181212_015013](https://user-images.githubusercontent.com/19976688/49827867-5e1f9680-fdb0-11e8-9795-0fb447d56f80.png)


[all_submissions.xlsx](https://github.com/Cloud-CV/EvalAI/files/2671405/all_submissions.xlsx)
Done with excel file. Please check the format

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.


@rishabhjain2018 most of the PRs I made are now marked as stale but they were up for review. What do I do now?

Hi @yashdusing, Don't worry about it. I'll surely get to this and the other PR's in early July. Thanks for your patience.