zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: KeyError: 'evaluation_details'
Root cause: Validation Gap

https://sentry.io/cloudcv/evalai/issues/680906137/

```
KeyError: 'evaluation_details'
  File "challenges/views.py", line 672, in create_challenge_using_zip_file
    yaml_file_data['evaluation_details']

There is no key for evalutaion details. Please add it and then try again!
```

ill solve this one


@darthgera123 Any update on this?

sorry, completely forgot about this. Will make a pr within a day or 2

Can I work on this issue if no one is working ! @darthgera123 

I think @darthgera123 is working on it. Please feel free to take another issue. :) 

@deshraj  can you give me access to sentry so i can completely figure out the issue. Thanks

@deshraj  can you please share the sentry access so that i can recreate the issue

@darthgera123 sorry I cannot give the sentry access since it's only accessible to maintainers. Also, there is no need to see sentry for the error. The error is posted in the issue description. Please see that for more information. 

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Load challenge data in the process when challenge is created
Root cause: Unimplemented Feature Gap

## Description

Currently, when someone creates a challenge on EvalAI, then gets the access to make submissions to that challenge in order to test it. But the catch here is that the submission worker is not ready to accept the submissions for that challenge since it needs to load the evaluation script and other required files. Hence whatever submission the challenge host does, it stays in the submitted state.

## How to fix it

- [ ] Add support for loading the required challenge related files whenever the challenge is created making sure that submission worker is reloaded or is loading the required files in memory

Hey i'll try to work on this issue. 

@deshraj @w3x10e8 I have fixed the issue. Can I submit my PR ?

@TejasBhitle hey sure you can submit your PR, Im working on other issue rn

Can I take up this issue ?

Sure @shiv6146, you can work on this.

@RishabhJain2018 Please have a look at #2205 I have made changes to submission_worker which did not have any unit tests previously and hence I think my coverage has reduced :disappointed: Any workarounds to actually fix this?

@shiv6146 This may help for now, until tests for the submission worker are written. Please have a look: https://coverage.readthedocs.io/en/coverage-4.3.4/excluding.html

What's the status of PR #2205?

I was not aware of the existing PR, and I created a simpler PR (2 line change plus comments) which addresses the issue: #3422.

Closing this since it is a very old issue.
Repository: Cloud-CV/EvalAI
Issue: Host Challenge link on Home Page not working
GitHub labels: bug

easy_to_fix

frontend

good first issue

-  the observed behaviour
`Host Challenge` is having href `unsafe:javascript:void(0)` and giving `The address wasn’t understood` after clicked
![screenshot from 2018-09-17 02-27-08](https://user-images.githubusercontent.com/3920286/45600858-61112200-ba21-11e8-9f9b-2de353fbde27.png)
- which operating system and/or browser you're using, if relevant
Ubuntu 18.04 LTS
Firefox 62.0 (64-bit)


@vkartik97 thanks for reporting this. I can also reproduce this error on Firefox. If you are interested in fixing this issue, please let me know. 

I'll fix this if @vkartik97 wants to work on some other issue 

@w3x10e8  
You can work on this.

The same issue is observable on Safari on macOS as well.
Repository: Cloud-CV/EvalAI
Issue: Make code into PEP8 format

As per EvalAI [contributing guidelines](https://github.com/Cloud-CV/EvalAI/blob/master/.github/CONTRIBUTING.md). The source code should be in PEP8.

When I typed the mentioned docs in PEP8 . I realised that PEP8 was not enforced in some files. 

**Expected Action**
- `  autopep8 --in-place --exclude env,docs --recursive . `
-  Add your commit message

Thanks!


If you have gone through the travis configuration, `flake8` is implemented to be run to check the formatting. If required the contributor can run that before committing their changes.




Yes, @party98 is right. We enforce PEP8 guidelines but Autopep8 adds up bunch of extra things that are not required. 

Although thanks for opening this issue @kurianbenoy :)
Repository: Cloud-CV/EvalAI
Issue: Using Python 3 ONLY
Root cause: Unimplemented Feature Gap

Currently, EvalAI is based on Python2.7([docker/prod/django/Dockerfile#L1](https://github.com/Cloud-CV/EvalAI/blob/4e725674bd2ee2fd5f4daf23328f6b868d2c9ca2/docker/prod/django/Dockerfile#L1)), but [`it will retire soon`](https://pythonclock.org/).
It will be better if we start migrating to Python3.
Thanks!


@vkartik97 the process to migrate has already started. Check #1791 #1786 

Thanks, @vkartik97 for the suggestion. We are already working on this feature and are about to release it.
Hence closing this issue.
Repository: Cloud-CV/EvalAI
Issue: Bugged contact us page if https://evalai.cloudcv.org/contact is directly opened 

Hi the Contact Us page if directly opened from the link https://evalai.cloudcv.org/contact is bugged.
Steps to reproduce :- 
Login to https://evalai.cloudcv.org
Open the page https://evalai.cloudcv.org/contact

![capture](https://user-images.githubusercontent.com/29617462/45769314-e2a0c400-bc5c-11e8-9e52-7d93f35d0236.PNG)

System details 
Windows 10
Google Chrome Version 69.0.3497.100 (Official Build) (64-bit)

It's not a big, it's a feature. :) 

This is an expected behaviour where we automatically fill the email address field of the user if he is logged in. Hence, closing it. 

If this issue is about something else, then please feel free to reopen this issue. 

I was talking about the UI it isn't aligned properly vertically if you open the link directly 

Ah I see. Thanks for bringing that up. Reopening the issue.

Please feel free to work on this issue if interested. :) 

Yea I will try to work on it:)
Repository: Cloud-CV/EvalAI
Issue: Adding Short Circuit Behaviour in Prod's django/container-start.sh

If you'd like to request a modification :
- Adding Short Circuit Behavior in [`docker/prod/django/container-start.sh
`](https://github.com/Cloud-CV/EvalAI/blob/master/docker/prod/django/container-start.sh) 

For more information on why we need this, please read https://stackoverflow.com/questions/89154/benefits-of-using-short-circuit-evaluation?answertab=active#tab-top

Thanks!
Repository: Cloud-CV/EvalAI
Issue: Prompt the User if $SECRET_KEY is not set for Production
Root cause: Validation Gap

I would like to request a feature
- Normally, `random_secret_key` is used as SECRET_KEY, [`settings/common.py#L27`](https://github.com/Cloud-CV/EvalAI/blob/40c56a44b25fe54f2922e5c83ab905f4f67374aa/settings/common.py#L29)for django by default, if `$SECRET_KEY` is not set.
- If a user tries to start the server in Production without `$SECRET_KEY` set, the program should prompt the user about the same.

Thanks!
Repository: Cloud-CV/EvalAI
Issue: Download JSON  is not working in API Authentication Token pop-up box
Root cause: Validation Gap

* the observed bevaviour 

in user profile  **Download JSON** is not working
after clicking it doesn't give any response



![screenshot from 2018-09-24 00-44-03](https://user-images.githubusercontent.com/32031946/45921203-ef2c5300-bece-11e8-89a6-7e2ba226a1d6.png)




@knakul853 Can you please add the browser name and version that you are using? I think this might be relevant to PR #1812 (issue #1810). 

* firfox version 62
* ubuntu

I’ll try to fix this and reference in the same PR (#1812)

Thanks @party98 :) 

The issue is unrelated to the said PR(#1812) hence I will be submitting a separate PR for the same.

@deshraj @RishabhJain2018 Can I make a PR regarding the issue, I have found a possible solution 
```We have to manually create a click mouseEvent.```

Even I am facing the same issue in Firefox version 60
Repository: Cloud-CV/EvalAI
Issue: HTTP Cache to Speed up the Frontend

- [`HTTP Caching`](https://developer.mozilla.org/en-US/docs/Web/HTTP/Caching) Services for `.html`, `.css`, `.js` and other image files can be used
- This will help the Site to Load fast

Thanks!


serviceWorkers...

@vkartik97 Can you please describe how you are thinking of it?

@vkartik97 are you thinking of some caching anything to speed up?

I am currently experimenting with IaaS/SaaS and Reverse Proxies for Page Caching.
I will soon post my findings here!

Closing this as this issue deals with IaaS.
Repository: Cloud-CV/EvalAI
Issue: Add fields in django admin
GitHub labels: easy_to_fix

backend

good first issue

Add `challenge` field in submissions admin. The field should be near challenge phase field.

@RishabhJain2018 have a look on https://github.com/Cloud-CV/EvalAI/pull/1828 please

Hey, I am working on this issue, but I got "Permission to Cloud-CV/EvalAI.git denied to JaneLiuUSA" message when I was trying to push my code to my branch off master. Could you help me to fix this issue?
Also I am not quite clear about the issue, do I just need to add a "challenge" field in the table when viewing submission?(see attachment) or it also needs to be in the detail page?
![screen shot 2018-10-07 at 11 37 52 pm](https://user-images.githubusercontent.com/30699807/46591648-14ea5800-ca8a-11e8-9efe-48c505ae286c.png)


Hi @JaneLiuUSA Thanks for your interest in solving the issue but @ChrsMark has already resolved the issue. Please feel free to pick up any unassigned issue.

Got it. I saw the issue is open so I thought it's not solved yet. Thanks for letting me know!

@RishabhJain2018 Why is this issue still open?

@ghassemiN Since the PR is not merged, hence it is open for now.

Can we register all the models with all their fields?


Hi @GauravJain98, I didn't get your point. We can take this conversation on EvalAI Gitter channel. Since the issue is fixed hence closing it for now.
Repository: Cloud-CV/EvalAI
Issue: Add exception handling when key is not present in leaderboard API
Root cause: Validation Gap

The backend server throws 500 internal server error whenever any key in the results stored in the leaderboard data table is not present in the leaderboard schema for that particular challenge. Instead we want to show meaningful error on the UI with proper status code. Please see the relevant error log given below:


Sentry Report: https://sentry.io/cloudcv/evalai-staging/issues/605096490/

```
KeyError: u'spl'
(5 additional frame(s) were not displayed)
...
  File "rest_framework/views.py", line 477, in dispatch
    response = self.handle_exception(exc)
  File "rest_framework/views.py", line 437, in handle_exception
    self.raise_uncaught_exception(exc)
  File "rest_framework/views.py", line 474, in dispatch
    response = handler(request, *args, **kwargs)
  File "rest_framework/decorators.py", line 52, in handler
    return func(*args, **kwargs)
  File "jobs/views.py", line 259, in leaderboard
    item['result'] = [item['result'][index] for index in leaderboard_labels]

KeyError: u'spl'
```

is this done already?


if no shall I take it.

@RishabhJain2018 can I pick this up?

Sure you can!

@RishabhJain2018 I can't access Sentry Report: https://sentry.io/cloudcv/evalai-staging/issues/605096490/, can you tell the steps to reproduce the issue?

Closing this since it is already fixed!
Repository: Cloud-CV/EvalAI
Issue: Fix potential vulnerabilities due to outdated requirements
Root cause: External Dependency Breakage

There are some outdated requirements which can open potential security threats. Hence we should update the vulnerable package versions as suggested by Github. Here is the list of upgrades to be done (as suggested by Github):

1. django ~> 1.11.15

Please make sure to verify the validity and compatibility of suggestions with EvalAI codebase.



Hey there, I couldn't see any vulnerable package info on Dependency Graph section. I wanted to take this issue to myself but I couldn't find the problem.

Please see the screenshot below. This will give you more context about the error:

![screen shot 2018-10-05 at 5 24 41 pm](https://user-images.githubusercontent.com/2945708/46560967-9c399f00-c8c3-11e8-9818-ba60c8b007dc.png)


![image](https://user-images.githubusercontent.com/20618151/46561093-cceafa00-c8fe-11e8-9768-67e1e1bfa662.png)
I can not see it. I don't know why. Thanks for the info.

Only project maintainers can see it. 

Upgrades should also be done for `django-storages` in `requirements/prod.txt`
```sh
╞══════════════════════════════════════════════════════════════════════════════╡
│ REPORT                                                                       │
│ For requirements/prod.txt                                                    │
╞════════════════════════════╤═══════════╤══════════════════════════╤══════════╡
│ package                    │ installed │ affected                 │ ID       │
╞════════════════════════════╧═══════════╧══════════════════════════╧══════════╡
│ django-storages            │ 1.5.1     │ <1.7                     │ 36434    │
╘══════════════════════════════════════════════════════════════════════════════╛
```
Repository: Cloud-CV/EvalAI
Issue: Add horizontal scroll in leaderboard
Root cause: Unimplemented Feature Gap

Currently, the leaderboard displays maximum 10 custom metrics without horizontal scroll. We want to increase that number by adding horizontal scroll.

Hi @RishabhJain2018, is this horizontal scroll bar at the bottom of the table the desired implementation? Or do we need something more advanced like column freezing, etc.?

![image](https://user-images.githubusercontent.com/7151454/47078377-5f5b9980-d22d-11e8-9af9-c393927b1d9d.png)


Oh, is this meant to be different from issue #1798?

I can't see the uploaded image. can you please upload it again.
Yeah, this is different from #1798 . as we want the leaderboard to horizontally scrollable in desktop view.

The image shows up OK on my end, you can view a copy of it here [https://i.imgur.com/ABmMw70.png](https://i.imgur.com/ABmMw70.png)
I still think these 2 cases are pretty much alike if all we need is a scroll bar attached to the bottom side of the table.

yeah, the image looks good to me. 
The two issues are alike in terms of same functionality but we would like to have different PRs for both of them.


Hi @haivp3010 Since we need that feature urgently, so I added it. Please feel free to take up any other issue.

@RishabhJain2018 That's fine. I'll see other issues then.
Repository: Cloud-CV/EvalAI
Issue: Add Challenge name in submissions model in django admin
GitHub labels: enhancement

easy_to_fix

backend

good first issue

Currently, we only show challenge phase name in the submissions table, we also want to show the corresponding challenge name in the table near to the challenge phase name.

Hey, I want to work on this issue. Please assign it to me.

Sure! You can work on it.

Hey! Is this still open? If so, can you point me to the file I need to look at for fixing this issue?

@rajesh1993 I think @SinghSatbir is working on it. Please feel free to take up any other issue.

Closing this since it is the duplicate of #1826 .
Repository: Cloud-CV/EvalAI
Issue: Display execution time only when greater than zero.
Root cause: Unimplemented Feature Gap

Currently, all the types of execution time is shown on the frontend under `my submissions`. We would like to show only the execution time which is greater than zero.

Helpful link: https://stackoverflow.com/questions/18403835/how-to-make-less-than-or-greater-than-comparison-in-angularjs?answertab=active#tab-top
Repository: Cloud-CV/EvalAI
Issue: Delete Teams app and move the models and views to Participants and Hosts app
GitHub labels: bug

GSOC-2019

easy_to_fix


@deshraj Can i try this

Sorry @jainarunarunjain, @TroJan is already working on this. 

@deshraj ok, no problem

Reason for deleting this app ::
This app contains models `Team` and `TeamMembers` that are more generic. `Team` and `TeamMembers` as entity belongs to both challenge and participant. For Challenge, `ChallengeHost` and `ChallengeHostTeam` already exists. Hence these models can be successfully merged into Participant app

Resolved in #188
Repository: Cloud-CV/EvalAI
Issue: TypeError: int() argument must be a string, a bytes-like object or a number, not 'AnonymousUser'
Root cause: Validation Gap

https://sentry.io/cloudcv/evalai/issues/742463793/

```
TypeError: int() argument must be a string, a bytes-like object or a number, not 'AnonymousUser'
(16 additional frame(s) were not displayed)
...
  File "rest_framework/views.py", line 491, in dispatch
    response = handler(request, *args, **kwargs)
  File "rest_framework/decorators.py", line 53, in handler
    return func(*args, **kwargs)
  File "jobs/views.py", line 319, in leaderboard
    challenge_host_user = is_user_a_host_of_challenge(request.user, challenge_obj.pk)
  File "hosts/utils.py", line 14, in is_user_a_host_of_challenge
    challenge_host_teams = get_challenge_host_teams_for_user(user)
  File "hosts/utils.py", line 9, in get_challenge_host_teams_for_user
    return ChallengeHost.objects.filter(user=user).values_list('team_name', flat=True)

TypeError: int() argument must be a string, a bytes-like object or a number, not 'AnonymousUser'
```

Since it is resolved in #1906 .Hence closing it.
Repository: Cloud-CV/EvalAI
Issue: Edit challenge name button disbaled when no changes are made

### The Observed Behaviour
If a host clicks the edit challenge name button but does not make any changes and submit, then a successful return message is there.

### The Expected Behaviour
The button should be disbaled if no changes are made.

### Would you like to work on this issue?
Yes

@RishabhJain2018 @deshraj 

![screenshot-from-2018-10-31-01-26-22](https://user-images.githubusercontent.com/24366008/47746518-3d8df800-dcac-11e8-9cd1-c180f403bd17.png)

![screenshot-from-2018-10-31-01-26-27](https://user-images.githubusercontent.com/24366008/47746520-3e268e80-dcac-11e8-8868-035637450cd5.png)

Thanks, @gautamjajoo for pointing this out.
You can work on this issue.


@RishabhJain2018 Working on it!

Facing the following error when I edit the 
team name
 challenge name  and submit. @RishabhJain2018 
![screenshot-from-2018-10-31-13-50-11](https://user-images.githubusercontent.com/24366008/47780152-d78f8800-dd20-11e8-98cf-387488e1e86f.png)


Team name or Challenge name?

@RishabhJain2018 Challenge name
Repository: Cloud-CV/EvalAI
Issue: Display error if filename is too long
Root cause: Validation Gap

**Current Scenario:**
While submitting to EvalAI, if the filename is greater than 100 characters then the submission isn't accepted & no error is being thrown on the front-end, so a participant doesn't get to know about the state of his submission.

**Deliverables:**
Display the error thrown by API on the frontend.


Can I work on this ?


Sure @yashdusing. You can work on it.

I saw your message today so sorry for the delay. Anyways, is this okay ? (I directly checked the length of string without passing it to backend since it would throw off an error anyway)
![screenshot-0 0 0 0-8888-2018 11 08-23-34-27](https://user-images.githubusercontent.com/19976688/48218013-e58f7980-e3ae-11e8-86b5-3ed2d68a39e2.png)
Repository: Cloud-CV/EvalAI
Issue: Addition of Copyright Year in Dashboard footer

Currently, there is no Copyright Year in the footer of Dashboard. 
@RishabhJain2018 @deshraj 

![capture](https://user-images.githubusercontent.com/24366008/47844063-71ba0380-dde7-11e8-9a45-7cff8e52cfa6.JPG)


@deshraj @RishabhJain2018 I am suggesting to add copyright year in the dashboard footer. The PR #1867 , makes copyright year dynamic of landing footer. So, please reopen the issue 

@gautamjajoo please feel free to open a pull request for that as well. We will be more than happy to merge it. Thanks!
Repository: Cloud-CV/EvalAI
Issue: Update EvalAI Users List
GitHub labels: enhancement

frontend

good first issue

Deliverables:

- [x] Add HD logo for Ebay 
![download](https://user-images.githubusercontent.com/12206047/48034765-aeab3080-e12e-11e8-9279-3647fe37eaf2.png)

- [x] Add HD logo for IIT Madras
![1200px-iit_madras_logo svg](https://user-images.githubusercontent.com/12206047/48034861-047fd880-e12f-11e8-80b1-8bf42c97ad8d.png)

- [x] Add HD logo for University Of Adelaide
![the-university-of-adelaide-1-logo-png-transparent](https://user-images.githubusercontent.com/12206047/48034972-912a9680-e12f-11e8-9160-3e6e2ea566af.png)




@RishabhJain2018 I would like to work on this issue!

Sure You can take it up.
Repository: Cloud-CV/EvalAI
Issue: Add support for show and hide password
GitHub labels: enhancement

GSOC-2019

easy_to_fix

frontend

good first issue

### Observed Behaviour
Currently , there is no feature for showing or hiding password in login and sign up page.

### Expected Behaviour
There should be a one eye icon which on clicking shows or hides the password.

@deshraj @RishabhJain2018 I want to work on this issue.
Should I just replace the current key icon with an eye icon?

@Sanji515 yes! replace the key icon with an eye icon :)
Repository: Cloud-CV/EvalAI
Issue: Add support for Editing Host Team name

### Observed Behaviour
Currently , there is no option to edit Host Team name.

### Expected Behaviour
Add support for editing challenge host team name.

### Would you like to work on this?
Yes.

@deshraj @RishabhJain2018 
![img_20181108_004200](https://user-images.githubusercontent.com/24366008/48154645-258f2780-e2ef-11e8-9067-35280d55aa2e.jpg)



I want to work on this..... Please assign this issue to me.
Thank you.
Repository: Cloud-CV/EvalAI
Issue: Bug while editing Evaluation Crietria of a challenge
Root cause: Algorithmic Error

### Steps to Reproduce
1) Create a challenge
2) Go to ```Evaluation``` tab . Click on edit ```Evaluation Criteria```.
3) Cancel the changes you have made.

### Observed Behaviour
The text displayed is empty.

![screenshot-from-2018-11-10-19-08-45](https://user-images.githubusercontent.com/24366008/48303715-a6d6fc00-e533-11e8-98ad-78c1eea35b96.png)

### Expected Behaviour
The text should be displayed.

![screenshot-from-2018-11-10-19-08-41 1](https://user-images.githubusercontent.com/24366008/48303725-c706bb00-e533-11e8-9663-fac6d9155766.png)

@deshraj @RishabhJain2018 




@deshraj , @RishabhJain2018 is the issue still open? If yes I would like to work on it.

Yeah, it is open but I am not sure if this is an issue or not. Can you please reconfirm it by reproducing it.

@gautamjajoo @RishabhJain2018 I don't think this bug still exists since I was not able to reproduce the bug again

@yashdusing Hey! I checked once again on my local system and didn't faced this issue. Closing this.

@RishabhJain2018  @gautamjajoo The bug still exists as I am able to reproduce it.
![out](https://user-images.githubusercontent.com/19167324/52169043-1b4ac100-2758-11e9-94a3-2f8a18a8c571.gif)
Repository: Cloud-CV/EvalAI
Issue: Add created_by in ParticipantTeam model

So that cases like get all participant_team by particular user can be easily solved. This otherwise would involve very complex joins

To keep master stable and not break migrations, a default null value should be added for all the existing rows. May be in futures, when we are rebasing migrations, then we can drop this null value clause on `created_by` in `ParticipantTeam` model.

@deshraj : FYI

Fixed in #210