zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: Bug in Count of My Particpant Teams

### Observed Behaviour
The count of ```My Participant Teams``` is same as ```My Host Teams```.

### Steps to Reproduce
Create 2-3 Host teams and go to ```dashboard```.
We will see Host teams equal to Particpant Teams.

@deshraj @RishabhJain2018 

![screenshot-from-2018-11-10-19-06-59](https://user-images.githubusercontent.com/24366008/48303866-25349d80-e536-11e8-95fe-64adc690cd20.png)


I'll fix this 

@gautamjajoo I tried to reproduce this issue but I am not able to, am I missing something?
![screenshot from 2018-11-11 13-56-43](https://user-images.githubusercontent.com/29617462/48317048-d6304c00-e5b9-11e8-9a40-14648626e6e7.png)


@w3x10e8 I tried once more and the count was right. I think so the error is only sometimes.
Repository: Cloud-CV/EvalAI
Issue: Token not shown when windows width is < ~980px

## Overview
When the window size is smaller than ~980px in width, the Token is not shown.

![token_get](https://user-images.githubusercontent.com/44368997/48406922-afaa1680-e75b-11e8-8d35-ad053ecd75c5.gif)

### Steps to reproduce the problem:
With browser window at less than 980px in width, visit the profile page to get the token.


@C0derLint Hey! Can I work on this issue?

@gautamjajoo Sure

@C0derLint Hey! This issue is duplicate of #1795 . This can be closed? @RishabhJain2018

 @RishabhJain2018 Please close this issue as well. It is same as #1795 .

Thanks for pointing it out @gautamjajoo ! 
Closing this since it is already resolved.
Repository: Cloud-CV/EvalAI
Issue: Buttons of Edit Challenge Title of My Hosted Challenges are not properly aligned

Sumit and Cancel button of Edit Challenge Tile of My Hosted Challenges are not properly aligned.

![bug](https://user-images.githubusercontent.com/19318218/48455640-00645280-e7e2-11e8-9cd9-86b85caafcc4.png)

I want to work on this issue.
Repository: Cloud-CV/EvalAI
Issue: Disable auth token when account not activated
Root cause: Validation Gap

### Observed Behaviour
When a user is not activated , he is able to go to `Get your auth token` tab. Where it also downloads the json file with false message.

### Expected Behaviour
The tab should be disabled.

![screenshot from 2018-11-19 01-01-05](https://user-images.githubusercontent.com/24366008/48677232-9a881a00-eb97-11e8-80b8-1fec1a854fb0.png)

@deshraj @RishabhJain2018 

> ### Observed Behaviour
> When a user is not activated , he is able to go to `Get your auth token` tab. Where it also downloads the json file with false message.
> 
> ### Expected Behaviour
> The tab should be disabled.
> 
> ### Would you like to work on it?
> Yes
> 
> ![screenshot from 2018-11-19 01-01-05](https://user-images.githubusercontent.com/24366008/48677232-9a881a00-eb97-11e8-80b8-1fec1a854fb0.png)
> 
> @deshraj @RishabhJain2018

Has anyone started working on this? If not then i would like to work on it. 

@RishabhJain2018 @gautamjajoo is this taken ? If not, I'd like to work on it

@yashdusing I haven't made a PR regarding the issue, you can work on it but not sure if the issue is valid or not. Let it be confirmed by @RishabhJain2018 .

Yup, I agree with the issue. Thanks @gautamjajoo for pointing it.
This issue is open :)

Can I work on this?

@sachinmukherjee I think you are already working on an issue, right?

@RishabhJain2018 I have submitted a PR for the previous issue.

I see..You can work on this :)

Actually even I have finished with my PR and I was working on it. So what should be done ? @RishabhJain2018 @sachinmukherjee 

@yashdusing  I think you are a GSOC participant. You can work on this. I will find some other issue to work on :)

Thanks @sachinmukherjee !

@gautamjajoo Should the tab be disabled or the button ?

@yashdusing You could disable the button `Get you Auth token`.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Add test cases for Update submission data API
GitHub labels: enhancement

easy_to_fix

backend

priority-high

good first issue

Since we have an API for updating submission data after a remote evaluation is completed, so we would like to have it's unit cases.
Link to the API: https://github.com/Cloud-CV/EvalAI/blob/master/apps/jobs/views.py#L583

Can I take this up?

Sure @ayukha you can work on it.

@Ayukha we will need these tests soon. So, can you please let us know what will be the ETA for the them.

I'll try to add the tests by tonight.

Sounds good. You can open up a PR with the amount of code that you have added so that I can help you.

@Ayukha @RishabhJain2018 can I work on this issue?
Repository: Cloud-CV/EvalAI
Issue: Two Loaders working at same time

### Observed Behaviour
When a user wants to participate in a challenge, there are two loaders that are working. As seen in the attached screenshot.

### Expected Behaviour
There should be only one loader working.

### Steps to Reproduce
Go to a challenge and participate in a challenge. When you register a team for the challenge, you can observe two loaders working at the same time.

### Would you like to work on it?
Yes

@deshraj @RishabhJain2018 

![image](https://user-images.githubusercontent.com/24366008/49066651-d5e5b100-f247-11e8-8a4e-ede20448ff8f.png)


Please assign this issue to me... I'm currently working on it.
Thank you.

Hi, @Sanji515 Thanks for the PR. Please do ask for assignment of the issue before start working on it, so that it should be fair with other enthusiastic contributors.
Repository: Cloud-CV/EvalAI
Issue: Integrate django-spaghetti-and-meatballs to visualize database schema
GitHub labels: enhancement

GSOC-2019

easy_to_fix

@RishabhJain2018 would you like to work on this? 

For reference: https://github.com/LegoStormtroopr/django-spaghetti-and-meatballs

@deshraj yeah sure.

Awesome. :-)

Fixed in #196
Repository: Cloud-CV/EvalAI
Issue: Invalid comment in models.py

**The expected behaviour**
The comment should say """Returns the end date of Phase"""
**The observed behaviour**
It says: """"Returns the end date of Challenge"""
**Steps to reproduce the problem**
https://github.com/Cloud-CV/EvalAI/blob/2a8670a4d1e037329c38ebc7d1b8a49c4ebb2188/apps/challenges/models.py#L148

However the issue is insignificant but it might confuse contributors.

@RishabhJain2018 @deshraj 

Thanks!


@jarnugirdhar I am currently working on #1866. Will make the above change when I send the PR for the same.

> @jarnugirdhar I am currently working on #1866. Will make the above change when I send the PR for the same.

Alright! :+1:
Repository: Cloud-CV/EvalAI
Issue: Verification mail is not being sent
Root cause: Documentation Deficiency

### Observed Behaviour

After the user signs up, no verification mail is being received, hence permission denied appears for further tasks.

### Expected Behaviour

The user should receive a verification email.

### Steps to Reproduce

Just signup for a new account and check your mail.

### Would you like to work on it?

Yes

@deshraj , @RishabhJain2018 




It looks like you have missed checking the terminal. Once you sign up, you will see the email content on the terminal itself in the development version. 

Closing this issue for now. Please feel free to re-open it if you cannot still see the email on terminal. 

@deshraj can't we simulate the exact process of sending the mail? Why just printing it on the terminal?

You can do that by changing email settings here https://github.com/Cloud-CV/EvalAI/blob/master/settings/dev.py#L21 but in the development environment, it's not recommended to use the original email.
Repository: Cloud-CV/EvalAI
Issue: Improve challenge creation pipeline
Root cause: Validation Gap

## Current Scenario

If you directly zip the challenge configuration and upload it on the server, then you see an error saying `zip file has more than one .yaml files` which is mainly the case due to temporary files added to the zip while zipping.

## Deliverables

- [ ] Handle the case where temp files are ignored while unzipping in challenge creation API
- [ ] Show a meaningful error rather than showing `zip file has more than one .yaml` files

## How to reproduce

You can reproduce this error by uploading the following challenge zip file to create a challenge. 
[challenge.zip](https://github.com/Cloud-CV/EvalAI/files/2642344/challenge.zip)


Can I work on this issue?

Sure @vkartik97 :)
Repository: Cloud-CV/EvalAI
Issue: MacOS Installation Docker Installation Instructions
Root cause: Documentation Deficiency

Installation instructions for MacOS (or for any OS using Docker) seems to be confusing. Credentials given in step 6 of Virtual Environment are common to both for Docker and Virtual Environment, they are made as part of Virtual Environment. Like installation instructions given for Fabrik, it is better to provide these details as part of instructions for both Docker and Virtual Environment.

@deshraj @RishabhJain2018 This issue can be closed. Fixed in #1946 .

Thanks, @gautamjajoo for pointing this out.
Closing this issue too!
Repository: Cloud-CV/EvalAI
Issue: Add tests for get_broker_urls API
GitHub labels: enhancement

easy_to_fix

backend

good first issue

inactivity

We have added a new API in [apps/challenges/view.py](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1330). Hence, tests are required in order to make the system robust.

Please feel free to ask if there are more questions/doubts. I'll be happy to help.

@RishabhJain2018 can i take up this issue ? 😅 

sure! go ahead.

@RishabhJain2018 Over [here](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1340) we do not have a field `queue` in the database, i didn't get what values would be returned when `http://0.0.0.0:8000/api/challenges/get_broker_urls/` gets called . Am i missing something? 

We do have the field named `queue` in the database https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/models.py#L57. Also, the output format is shown here: https://github.com/Cloud-CV/EvalAI/pull/1948

Please let me know if you have some other questions too.

@RishabhJain2018 I've worked on this issue hence the referenced PR. Please do review and let me know if any changes required.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Viewing challenge stars should not require logging in
Root cause: Validation Gap

Without logging in:
<img width="287" alt="screen shot 2018-12-16 at 1 35 10 pm" src="https://user-images.githubusercontent.com/1156489/50057373-6f153280-0137-11e9-9bf8-cf6e3db93f84.png">

After logging in:
<img width="339" alt="screen shot 2018-12-16 at 1 35 00 pm" src="https://user-images.githubusercontent.com/1156489/50057372-6f153280-0137-11e9-8af0-3593377706a7.png">

@abhshkdz can I work on this issue?

Sure! go ahead.
Repository: Cloud-CV/EvalAI
Issue: Update response format for the API
GitHub labels: enhancement

easy_to_fix

backend

good first issue

inactivity

The response formats in the API's here https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1330 should be of JSON type (Currently, it returns list) and consistent with other API's. For e.g. the `result` key should be used for showing the results and `error` key should be used for displaying the error.

Please feel free to ask if you have any doubts.

@RishabhJain2018 In reference to the `get_broker_urls`, i had to convert the response to a list explicitly [here](https://github.com/Cloud-CV/EvalAI/pull/1961/files#diff-7b5c4a15a7006ac909ae8faa7b5d7e65R3040). 
Please let me know if i can work on this issue and subsequently make changes in the tests #1961 .
> For e.g. the result key should be used for showing the results and error key should be used for displaying the error.

In case of get_broker_url_by_challenge_pk :
```
{
'result' : ['queue-name-1']
}
```
In case of get_broker_urls:
```
{
'result' : [ 'queue-name-1',
             'queue-name-2']
}
```


> Please let me know if i can work on this issue and subsequently make changes in the tests #1961 .

Yeah you can do this.

Also, the format pasted by you above looks good to me! Please do return a dict with `error` key in case of errors.

> Please do return a dict with error key in case of errors.

@RishabhJain2018 `error` key is being used already here ( [1](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1343) | [2](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1361) | [3](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1367) )

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Search submissions by challenge name in submissions table
GitHub labels: enhancement

easy_to_fix

backend

priority-high

good first issue

Currently, we support searching the submissions by the `participant team name, challenge phase name, created by name and submission status`. We would like to add searching the submissions by `challenge name` and also add the same to default list filtering options.

Can I work on this issue?

sure! you can work on it!
Repository: Cloud-CV/EvalAI
Issue: Frontend: incorrect "back" behavior from landing page
GitHub labels: bug

frontend

critical

priority-high

Steps to reproduce:
- Go to https://evalai.cloudcv.org/ using Firefox
- Click on "Participate" button which links to https://evalai.cloudcv.org/web/challenges/list (other links have similar problems)
- Now press back in browser. 

Expected behavior: browser should go back to https://evalai.cloudcv.org/

Buggy behavior: browser goes to Firefox new tab (presumably because landing page never registered as a visit/page). 

It appears that #1978 didn't fix this issue. Reopening it so that we don't forget this issue. 

Hi! New to EvalAI :) May I work on this for now?

Hi @KhalidRmb Thanks for your interest! I think we have already resolved this issue. Please feel free to take up any other issue from the list. We have issues with labels as `good-first-issue` for beginners.
Also, do join our Gitter channel for your doubts. Feel free to ask questions/doubts you face while settings up EvalAI or solving the issue. I'll be happy to help.

Closing this, since this is already fixed!
Repository: Cloud-CV/EvalAI
Issue: Add a decorator to check if the user has confirmed the email address or not 
Root cause: Unimplemented Feature Gap

For most of the endpoints, we need to add a permission decorator that checks if the user has verified his email address or not. If not, then return json object that says "Please verify your account first". 

@deshraj can you assign this to me?

Yeah, you can work on it. :-)

if anyone wants to work on this feel free to do. I have my semester exams going on. 

Thanks @anweshknayak for letting us know. All the best for your semester exams. :-)

Fixed in #245
Repository: Cloud-CV/EvalAI
Issue: SyntaxError: Generator expression must be parenthesized
Root cause: External Dependency Breakage

While running `$ python manage.py migrate --settings=settings.dev` in MacOS 10 :
```sh
Traceback (most recent call last):
  File "manage.py", line 22, in <module>
    execute_from_command_line(sys.argv)
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/core/management/__init__.py", line 338, in execute
    django.setup()
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/__init__.py", line 27, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/apps/registry.py", line 85, in populate
    app_config = AppConfig.create(entry)
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/apps/config.py", line 94, in create
    module = import_module(entry)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/contrib/admin/__init__.py", line 4, in <module>
    from django.contrib.admin.filters import (
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/contrib/admin/filters.py", line 10, in <module>
    from django.contrib.admin.options import IncorrectLookupParameters
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/contrib/admin/options.py", line 13, in <module>
    from django.contrib.admin import helpers, widgets
  File "/Users/kartik/Documents/Code/EvalAI/lib/python3.7/site-packages/django/contrib/admin/widgets.py", line 152
    '%s=%s' % (k, v) for k, v in params.items(),
    ^
SyntaxError: Generator expression must be parenthesized
```


I also got same error with Python 3.7 but solved with Python 3.6 This is a problem when django is used with Python 3.7. Are you using Python 3.7 ?

@Nimishkhurana Yes
Repository: Cloud-CV/EvalAI
Issue: Fix potential vulnerabilities due to outdated requirements
Root cause: External Dependency Breakage

There are some outdated requirements which can open potential security threats. Hence we should update the vulnerable package versions as suggested by Github. Here is the list of upgrades to be done (as suggested by Github):

1. `pyyaml>=4.2b1`

Please make sure to verify the validity and compatibility of suggestions with EvalAI codebase.

Can I work on this issue?

@RishabhJain2018 Can I work on it?

@gautamjajoo Since you are working on the other issue, let @vkartik97 work on this one :)
Repository: Cloud-CV/EvalAI
Issue: Absence of decorators for authenticating and checking user status.
GitHub labels: inactivity

I'd like to propose code standard optimisation:

**Observation**

- [Line 45](https://github.com/Cloud-CV/EvalAI/blob/master/apps/web/views.py), view notify_users_about_challenge will only rendered if and only if user is authenticated and it passes test of being a superuser. There are so many nested if else s, which can be eliminated by:

- [ ] Using Decorators: login_required and user_passes_test.

- [ ] Creating decorators for handling server error and page_not_found error.

Please note that there is no optimisation in performance. But the code management is effected.
For example we may want to handle 500 error for every view. So we cant use if else for handling. Usage of decorators can help there.

Thanks!


I want to handle this, Can I take this as issue and start working on it?


@charanjit-singh Great Observation! 
What do you think about using `permissions.IsAuthenticated` instead of  `login_required`?

Yes! using permissions will keep it in DRF's way.
So yeah we can use `permissions.IsAuthenticated`

And Instead of rendering 404.html in views, we should Raise `Http404 `Exception.

`from django.http import Http404`




This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Add feature to make the baseline entry by challenge host show on leaderboard
Root cause: Unimplemented Feature Gap

**Deliverables**: 

- [ ] Add a  Boolean field in submissions model `baseline_submission`
- [ ] Update API `change_submission_data_and_visibility` to change to toggle the value of the field `baseline`
- [ ] Add a column in the `My submissions`  table for challenge hosts only, so that they can toggle this functionality.
- [ ] In the leaderboard API after filtering the submissions while creating the `distinct_leaderboard_entry_list` , if the value of `baseline_submission` is True, then add it into this list otherwise ignore it.
- [ ] Add a tag on leaderboard as `baseline` to show which entries are baseline.

I am working on this issue

Sure! you can take it up.

@vkartik97 Is this issue completed? It would be nice if you'll complete the previous taken issues and then work on new one :)

@RishabhJain2018 I'll try to open PR for this ASAP 

Sounds good! Please complete it asap, So, @yashdusing you can take up #2070
Repository: Cloud-CV/EvalAI
Issue: Fix potential vulnerabilities due to outdated requirements
Root cause: External Dependency Breakage

There are some outdated requirements which can open potential security threats. Hence we should update the vulnerable package versions as suggested by Github. Here is the list of upgrades to be done (as suggested by Github):

`django==1.11.18`

Please make sure to verify the validity and compatibility of suggestions with EvalAI codebase.

Can I take this up?

Sure!

**Related to this:** Another update may be needed in requirements/prod.txt for uWSGI from 
`uWSGI==2.0.15` to `uWSGI==2.0.17.1`
**Vulnerability:** Directory Traversal (Severity- High). For reference: https://snyk.io/vuln/SNYK-PYTHON-UWSGI-42087
Repository: Cloud-CV/EvalAI
Issue: Adding Non Test Source Files to Coverage Exclusion List

Following Source Files are not used in Tests and are decreasing Coverage
- settings/custom_storages.py
- settings/staging.py
- settings/dev.py
![screenshot from 2019-01-15 02-19-49](https://user-images.githubusercontent.com/3920286/51140315-3ff3fd00-186c-11e9-9cd7-79bcc8b3cd97.png)


@vkartik97 Noted. As I understand, these are not required as we will not be testing. More such files will be classified to make the coverage more relevant and meaningful, as well as relevant files/sections for which we need unit tests, in #2028. 
Thanks!

Closing this one, since we already have an issue for the same!
Repository: Cloud-CV/EvalAI
Issue: Improper error message shown
Root cause: Validation Gap

**Expected behaviour :**
"User not logged In" or similar error message.

 **Observed behaviour :**

![error](https://user-images.githubusercontent.com/19167324/51288077-838f6800-1a20-11e9-9464-ea738875462e.png)


**Steps to reproduce the problem :**

Click on star challenge without logging In.



Thanks, @Ayukha for opening this.
Would you like to work on it?

Yes, I would like to work on it.

Sure! go ahead.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.