zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: Show explicit error message while creating a team.
GitHub labels: enhancement

frontend

backend

priority-high

good first issue

**Current Scenario:**
We only display a error message that says `Team cannot be created`.

**Deliverables:**
We want to show the specific error message returned from backend stating that why the team can't be created.

**What you have to do:**
1. Change the error message [here](https://github.com/Cloud-CV/EvalAI/blob/master/frontend/src/js/controllers/teamsCtrl.js#L239) to `error.team_name[0]`.
2. Change the error message [here](https://github.com/Cloud-CV/EvalAI/blob/master/frontend/src/js/controllers/challengeHostTeamsCtrl.js#L225) to `error.team_name[0]`.

@RishabhJain2018 I would like to do this one!


Sure @HargovindArora Go Ahead!

Okay. I'm on it
Repository: Cloud-CV/EvalAI
Issue: Change the uploaded challenge logo to some random name.
GitHub labels: enhancement

easy_to_fix

backend

critical

good first issue

### Current Scenario:
Currently all the challenge logo images are being uploaded by the same name as the user has them on their local machine.

Hint: See the names for https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/models.py#L42 evaluation script.

### Deliverables:
We want that the logo images should be stored with unique random string on the server. 

@RishabhJain2018 I would like to work on this!


Sure @HargovindArora Go Ahead!
Repository: Cloud-CV/EvalAI
Issue: Set object level permissions to update a challenge
GitHub labels: bug

GSOC-2019

medium-difficulty

Set object level permissions so that the user who is creator of the challenge can only edit/delete the challenge. 

For reference, see this http://www.django-rest-framework.org/api-guide/permissions/#object-level-permissions

@deshraj I think we need to write again the `challenge_detail` view of the challenges app using the class based views. As for function based views we can't implement the object level permissions. For reference please check [this](https://github.com/tomchristie/django-rest-framework/issues/1697) link.

No, I don't think so. We can do it easily for FBV. 

I realized that I posted the wrong reference link. Please see this http://www.django-rest-framework.org/api-guide/permissions/#custom-permissions

@deshraj ThePR is merged. I think we should close this.

Thanks @RishabhJain2018 for working on this. 

Fixed in #231
Repository: Cloud-CV/EvalAI
Issue: Modify challenge phase query for displaying challenge phase detail
Root cause: Validation Gap

**Current Scenario:**
The function [here](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L398) will **not** throw the error even if there are no challenge phase corresponding to the challenge.

**Steps to Reproduce:** You will only be able to check it only at the API level.
Let us suppose there exists a challenge with id 34 and phase ids 120, 121. Now when you will hit the [url ](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/urls.py#L17)with challenge id 34 and phase id say 1 then it won't give error if phase id 1 exists(for any other challenge). 

Ideally, it this [url](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/urls.py#L17) should only accept the phase ids 120 and 121 and should throw error for every other phase id.

**Deliverables:**
Modify the challenge phase query [here](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L406) to include the `challenge` parameter in it.

What should be added:
`challenge_phase = ChallengePhase.objects.get(challenge=challenge, pk=pk)`
Also, Update the response message to
`response_data = {'error': 'Challenge Phase {} does not exist'.format(pk)}`

@RishabhJain2018 I would like to work up on this!

Sure @HargovindArora go ahead!

@RishabhJain2018 How to check whether the changes made are showing effect? I meant how should I reproduce error after making the required changes? I tried deleting the phases of the challenges already present there, nothing happened.

@HargovindArora I have updated the description.

I would like to start contributing by working on this !!

@rakesh-1601 Sounds good! Please let us know here or on our Gitter channel if you're having any difficulties. :)

@rakesh-1601 Please feel free to take up any other issue since @HargovindArora has already opened a PR for this.

Hello. Is this issue still open? Can I work on this?

@Arpitrf looks like #1751 is already there for this. Please feel free to take any other unassigned issue. 

@RishabhJain2018  I would like to work on it.

Sure!

Can I work on this issue @RishabhJain2018 ?


@kurianbenoy  There is already a PR opened for this issue which is yet to be reviewed.

> @kurianbenoy There is already a PR opened for this issue which is yet to be reviewed.

The travis tests for your PR is failing. That's why it's not being reviewed.
Repository: Cloud-CV/EvalAI
Issue: Bug in showing remaining submissions
Root cause: Algorithmic Error

Currently, if the number of total remaining submissions is less than that of the limit set for doing the total number of submissions in a day, then ideally total submissions that can be done should be equal to the total remaining submissions which is not the case right now. Please see the screenshot below for illustration:

<img width="1186" alt="screen shot 2018-07-11 at 10 22 14 pm" src="https://user-images.githubusercontent.com/2945708/42614102-3618ffb6-8559-11e8-95f9-adee793c1a24.png">



Can I work on this issue?

Hi @Gautam1630 I have already completed the above issue and opened a PR. Please feel free to take up any other issue.
Repository: Cloud-CV/EvalAI
Issue: Gulp Staging Fails
Root cause: Validation Gap

The new change introduced in #1755 breaks the gulp staging task. Please see the error log below:

```
deshraj at DESHRAJs-MacBook-Pro in ~/Documents/EvalAI on staging [$]
$ docker-compose run nodejs gulp staging
[05:23:44] Using gulpfile /code/gulpfile.js
[05:23:44] Starting 'staging'...
[05:23:44] Starting 'clean'...
[05:23:44] Finished 'clean' after 174 ms
[05:23:44] Starting '<anonymous>'...
[05:23:44] Finished '<anonymous>' after 917 μs
[05:23:44] Starting 'vendorcss'...
[05:23:44] Starting 'vendorjs'...
[05:23:44] Starting 'css'...
[05:23:44] Starting 'js'...
[05:23:44] Starting 'html'...
[05:23:44] Starting 'images'...
[05:23:44] Starting 'fonts'...
[05:23:45] Finished 'css' after 1.23 s
[05:23:45] Finished 'vendorcss' after 1.25 s
[05:23:46] 'js' errored after 1.39 s
[05:23:46] GulpUglifyError: unable to minify JavaScript
Caused by: SyntaxError: Unexpected token operator «=», expected punc «,»
File: /code/frontend/src/js/controllers/controllers.min.js
Line: 1007
[05:23:46] 'staging' errored after 1.57 s
[05:23:46] The following tasks did not complete: vendorjs, html, images, fonts
[05:23:46] Did you forget to signal async completion?
```

cc: @live-wire @RishabhJain2018 

This seems to be fixed!
Repository: Cloud-CV/EvalAI
Issue: Fix Bug in EvalAI Submissions
Root cause: Validation Gap

Sometimes the submissions in `evalai` have status as submitted but the input file is blank.

Hey I can work on this issue ! Can you elaborate what you mean by input file is blank? Input is not provided or is not read properly. @RishabhJain2018 

Can you tell me the steps to reproduce this issue?
Repository: Cloud-CV/EvalAI
Issue: Add Filtering by participant team name in EvalAI Admin


Can I work on this issue?

Sure! You can take it up.

Hey I think filtering by participant team name is already there.
![paricipant team](https://user-images.githubusercontent.com/19318218/44629711-c87f0900-a970-11e8-8056-3b1bb7e41e35.png)
Here is the code that filters according to participant team name
`list_filter = ('team_name',)`

yes! thanks for pointing out. Closing this issue.
Repository: Cloud-CV/EvalAI
Issue: Add cloudcv logo in header
GitHub labels: enhancement

GSOC-2019

easy_to_fix

Need to add the cloudcv logo just above the link www.cloudcv.org. Download logo fromthe official site www.cloudcv.org

To make life easier, the logo can be found here http://deshraj.github.io/static/img/cloudcv.png

@aka-jain @deshraj can you provide this logo without background

Sure, I'll make that one. Will let you know when finished with it.

![cloudcv](https://cloud.githubusercontent.com/assets/11537940/20827532/ba8c0a70-b898-11e6-8e39-442b9a913741.png)
@jainarunarunjain I hope this logo works fine. Let me know if you have any query.

Fixed in #202
Repository: Cloud-CV/EvalAI
Issue: Signup failing with Cross Origin Read Block
Root cause: Configuration Error

Options preflight is failing to evalapi.cloudcv.org on sign up.

Browser: Google Chrome (Version 67.0.3396.87, 64-bit)
OS: Mac OS 10.3.5

@apsdehal : Sorry for the inconvenience. There is some issue with the gunicorn prod setup that we are fixing. As of now, the issue is fixed temporarily. We will keep you posted about the permanent fix. 

This seems to be fixed!
Repository: Cloud-CV/EvalAI
Issue: Python 3 Travis Checks failing
Root cause: Environment Incompatibility

## Details

The Python3 checks seem to be failing on Travis. See https://travis-ci.org/Cloud-CV/EvalAI/jobs/413411233 for more details. 

Also, this seems to be related to #1681 


There is a similar issue #1791 . hence closing this one!
Repository: Cloud-CV/EvalAI
Issue: AttributeError: This QueryDict instance is immutable
GitHub labels: inactivity

Private Link: https://sentry.io/cloudcv/evalai/issues/505241594/
Public Link: https://sentry.io/share/issue/9fe7a0283bfa4481b4eb222dbce9494c/

```
AttributeError: This QueryDict instance is immutable
(8 additional frame(s) were not displayed)
...
  File "rest_framework/views.py", line 437, in handle_exception
    self.raise_uncaught_exception(exc)
  File "rest_framework/views.py", line 474, in dispatch
    response = handler(request, *args, **kwargs)
  File "rest_framework/decorators.py", line 52, in handler
    return func(*args, **kwargs)
  File "jobs/views.py", line 123, in challenge_submission
    'request': request
  File "jobs/serializers.py", line 20, in __init__
    kwargs['data']['created_by'] = created_by.pk

AttributeError: This QueryDict instance is immutable
```

Hi can i work on this issue

@RishabhJain2018 

@darthgera123 sure, let us know if you need help. 

@deshraj   could you tell me the steps to reproduce this error

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: API Consumption error
Root cause: Documentation Deficiency

Getting an error on doing a curl request to /accounts/login/
![image](https://user-images.githubusercontent.com/19913130/44475927-fe13b180-a653-11e8-8f56-ed14761dea1d.png)


Hi @GauravJain98 I think you are using the wrong URL for logging in. Please take a look at the API docs here [http://localhost:8000/docs/](http://localhost:8000/docs/ ) once your Django server is running.

I am closing this issue for now! Please feel free to open again if you are still facing the error.
Repository: Cloud-CV/EvalAI
Issue: accounts/login gets redirected to a 404 page
Root cause: Documentation Deficiency

Opening on browser 
I get this

![image](https://user-images.githubusercontent.com/19913130/44476104-68c4ed00-a654-11e8-9c8f-19d1d1b9a032.png)


Hi @GauravJain98 I think you are using the wrong URL for logging in. Please take a look at the API docs here [http://localhost:8000/docs/](http://localhost:8000/docs/) once your Django server is running.

I am closing this issue for now! Please feel free to open again if you are still facing the error.

Okay
Repository: Cloud-CV/EvalAI
Issue: Add functionality to update the profile picture
GitHub labels: enhancement

easy_to_fix

frontend

backend

new-feature

good first issue

inactivity

**Current Scenario:**
A user can't update his profile picture.

**Deliverables:**
A field on the profile page where a user can upload an image in order to update it.
The screenshot of the Update Profile Page is given below.
<img width="1440" alt="screen shot 2018-08-22 at 6 33 23 pm" src="https://user-images.githubusercontent.com/12206047/44494531-28587580-a63a-11e8-8e0d-e02190ee29e3.png">



Hey, I would like to take this issue. However, I am new to the project and was hoping if some assistance could be provided


Hey @RishabhJain2018 , I am interested to work on this issue. Would you assign it to me or shall I just start working?

It seems like @party98 have picked up another issue to work on. @usmanmuhd You can work on this issue.

@RishabJain2018 . If this issue is still unsolved, do you mind if  I give it a shot. I'm new at this, but I'll try my best

@AshleyTR I'm still working on the issue.

@usmanmuhd No worries. I'll find another one. Thanks for replying fast


@usmanmuhd Any update on this issue?

@RishabhJain2018 I have added the backend functionality. I am yet to do the front end part (quite new to angular).

Can you please open up a PR for that. We generally merge front-end and backend code in different PR's.

@RishabhJain2018 I will do it in a few days. Currently on a vacation.

Sure! No problem. Thanks for keeping us posted.

Is this Issue still open? 
I would liem to work on it.

Can I work on this issue @RishabhJain2018 

Is this issue a priority as our frontend is now being migrated to `new frontend`, this year. If yes, I was interested to work on this project

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Unable to login via Safari
Root cause: Environment Incompatibility

### The expected behaviour
Successfully be able to login to the dashboard on Safari

### The observed behaviour
Unable to maintain a session. After 5 seconds of logging in, a timeout error is generated and the site logouts automatically.

### Steps to reproduce the problem
Try logging in via safari

### Which operating system and/or browser you're using, if relevant
macOS 10.13.6
Safari 11.1.2

### (if possible) copies of the console/server logs
[Error] Failed to load resource: the server responded with a status of 401 (Unauthorized) (challenge_host_team, line 0)

![image](https://user-images.githubusercontent.com/22412980/44630750-7b0a9800-a980-11e8-9e95-3325ba2c9c76.png)



+1

@matthew-z @party98 Would you like to work on it?

Sorry, I am not familiar with web development

Okay! No problem.

I can try to give it a go. But I am not super confident about it. 

Sent from my iPhone

> On 07-Oct-2018, at 12:06 AM, rishabhjain <notifications@github.com> wrote:
> 
> Okay! No problem.
> 
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub, or mute the thread.


Sure! Please keep me posted regarding it.

@party98 Any update on this issue?
Repository: Cloud-CV/EvalAI
Issue: Make Exception message more verbose
Root cause: Validation Gap

Add Challenge Phase name and ID along with Dataset split name & ID in the error message here
https://github.com/Cloud-CV/EvalAI/blob/master/scripts/workers/submission_worker.py#L352

I'd like to take this issue up.

Can I work on this @RishabhJain2018 ?

Hi, @kurianbenoy I think @party98 is already working on it & have also opened a PR for the same. Please feel free to take any other issue.

ok :+1: 

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.


This issue has been automatically closed as there is no further activity. Thank you for your contributions.
Repository: Cloud-CV/EvalAI
Issue: Improve exception handling for import errors in evaluation script
Root cause: Validation Gap

Currently if there is a challenge evaluation script which contains some custom python package requirement which is not installed on EvalAI server, then the submission worker process gets killed automatically. Please see the example log below where `tqdm` is missing in the system.

```
worker_1  | Traceback (most recent call last):
worker_1  |   File "/usr/local/lib/python2.7/runpy.py", line 174, in _run_module_as_main
worker_1  |     "__main__", fname, loader, pkg_name)
worker_1  |   File "/usr/local/lib/python2.7/runpy.py", line 72, in _run_code
worker_1  |     exec code in run_globals
worker_1  |   File "/code/scripts/workers/submission_worker.py", line 535, in <module>
worker_1  |     main()
worker_1  |   File "/code/scripts/workers/submission_worker.py", line 516, in main
worker_1  |     load_active_challenges()
worker_1  |   File "/code/scripts/workers/submission_worker.py", line 234, in load_active_challenges
worker_1  |     extract_challenge_data(challenge, phases)
worker_1  |   File "/code/scripts/workers/submission_worker.py", line 215, in extract_challenge_data
worker_1  |     challenge_module = importlib.import_module(CHALLENGE_IMPORT_STRING.format(challenge_id=challenge.id))
worker_1  |   File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module
worker_1  |     __import__(name)
worker_1  |   File "/tmp/tmpm1P8t1/compute/challenge_data/challenge_59/__init__.py", line 1, in <module>
worker_1  |     from .main import evaluate
worker_1  |   File "/tmp/tmpm1P8t1/compute/challenge_data/challenge_59/main.py", line 37, in <module>
worker_1  |     from tqdm import *
worker_1  | ImportError: No module named tqdm
evalai_worker_1 exited with code 1
```

We want to make the system more robust. So, we would want to add exception handling so that the worker process doesn't get killed whenever there is a missing requirement. 

Should we catch an `ImportError` exception and extract the package name that is missing and try to install it in the submission folder using pip?
If this fails, then we can throw an error indicating to that the server was unable to run the script due to error in import the package.


Please give a go ahead if you think this is a good idea so that I can begin work. 😀

Fixed in #1801 . Hence closing this one! @party98 Please pick any other issue.
Repository: Cloud-CV/EvalAI
Issue: CORS error while using django server with frontend server.
Root cause: Configuration Error

![screenshot 110](https://cloud.githubusercontent.com/assets/16155501/20721362/65df055a-b617-11e6-84b5-9021184e8eee.png)
CORS error is coming while accessing django server from localhost. 

Thanks @jainarunarunjain for reporting this. I will check and get back to you soon. 

Fixed in #180. Closing it now.
Repository: Cloud-CV/EvalAI
Issue: Fix Failing test cases in Python 3
Root cause: Validation Gap

The Travis-CI build for python 3 is failing.
The tasks involved are:
1. Fix the flake8 errors
2. Fix the failing test cases

Can I work on this issue?


Sure @kurianbenoy You can take this issue. Just for the head start here is the link to failing test cases & flake8 errors https://travis-ci.org/Cloud-CV/EvalAI/jobs/425998771#L1340

@RishabhJain2018 thanks
Repository: Cloud-CV/EvalAI
Issue: https://evalai.cloudcv.org/web/permission-denied should redirect if already verified.
Root cause: Unimplemented Feature Gap

_Thanks for taking the time to report a bug in the EvalAI project, or propose a new feature! Before creating a new issue, please do a quick search to check that it hasn't already been filed on the [issue tracker](https://github.com/Cloud-CV/EvalAI/issues)._

If you'd like to report a bug, please include the following information:
- the expected behaviour
- the observed behaviour
- steps to reproduce the problem
- which operating system and/or browser you're using, if relevant
- (if possible) copies of the console/server logs

On the other hand, if you'd like to propose a new feature:
- please describe, as clearly as possible, what you'd like to see
- (if possible) include mockups/screenshots, if these would help convey the meaning better

Thanks!

![screen shot 2018-09-07 at 11 26 23 am](https://user-images.githubusercontent.com/11073943/45201001-10672f80-b291-11e8-9324-8c1d1e19ff02.png)

Message: **false** should be more intuitive.
Issue: On hitting the url (https://evalai.cloudcv.org/web/permission-denied), if user is already verified -- redirect to dashboard.
Reproduce: Create an account, it takes you to permission denied view. Verify your email by clicking on the link. Go back to the previous page and refresh.

This is the desired behavior. Hence Closing this issue!

Really ? Sure!
Repository: Cloud-CV/EvalAI
Issue: Update profile button not shown in mobile view

In mobile view the update profile button is not shown as expected.
![screenshot from 2018-09-08 13-05-36](https://user-images.githubusercontent.com/26684281/45251691-0cf2a780-b368-11e8-8610-a01cc62828e9.png)



Thanks @usmanmuhd for pointing out. Would you like to work on it?

@RishabhJain2018 Currently I am more interested in working on #1777 . I was thinking of making this one as a GCI task. There a lot more instances of this kind. Example:
![inc](https://user-images.githubusercontent.com/26684281/45260988-c8244a80-b413-11e8-8df9-be7415848227.png)


Sure @usmanmuhd . You can work on it. But for GCI tasks please make sure that the tasks are easy enough for the students (Remember that they are high school students 13-17 years). If there is a tough task then break it into smaller tasks & later on combine all these smaller tasks. 

@RishabhJain2018 Could I PM you on gitter  in order to discuss the tasks for the GCI.
PS: I have filled the form for being a GCI mentor.

This is not the right place to talk about GCI. Please send all the GCI related messaged on the gitter channel. Moreover, if you want to work on the frontend for EvalAI then please refer this https://github.com/Cloud-CV/EvalAI-ngx repository.
Repository: Cloud-CV/EvalAI
Issue: Leaderboard Table is not horizontally scrollable in Mobile View
Root cause: Architectural Constraint

The leaderboard table on the path on challenge page is not horizontally scrollable in mobile view.
(see example on "https://evalai.cloudcv.org/web/challenges/challenge-page/103/leaderboard/298")

Screenshot:

<div>
<img src="https://user-images.githubusercontent.com/17432193/45275084-4fd38d00-b4d8-11e8-875e-fb8ef68c77cc.jpg" width="250">
</div>
<br><br>
Can I work on this ?

Sure! You can work on it.

@RishabhJain2018 How can I replicate the leaderboard on local machine? So that I can see if my changes are working or not!

Hi @gautamjajoo You can use `chrome dev tools` for it. Here's the link to it: https://developers.google.com/web/tools/chrome-devtools/device-mode/#device


@RishabhJain2018 I tested on mobile, but the leaderboard table is horizontally scrollable. Here's the attached screencast for the reference.

![ezgif com-video-to-gif](https://user-images.githubusercontent.com/24366008/47834135-3ce88500-ddc4-11e8-8b4c-fc08a9191889.gif)



@TejasBhitle Can you please tell which device were you using?

@RishabhJain2018 I had tried it using Chrome Dev tools.
Apparently I feel this issue is resolved after the PR #1845 you submitted.

No problem. Closing this since it is already resolved.