zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: Show organization logos dynamically from backend
GitHub labels: enhancement

medium-difficulty

frontend

backend

GSoC-2020

Dependent on #2696 (Can be worked only when this is merged.)

**Description:**
The organizations using EvalAI are hardcoded in the codebase with their logos. We would like to load these organizations from the backend.

**Deliverables:**
- [ ] Add an API to fetch the logos from the backend for which `is_active=True`.
- [ ] Change the frontend code to use this API and display the logos.

@RishabhJain2018 I would like to work on it

Sure @pystar-oss 

@pystar-oss Are you still working on the issue? If not, can I take this up @Sanji515 ?

@Sanji515 Can I work on this? 


@RishabhJain2018 is this issue still open ? If yes, can I work on it ?


Yes, it is open.

@yashdusing Are you working on this? 

Also, @RishabhJain2018 there is an open PR (https://github.com/Cloud-CV/EvalAI/pull/2707) for the referenced issue. Please review.

@pushkalkatara yes, I'd like to work on this issue 


Lets punt this feature. I am afraid that this will make the frontend page slow and doesn't add too much value. We can once in a while keep updating the orgs on the main page. Thanks all for your interest in working on this issue.
Repository: Cloud-CV/EvalAI
Issue: Add a tab for participated challenges for participants
Root cause: Unimplemented Feature Gap

**Description**:
As the number of challenges is increasing on EvalAI, we need a separate tab for participants which will show only the challenges in which they have participated (Similar to Hosted Challenges).

**Deliverables**:
- [ ] Add an API to fetch the participated challenges for a particular user.
- [ ] Add a tab in the left sidebar to show the participated challenges for a participant like the hosted challenges.

@RishabhJain2018  Can I take this up?

@RishabhJain2018 Sir i think we have a similar issue already #2515 

I see @Suryansh5545 ... lets close [#2515 ](https://github.com/Cloud-CV/EvalAI/issues/2515). And I think as no one is working on this issue @Ayukha you can take this one.

I think @Ayukha is already working on #2694  issue so this issue is still open.

@Sanji515 Can I take this up?

Sure @aryanmediratta 

@Sanji515  i have already opened a PR for #2694 

oh I see then @Ayukha you can work on this issue.

@aryanmediratta Please feel free to take up any other issue :)
Repository: Cloud-CV/EvalAI
Issue: Filter challenges based on name
GitHub labels: enhancement

easy_to_fix

backend

new-feature

priority-high

GSoC-2020

**Description:**
Since we've more than 50 AI challenges on EvalAI, it would be good to add filtering based upon the challenge name.

**Deliverables:**
- [ ] Add an API to filter challenges based upon the challenge name in the challenges app.
- [ ] Add unit tests for the API


Hi @RishabhJain2018, can I take this one up?

@RishabhJain2018 can i work on this?

Hi @adityaketkar, Sure you can take this up.

Hi @ksarthak4ever, Please take up any other issue from the list. 

@RishabhJain2018, just a suggestion. Can we try the filter functionality instead of creating separate search button and interface?
It looks elegant and is also fast. Have a look at the demo below : 

![SmallSadFlyingsquirrel-size_restricted](https://user-images.githubusercontent.com/22611315/75777166-c233cf00-5d55-11ea-9b53-593da420b3e3.gif)







@Ram81  @RishabhJain2018, Even now this feature is not implemented. If this issue is still relevent I would like to work on this, Please assign it to me.

Thanks in advance.

@RishabhJain2018 @deshraj Iwould like to work on this .can i take this issue?

@RishabhJain2018  as the issue is still open i would like to work on it.


i @RishabhJain2018 @deshraj Iwould like to work on this .can i take this issue?

can i work in this
Repository: Cloud-CV/EvalAI
Issue: Center EvalAI logo properly

**Description**
The EvalAI logo in use has some extra space on the right side.
<kbd>
<img src="https://raw.githubusercontent.com/Cloud-CV/EvalAI/master/docs/source/_static/img/evalai_logo.png">
</kbd>

**Expected**
Crop the logo to make it properly centered.

**Reference**: https://raw.githubusercontent.com/Cloud-CV/EvalAI/master/docs/source/_static/img/evalai_logo.png

Closing via #2708
Repository: Cloud-CV/EvalAI
Issue: [Feature Proposal] Add support to signup/login using Github OAuth
Root cause: Unimplemented Feature Gap

The signup experience can be simplified by integrating a "Sign up using Github" link along with the current sign up form. 

Proposed Feature : 
- "Sign up using Github" option during registration.
- "Sign in using Github" option during login.

Hey @adityaketkar  I think it's a copy of #2291 

@Kajol-Kumari yes, indeed they are same. I'll close this issue. Thanks for pointing out.
Repository: Cloud-CV/EvalAI
Issue: Add search bar in all challenges view to filter challenges based on title
GitHub labels: priority-high

**Description:**

Following up with #2699, use the new API to query the database for challenges based on title input by the user.   


**Deliverables:**
- [ ] Add appropriate functions in the controller to call the new API
- [ ] Add a search bar in front-end and connect it to the controller 

@RishabhJain2018 can you review #2699 so I can take this up? 

@adityaketkar I think  this issue is similar to #2591 . And it was decided to close it for #2699 . As it seems much better. 

@Suryansh5545 I agree. Should I add these deliverables in #2699 and close this issue ?

@adityaketkar the idea is already rejected in #2591  so I don't think the community needs it now . But it's your choice. 

Thanks for the information @Suryansh5545. Closing this issue.

@adityaketkar Is it possible for you to open up a PR for the same as you have a working demo here: https://github.com/Cloud-CV/EvalAI/issues/2699#issuecomment-593934154

> @adityaketkar Is it possible for you to open up a PR for the same as you have a working demo here: [#2699 (comment)](https://github.com/Cloud-CV/EvalAI/issues/2699#issuecomment-593934154)

Sure. I'll create a PR.

Similar to #2699 and closing this one.
Repository: Cloud-CV/EvalAI
Issue: Broken Link In The "Read The Docs" For EvailAI

# The Error

The 'Edit On Github' link on the top right at [this link](https://evalai.readthedocs.io/en/latest/contribution.html) leads to a 404 page.

# The Expected Behavior

It leads to a file to edit changes into.

# Observed Behavior

Instead it sends me to a blank page with the text
```
Not Found
```

At [link](https://github.com/Cloud-CV/EvalAI//master/docs/source/contribution.rst)

# Steps to reproduce the issue

Just click on the 'Edit On Github' link at [here](https://evalai.readthedocs.io/en/latest/contribution.html).

# What Operating System / Browser Am I Using

OS is irrevelant here. Browser is Chromium with the version
```
Chromium 80.0.3987.106 Arch Linux
```

# Output of console log

Irrelevant here

Thank you!

( Or just let me know which file it should instead redirect to - I don't know where to exactly make the change to href of the a tag - pretty sure it should lead to [this link instead](https://github.com/Cloud-CV/EvalAI/blob/master/.github/CONTRIBUTING.md). )


This is in reference to an issue, #2560 [Update the Contribution Guidelines on EvalAI-Docs #2560](https://github.com/Cloud-CV/EvalAI/issues/2560) where the User asks the contributing text from which we reach the broken results at the [link](https://evalai.readthedocs.io/en/latest/contribution.html) should be updated with the current and updated contributing at [this link](https://github.com/Cloud-CV/EvalAI/blob/master/.github/CONTRIBUTING.md).

Thanks. <3

Duplicate of #2560. Closing it.
Repository: Cloud-CV/EvalAI
Issue: Add 'tags' for each challenge
GitHub labels: enhancement

easy_to_fix

backend

new-feature

good first issue

GSoC-2020

frontend_v2

Currently we don't have tags related to a challenge. These tags could help to identify the challenge details by keyword such as targeted conference `cvpr2020`, `neurips2021` etc. 

### Deliverables
- [ ] Add a `tags` field (postgres array field, default=[], null=True) to `Challenges` Model 
- [ ] List tags associated with a challenge on the [challenge list page](https://evalai.cloudcv.org/web/challenges/list), [challenge details page](https://evalai.cloudcv.org/web/challenges/challenge-page/574/overview)
- [ ] Add `tags` support in Challenge creation templates so that tags automatically gets created when configuration is uploaded to EvalAI
- [ ] Update/add unit tests for tags

Hi @deshraj 
Can I work on the issue?

Sure.

Hi @RishabhJain2018 @deshraj  please review the PR.

Hi @RishabhJain2018 is the issue still open. I was thinking of contribuitng. It would be great help if you can help me in getting started.

I would like to work on the issues 

Hi i would like contribute with this issue

Can I work on this issue?


@deshraj is this issue is still open to work?

Hi I am keenly interested in addressing specific issues and am earnestly hopeful of having the opportunity to engage with them further.

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: REPLACING THE UI WITH A MODERNIZED ONE AND ANALYZING ALL THE BUILD CODE TO AVOID LOGGING IN ISSUES

[issue tracker](https://github.com/Cloud-CV/EvalAI/issues)._

I'd like to propose a new feature:
-I have a new generation technology UIthat would help get the most benefits out of the EVALAL product.
- looking at the issues concerning continuous malfunction on the platform I’d line to analyse the code and help get the most out of the EvalAl project

Thanks!


Hi, thanks for opening the issue. Unfortunately, we already have the UI ramp up project going on https://github.com/Cloud-CV/EvalAI-ngx and we are not looking to introduce some new technology. 

On Wed, 1 Apr 2020 at 05:18, Deshraj Yadav <notifications@github.com> wrote:

> Hi, thanks for opening the issue. Unfortunately, we already have the UI
> ramp up project going on https://github.com/Cloud-CV/EvalAI-ngx and we
> are not looking to introduce some new technology.
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <https://github.com/Cloud-CV/EvalAI/issues/2736#issuecomment-607020800>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ALRKDPRRQI6222CKVTG6QMLRKK6AVANCNFSM4LV6AD5Q>
> .
>
I’d be willing to help improve the project in any way I can to help make it
a a better product and I’d be glad if you consider my offer
Repository: Cloud-CV/EvalAI
Issue: Add a proper API Documentation 

The current **ReadTheDocs** documentation only points to the codebase `eval-ai/urls` for APIs. This makes it complicated for the reader to browse through and understand which endpoint serves which purpose. The reader, who perhaps might be a developer writing a new external integration with EvalAI, may need to waste their time going through the codebase only to understand which endpoints to interact with and how.

EvalAI needs to publish a fresh and thorough API documentation. Perhaps this can be done in a more straight-forward manner by using Swagger with Django REST Framework, to automate the process.

@mrinalwahal thanks for opening the issue. This seems like a reasonable idea to have the REST API documentation available for general use. Right now, we have integrated DRF Docs for seeing API documentation during development only (you can visit http://localhost:8000/docs/ to see on your local development environment). 

We would love to expose the API documentation to the general public. If you are interested in working on this issue, please let us know. :) 

@deshraj sure I'm up for it.

@deshraj Thanks for the suggestion and we have already exposed the documentation to general public here https://evalapi.cloudcv.org/api-docs/ .

@mrinalwahal If you want to work on it then please help us in enhancing the documentation.

My bad. Thanks Rishabh for pointing out. Didn't realize that we exposed it long back. 😅 

Closing this issue.
Repository: Cloud-CV/EvalAI
Issue: ## [Warning] : Logged into multiple windows
Root cause: Unimplemented Feature Gap

# Warning : You may be disabled from previous logged in windows
A warning message should popped up when user attempts to log in into another browser window if he/she is already logged in into an existing window.
- [ ] Create warning before logging the user into existing window

@RishabhJain2018 If it's seems to be genuine issue to me. I would like to work on this.

@amanpro1 thanks for opening the issue but this behavior is something which is works fine and we would still keep it the way it is right now.
Repository: Cloud-CV/EvalAI
Issue: Requirements broken
Root cause: Configuration Error

This error was being thrown   
` File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
ImportError: No module named storages `

fixed by `pip install django-storages` Should this be added to requirements ? 

@gauthamzz I think you tried to run with the production config file, that's why you encountered this error. Can you tell me the command which threw this error?

python manage.py runserver 
It was working fine earlier.

It would have worked earlier but as we are making changes, it will break since the default settings is `settings.prod`. So, you will have to run the command `python manage.py runserver --settings=settings.dev`. 

Okay . Thanks
Repository: Cloud-CV/EvalAI
Issue: Add functionality to send slack notifications
GitHub labels: enhancement

easy_to_fix

backend

new-feature

priority-high

GSoC-2020

**Description:**
Some of the challenge hosts are curious to know when the submissions to their challenge are coming, hence they want to post on the slack channel whenever a new submission comes in.

**Deliverables:**
- [ ] Add a nullable with blank=True URL field in the Challenge model with the name `slack_webhook_url`.
- [ ] Add a migrations file for the same.
- [ ] Use the function from base/utils for sending slack notification.
- [ ] In the function `publish_submission_message` in `jobs/sender.py`, if there is a `slack_webhook_url` in the challenge model, then call the function in the above step with this URL after sending the message in the queue.
- [ ] Add required unit tests.


@RishabhJain2018 I'd like to work on it

Sure, @Ayukha. Thanks for picking it up.
Repository: Cloud-CV/EvalAI
Issue: Update contributing guidelines to recommend using Black instead of autopep8

The docs, i.e. https://evalai.readthedocs.io/en/latest/contribution.html recommend using autopep8 to format the code while the README has a [`Black`](https://black.readthedocs.io/en/stable/) tag. 
Appropriately replace the autopep8 part with instructions for Black.
Repository: Cloud-CV/EvalAI
Issue: Add models to disable/delete submissions
Root cause: Unimplemented Feature Gap

**Motivation**:
Some of the challenge hosts want to delete the 'canceled` submissions and the submission in which participants have uploaded non-standard submission files from their All Submissions view. Hence, we require this feature.

**Deliverables**:
- [ ] Add a boolean field `ignore_submission` with default as False in the Submissions model.
- [ ] Add migration file for the added models.

@RishabhJain2018 can I take this up?

sure, @Ayukha .

@Ayukha Please change the boolean field name to `ignore_submission`.
Repository: Cloud-CV/EvalAI
Issue: Make Browsable API endpoint to be served in development environment only 
GitHub labels: enhancement

GSOC-2019

easy_to_fix

backend

We want the browsable API urlpattern https://github.com/Cloud-CV/EvalAI/blob/master/evalai/urls.py#L45 to be only served in the development environment. 

can i try this?

@gauthamzz Sure, go ahead.

Fixed in #278
Repository: Cloud-CV/EvalAI
Issue: Tiles in Challenges List page not aligned properly
GitHub labels: bug

frontend

priority-high

GSoC-2020

- The Observed Behaviour: 
The Challenge Listing is not aligned properly
<img width="1280" alt="Screenshot 2020-05-03 at 4 10 08 PM" src="https://user-images.githubusercontent.com/3920286/80926919-cca33100-8db7-11ea-9f38-a6c384979330.png">
- Steps to reproduce the problem: Open https://evalai.cloudcv.org/web/challenges/list <br>
- OS: macOS Mojave<br>
- Browser: Firefox 75.0<br>
<br><br>
Thanks!


@Kajol-Kumari Would you like to wok on this?

sure @RishabhJain2018 sir.
Repository: Cloud-CV/EvalAI
Issue: Alignment in sponsors list 
GitHub labels: bug

easy_to_fix

frontend

GSoC-2020

 - the observed behaviour
 Sponsors list not Centrally aligned 
![Screenshot_20200504-063016~2](https://user-images.githubusercontent.com/19167324/80976955-b772e480-8e41-11ea-90a8-2dab249522e6.png)

- steps to reproduce the problem
 Open evalai.cloudcv.org in mobile view

Thanks @Ayukha for catching it. Would you like to work on this?

@RishabhJain2018 sure!

Weirdly, I can't see the images on my PC but it's visible on other devices 

![screenshot-evalai cloudcv org-2020 05 04-20_16_10](https://user-images.githubusercontent.com/19976688/80978781-23eee300-8e44-11ea-9cbb-2d2be1d8f5b4.png)


It's a cache issue. Can you please do a hard refresh.

Tried emptying cache and doing a hard refresh. Still the same issue 


I think it has something to do with the 'sponsor-logo' tag in CSS since after debugging and trying to remove the 'sponsor-logo' tag the images did appear. 

I think it's more of an issue with the current config of Nginx which caches the static files. Might want to look into nginx config and see what needs to be changed.

I think it's because of the css tag because the image does load and it did show up in the dev debug tools.
![screencast-evalai cloudcv org-2020 05 04-22_26_54](https://user-images.githubusercontent.com/19976688/80992123-ad0f1580-8e56-11ea-9446-113bbfb18bd6.gif)



![img](https://user-images.githubusercontent.com/19167324/80992710-8d2c2180-8e57-11ea-8428-bf8c4145df66.png)
 @yashdusing I am able to get the images with same css.
Can you specify the browser you are using?

I am using Chrome. I also checked the version and there's no pending updates 

I tried it on chrome and firefox both, it works fine for me.

It shows up on edge. Weirdly, the display issue only happens with chrome

I am fairly confident it's a cache issue. The fix is by looking and changing the nginx configuration appropriately to invalidate cache. :) 

Ok I was wrong. 😅 Turns out that this issue is related to the css getting overwritten by some other class. I believe @RishabhJain2018 is going to open a PR for the same soon. 

This is already fixed in #2790 :).
Closing this issue.
Repository: Cloud-CV/EvalAI
Issue: Challenge Participation Invitation in Development Mode
Root cause: Configuration Error

#### Current Behaviour:
Hitting the [invite_users_to_challenge](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1936) gives error of `Unable to find the sendgrid key` b'coz of [send_email](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L2014) method as the key accessible in production only.

#### Feature Requested:
Just like the `email verification` and `password-reset` there should be similar method for sending invitation of participation by the host.
Repository: Cloud-CV/EvalAI
Issue: Unordered list HTML tag <ul></ul> isn't getting rendered in evaluation details section
Root cause: Validation Gap

**Description**:
In the evaluation details section if a challenge host wants to render a `<ul></ul>` tag then it isn't getting rendered properly.


@Kajol-Kumari Can you please look into this?

sure @RishabhJain2018 sir.

@RishabhJain2018 @Sanji515 This issue is not only with `evaluation_detail_edit` but all the editing trix editors where angular-trix has been used i.e in `submission_guidelines_Edit`, `Terms_And_condition_Edit` etc. The trix-editor is working fine when i pasted it on plunker. So i thought maybe some .scss design is overwriting it. But even after removing all the styles from it. I am still just getting the blank space instead of bullet. Still can't figure out what is causing this problem. What am i missing?

okay.
Did you check by inputting the `<ul></ul>` manually in the HTML of overview, etc? I think it also doesn't get rendered from there.

> okay.
> Did you check by inputting the `<ul></ul>` manually in the HTML of overview, etc? I think it also doesn't get rendered from there.

Yes @RishabhJain2018, i had tried this too. In this case also only blank space is appearing instead of bullets.

I don't think you're missing anything and it is mostly the CSS override issue. Did you check in the console by removing the CSS to this `<ul></ul>` element?

> I don't think you're missing anything and it is mostly the CSS override issue. Did you check in the console by removing the CSS to this `<ul></ul>` element?

yes @RishabhJain2018 got the problem, CSS is being overridden. Thanks!
Repository: Cloud-CV/EvalAI
Issue: Create unique URL for each phase under My Submission and All Submissions Page
Root cause: Unimplemented Feature Gap

**Description**:
If a challenge has multiple phases and the host reloads the My submission page / All Submissions page then the selected phase changes to blank and it becomes inconvenient for the host to select the phase again from the list again.

**Fix**:
Create a unique link for each phase in My Submissions/All Submissions using the slug for the phase in the URL.

@Kajol-Kumari Can you please add this :)

> @Kajol-Kumari Can you please add this :)

Sure @RishabhJain2018 sir.
Repository: Cloud-CV/EvalAI
Issue: Installation error: nodejs failed to build
Root cause: Environment Incompatibility

- Expected behaviour: Installation EvalAI is successful
- Observed behaviour: Error
`Service 'nodejs' failed to build: The command '/bin/sh -c apt-get update && 	apt-get -y install gconf-service libasound2 libatk1.0-0 libc6 libcairo2libcups2 libdbus-1-3 libexpat1 libfontconfig1 libgcc1 libgconf-2-4 libgdk-pixbuf2.0-0 		libglib2.0-0 libgtk-3-0 libnspr4 libpango-1.0-0 libpangocairo-1.0-0 libstdc++6 libx11-6 		libx11-xcb1 libxcb1 libxcomposite1 libxcursor1 libxdamage1 libxext6 libxfixes3 libxi6 		libxrandr2 libxrender1 libxss1 libxtst6 ca-certificates fonts-liberation libappindicator1 		libnss3 lsb-release xdg-utils wget' returned a non-zero code: 100`
[installation_log.txt](https://github.com/Cloud-CV/EvalAI/files/4603232/installation_log.txt)
- Steps to reproduce the problem: 
1. Install Docker and Docker-compose
2. `git clone https://github.com/Cloud-CV/EvalAI.git evalai `
3. `cd evalai`
4. `docker-compose up --build`
- Operating system and Docker version
First setup: macOS Mojave 10.14.6, Docker version 2.2.0.5 (43884), Compose 1.24.4
Second setup: Windows 10 Pro 1909, Docker version 2.2.0.5 (43884), Compose 1.25.4




I fixed it using this correction in evalai/docker/dev/nodejs/Dockerfile
![image](https://user-images.githubusercontent.com/12996098/81476800-7b15fe80-921c-11ea-8c15-f97c73d3e80f.png)


Thanks @vpozdnyakov for reporting this.

Fix for this issue #2789