zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: UI Design: Log in and sign up page - To remove redundancy of  the password character limit
Root cause: Documentation Deficiency

**- the observed behaviour**
  Password field by default displays the character limit that minimum length of 8 is required. 
**- the expected behaviour**
  According to good UI design, I think it would redundant to include the character limit, when it is actually dynamically updating this behaviour when the character limit is less than 8 and this calls for redundancy.  
**- steps to reproduce the problem**
Look at the screenshot below 

1. Sign UP page

<img width="552" alt="Screenshot 2019-11-24 at 12 43 48 AM" src="https://user-images.githubusercontent.com/31419210/69483949-8bdfdd00-0e53-11ea-880d-fef81b1b1fc9.png">


 2. Login Page

<img width="596" alt="Screenshot 2019-11-24 at 12 37 46 AM" src="https://user-images.githubusercontent.com/31419210/69483911-05c39680-0e53-11ea-8202-cbfec451a83c.png">

The circled message in both these screenshots is not required as it is causing redundancy.

**System Requirements**
Browser: Safari 
OS : Mac



@vs74 thanks for reporting this. If you are interested in fixing this issue, please let me know.

@vkartik97, I would like to work on this. May I proceed ?

Sure!

I would also like to work on this so can i get the source of this page?

@ArcSlayer121 
Currently, @vs74 has been assigned to this issue. Feel free to look for other issues!

can i work on this issue?
Repository: Cloud-CV/EvalAI
Issue: UI fades out for few seconds and then fades in 

**The Observed Behaviour**
**GIF**
![ezgif com-video-to-gif](https://user-images.githubusercontent.com/31419210/69490542-b9f30a80-0eaf-11ea-8e35-a434d3476794.gif)

Here is a sample GIF wherein I tried to navigate between diff functionalists ( `AI Challenges`, `Hosted Challenge`s, `Create Challenge`). Notice when I click on `AI Challenges`, for a fraction of seconds the screen fades out and then it properly loads(fade in) the information on the web page. This behaviour is observed during first few seconds. Though I don't know what might the exact cause of the problem (perhaps response time, UI design or it might be the some effect or transition ) as I am not a expert in Web Development

**Steps to Reproduce the Problem**

1. Login in to EvalAI
2. Try Navigating between diff functionalities
3. You will notice for a few initial seconds fade out effect and then it fades in.

**Expected Behaviour**
1. If it's a bug, we should handle it. 

2. If this is probable effect which has been included in UI, I think it's better to reduce the delay between the fade in and fade out 


Hi @vs74 this is not an effect, just a loading screen waiting for api to getting finished. I guess somehow, loader is not showing up here. We can work on that. See other pages where you can see loader as well as fadeout screen.
Repository: Cloud-CV/EvalAI
Issue: Two links serving same purpose on same webpage

There is "All Challenges" two times on the same page.

- the expected behaviour
There is no need of having two ["All Challenges"](https://evalai.cloudcv.org/web/dashboard) on the same page as both are serving the same purpose. 
I understand that it could have made some sense if we were watching it NOT on desktop view only but still it doesn't go so well(here) as there remain two links to same page on the same webpage.

- the observed behaviour

checkout the screenshot below: 
![Screenshot from 2019-11-24 04-01-37](https://user-images.githubusercontent.com/47540976/69491276-e7908180-0eb8-11ea-9d4d-e6efb8affe03.png)
There should be one of them only.

- steps to reproduce the problem

    - Login/Signup 
    - Go to dashboard

- operating system and/or browser

    - Ubuntu , Firefox







Thanks!


This is fixed!
Repository: Cloud-CV/EvalAI
Issue: [Error Display] User logs in and email not verified.
Root cause: Validation Gap

- the expected behavior
Users should be asked to verify email first to start using EvalAI.
- the observed behavior
The message displayed is unable to create or select a team, and unknown comment as false as in the image
![unable](https://user-images.githubusercontent.com/21266230/69491814-5ae9c180-0ec0-11ea-80cf-1a6b68dbdb64.png)

- steps to reproduce the problem
1. Register a new account.
2. Login using the account without verifying.



Can I work on this issue @pushkalkatara ?

@pushkalkatara, is the problem observed on your local machine ? The reason I am asking is that user email and login are getting verified on the official website [here](https://evalai.cloudcv.org)


Yes i observed it on local host, in the terminal we get a link through which we can verify the account locally, but before that if user tries to login, the above error occurs.

@bismitaguha EvalAI maintainers can only assign the issues.

@RishabhJain2018 can I work on this?

@RishabhJain2018 can I work on this issue


@pushkalkatara There was an issue https://github.com/Cloud-CV/EvalAI/issues/1337 and a PR https://github.com/Cloud-CV/EvalAI/pull/2152 for it and was closed due to inactivity

Duplicate of #2504
Repository: Cloud-CV/EvalAI
Issue: [Tests] Add tests for updating leaderboard data API
Root cause: Unimplemented Feature Gap

Deliverables -
Add tests for the API added in this PR #2481 

@RishabhJain2018  Can I take this up?

Sure @Ayukha !

As this is still open, can I take this up?

@RishabhJain2018 Can I work on this issue?

@RishabhJain2018  as the issue is still open can I work on it?


Hii @RishabhJain2018 , is this issue is still open?
if this is Open, please assign to me.


@RishabhJain2018 please assign me.
Repository: Cloud-CV/EvalAI
Issue: Add ArgoAI as one of our users
GitHub labels: enhancement

easy_to_fix

frontend

good first issue

Add the logo for [ArgoAI](https://www.argo.ai/) alphabetically in the users list.

@RishabhJain2018 can I work on this?

sure!

@RishabhJain2018 Do we have to add the logo in the "Partner Organizations section"? Or In which specific section should I update this logo?

Hi @iamdarshshah, I think @yashdusing is working on it.

@yashdusing Any updates on this one?

@RishabhJain2018 is it okay if I complete this by week end ?

sure, sounds good!


Any updates on this issue?
Repository: Cloud-CV/EvalAI
Issue: Sidebar on Dashboard view is not working properly for Mobile view.
Root cause: Architectural Constraint

Currently sidebar is collapsing at ~640px but it should be collapsed at screensize<992 px.

@aka-jain can I fix this?

@RishabhJain2018 : Sure, assigning it to.

@aka-jain @deshraj I think this issue is soved. Please refer https://github.com/Cloud-CV/EvalAI/blob/master/frontend/src/css/modules/web.scss#L24 and https://github.com/Cloud-CV/EvalAI/blob/master/frontend/src/css/modules/variables.scss#L45

@RishabhJain2018 : Nope, sidebar is not getting collapse at 992px, only container is expanding.  Have a look at sidebar.

okk sure.

@RishabhJain2018 : I think you are working on 404 page. So let's make this issue free for other contributors. You can take it back after solving issue #290 
I hope it'll be Ok for you :)

@aka-jain yeah sure. no problem.

@aka-jain can I work ?

@anweshknayak : sure go ahead.

@aka-jain is anyone working on this? Or we are planning to do this in `v2`. If yes, please add a label of `v2`

Hi I am new here. can I claim this? and I have already submitted a [PR](https://github.com/Cloud-CV/EvalAI/pull/740) to fix it. 
Thanks

Sure @MAKOSCAFEE, will check your PR. Thanks :)

Fixed with #740
Repository: Cloud-CV/EvalAI
Issue: Mobile view header for Dashboard is not working properly.
Root cause: Unimplemented Feature Gap

Header of Dashboard view doesn't seem to be responsive. Need to fix that.

can I fix this too ?

sorry for asking this late. I solved this issue. can you review ?

@deshraj : Actually, I am not sure - Is this fixed now? 

@aka-jain is keeping track of this issue. Lets keep it open and let Akash make a decision on this. 

@spyshiv : do you want to work on this?

this issue is fixed. @aka-jain : please close this issue.

Fixed in #434. Closing it.
Repository: Cloud-CV/EvalAI
Issue: [Feature Request] How about we add a beginner dataset for users to get familiar with the interface?
Root cause: Unimplemented Feature Gap

I have been using Kaggle from a long time. And I realized that as a beginner, the [Titanic dataset](https://www.kaggle.com/c/titanic) competition helped me become familiar with their interface. I am relatively new to EvalAI and maybe some sample dataset such as the Titanic along with Tutorial instructions would be cool to have.
Maybe having a tutorial on MNIST dataset will be simple and helpful. It has been used in several tutorials as well. 
What do you think?

Yes, I think It will be great for newcomers

Can I contribute for this issue by creating a tutorial or something?


Why was this closed? Has such a tutorial been created?
Repository: Cloud-CV/EvalAI
Issue: make challenge tabs stick under navbar
GitHub labels: enhancement

frontend

good first issue

- the expected behaviour

 As we scroll down the ongoing challenges, upcoming challenges secs etc. stick the top under the navbar. Same as navbar sticks the top of screen. This will help improve the overall experience on the page.

![Peek 2019-12-11 21-58](https://user-images.githubusercontent.com/47540976/70640226-a55d9300-1c61-11ea-940d-bb646e01ad0c.gif)

- the observed behaviour
As we scroll down these sections too scroll along.
- steps to reproduce the problem
click the All challenges on homepage.

Thanks!


Can I take this issue?

@Saloni-Tayal As you have reported this issue, would you like to build this feature?

@sanji515 yes I want to build this feature. 

@Saloni-Tayal Looking forward to your PR.

Please wait @ShubhamPandey28 Will open more issues soon :smiley: 

I think no one is working on this?

@Saloni-Tayal are you still working on this?


@Saloni-Tayal are you working on this issue? if not, @Sanji515 can I take this issue up? 

Hey @RishabhJain2018 I think after adding tabs, we won't need this anymore. I had opened a PR for adding tabs in EvalAI [#2668](https://github.com/Cloud-CV/EvalAI/pull/2668)

Is this still open?
Repository: Cloud-CV/EvalAI
Issue: how to verify my email
Root cause: Documentation Deficiency

when I enter the url:https://evalai.cloudcv.org/ and sign in my account.
There is a dialog box pops up:
Unable to create or select a team.
Please verify your email first!

@UPCLJ when you sign up, you will receive an email like this from `no-reply@cloudcv.org`:

> Hello from EvalAI!
> 
> You're receiving this e-mail because user "UserName" was registered at evalai.cloudcv.org under this e-mail address.
> 
> To verify your registration, please go to https://evalapi.cloudcv.org/api/auth/registration/account-confirm-email/<your_unique_token>/
> 
> Thank you from EvalAI!
> evalai.cloudcv.org

If you visit the link mentioned, you can login directly through https://evalai.cloudcv.org/auth/login


@nikochiko @UPCLJ I think this issue is the case if a user loses verification email without verifying the link then neither user will be able to verify his account nor create a new account with the same email address.

If I'm right then this is the duplicate of #2122 

Is this issue still open? I would like to work on this @nikochiko 

Duplicate of #2486, hence closing it.
Repository: Cloud-CV/EvalAI
Issue: Insecure requirement: uWSGI
Root cause: External Dependency Breakage

#### Description of the issue:
The version of uWSGI used by EvalAI (2.0.15) is insecure and should be updated to 2.0.18 
See: https://requires.io/github/Cloud-CV/EvalAI/requirements/?branch=master
![uWSGI-insecure](https://user-images.githubusercontent.com/37668193/70715171-ba90fb00-1d0f-11ea-9977-8d873e7522d2.PNG)

#### How to resolve:
1. Update package on your branch
2. Make API changes if any
3. Make a PR and fix Travis-CI failures
4. Test it and update the code if possible


Do I only need to update this particular package on mine branch and make a pull request to close this issue?
I am willing to contribute for this organization and also new here so just asking to confirm..

@veb7vmehra Please wait for one of the project maintainers to respond. Then they can decide if this is required and assign the task. 
But this should be the basic steps:
1. Update package on your branch
2. Make API changes if any
3. Make a PR and fix Travis-CI failures
4. Test it and update the code if possible

Duplicate of #2564
Repository: Cloud-CV/EvalAI
Issue: [Docs] Documentation for making a submission
Root cause: Documentation Deficiency

Reference: https://evalai.readthedocs.io/en/latest

I wanted to find steps on how to make a submission, but I think it is not there in the docs (please correct me if I am missing something). 
The [submissions section](https://evalai.readthedocs.io/en/latest/submission.html) only covers how the submission proceeds, it does not guide through the submission process.
I think there should be a documentation to explain the contents of zip, json and txt file when uploading file for submission and also a documentation for uploading file with URL.

@nikochiko i would like to work on this, can you assign it to me?

@adrijshikhar Sure! Go ahead

This is challenge specific and each challenge host needs to mention their own format.
Repository: Cloud-CV/EvalAI
Issue: [Feature Request] Sync accounts for EvalAI and EvalAI-forum

Currently, if an account is created on [EvalAI](https://evalai.cloudcv.org), the same account cannot be used to login into [EvalAI-forum](https://evalai-forum.cloudcv.org).
I think it will be easier for users to have to create just one account and use it for both as both are part of one project. 
Also as a note, the forum has functionality to accept registrations through GitHub and Google other than with Email which is not present in EvalAI.

I would like to work on to add the functionality to accept registrations through GitHub and google in EvalAI. Can I proceed?

@ataata107 I cannot assign the task. Please wait till the project maintainers decide whether this feature should be added or not and then they can assign it. :)

This isn't on the project roadmap for now.
Repository: Cloud-CV/EvalAI
Issue: Edit Host Competition button on home page
GitHub labels: bug

GSOC-2019

easy_to_fix

frontend

In home page there is a button for Host Competition. We have to replace it with "View Challenge" button and redirect it to challenge page (url : /web/challenge-page/overview)

Im on it. 

@aka-jain this feature is applicable for both the users who are logged in and who are not. ?

Just add URL of challenge page, it will automatically handle authentication. 
p.s Only logged in user can visit this page.

Closing this issue, need some discussion.
Repository: Cloud-CV/EvalAI
Issue: [Feature Request] Add feature to see challenges which the user has participated in.
Root cause: Unimplemented Feature Gap

Currently, there is no way to get a list of all challenges in which the user has participated. (Except for using CLI which has that feature) It would be a good addition here as well.

@RishabhJain2018  can I work on this?


hi @nikochiko. I am a newbie here. I want to work on this. Please help me to figure out which part code should I look for working on this. Thanks!

@RishabhJain2018  Can i work on it?

Closing this as it is opened [here](https://github.com/Cloud-CV/EvalAI/issues/2698) now.
Repository: Cloud-CV/EvalAI
Issue: Setting up developer environment fails: celery and worker throw errors, celery stops running
Root cause: Configuration Error

As @masonlr pointed out on Gitter, the celery is throwing an error.
See: https://travis-ci.com/nikochiko/evalai-cli/jobs/267038723#L4381 line 4381, a similar error occurred while I tried to setup the server in a Travis VM.

OS: Ubuntu 16.04 Xenial

I think the cause is that Django wasn't up at `localhost:8000` in time.
@Ram81 pointed out that it could be because of an incorrect hostname for django due to the container name, but the hostname is defined explicitly in the [Dockerfile](https://github.com/Cloud-CV/EvalAI/blob/master/docker-compose.yml#L16).
Maybe `wait-for-it.sh` is malfunctioning?

In https://travis-ci.com/nikochiko/evalai-cli/jobs/267038723#L4381 Line 4373 is the main cause of the issue. You can easily get rid of this issue if you provide your aws credentials(first 4 lines) in the [Docker Environment](../blob/master/docker/dev/docker.env). 
Hope this helps :)

@ataata107, are AWS credentials required even if the `pakohan/elasticmq` container is being used to replace SQS in development mode? When testing https://github.com/Cloud-CV/EvalAI-ngx, the containers run (and elasticmq works) without having to add personal AWS credentials. The default credentials in https://github.com/Cloud-CV/EvalAI-ngx/blob/master/docker/dev/docker.env work.

Could you please describe what the intent is here in dev mode? Are personal AWS credentials required or are the default credentials in https://github.com/Cloud-CV/EvalAI/blob/master/docker/dev/docker.env meant to be sufficient?

I guess celery doesn't support elasticmq yet so that might be what's causing the problem for dev env.
I'll try setting up a separate example to check if it is actually the case 
Reference : https://github.com/celery/celery/issues/5406

#2593 solves this. This issue can be closed

Until #2593 has been merged, @nikochiko could you please re-open this issue?

Also @nikochiko, thanks for the dramatiq changes!

@masonlr I think that's right, I'll wait for it to be merged. :+1:

Closing this since it is a very old issue.
Repository: Cloud-CV/EvalAI
Issue: Auth token cannot be renewed
Root cause: Unimplemented Feature Gap

**Current Scenario:**
Once an auth token is generated, it cannot be renewed. So if my auth token is compromised, my account is permanently compromised.

**Expected Scenario:**
There should be an option to refresh auth token. This will generate a new auth token and associate it with that account to prevent an account from being compromised permanently.

P.S. If the maintainers say this feature should be added, I would like to work on it.

Edit:
This issue looks like a duplicate of closed https://github.com/Cloud-CV/EvalAI/issues/1814 by @vkartik97 
This unmerged PR seems to be the solution: https://github.com/Cloud-CV/EvalAI/pull/1895 The Travis build is failing only because of flake8 errors.
Repository: Cloud-CV/EvalAI
Issue: [code] Improve code structure for `submission_worker.py` and `remote_submission_worker.py`.

#### Current:
The `submission_worker` and `remote_submission_worker` have a lot in common currently. Naturally, if a change happens in the future, code in both files will have to be edited. 
In addition to that, many functions are very much exactly the same.
Moreover, within each file, there is repetition of code, e.g.: the `download_and_extract_file` and `download_and_extract_zip_file` use the same code for the downloading part.

#### Expected:
The code should be modularized and helper methods / utils should be created accessible to both the workers. This will:
* allow easy updates in the future
* make the code more readable
* tests can be made more effective / independent of the specific modules used. e.g., for testing if a file has been asked for downloading, a util function `download_file` can be mocked rather than having to mock `requests.get` which may change in the future if we switch the library used. 

#### Objective of resolving PR:
* Analyze the code, find reused / utility code.
* Make utils accessible to both
* Keep required changes in the main code to a minimum
* Try to keep required edits in the corresponding tests to a minimum.


@RishabhJain2018 @Ram81 This is my suggestion, please let me know if a PR for this is required. (I am also a GCI participant, so it would be great to have this as a task :D)

Is this problem up for grabs?
Repository: Cloud-CV/EvalAI
Issue: [code] Create common methods for fetching environment variables 

#### Current: 
The code for fetching environment variables is repeated in [`remote_submission_worker.py`](https://github.com/Cloud-CV/evalai/blob/master/scripts/workers/remote_submission_worker.py#L28-L31) and [`rl_submission_worker.py`](https://github.com/Cloud-CV/EvalAI/blob/master/scripts/workers/rl_submission_worker.py#L26-L31).
So in the future, if additional environment variables are used, the changes would have to be made in both places.

#### Proposing:
A common mechanism be used to extract / assign them.
#### A possible solution: 
Creating a `class EnvironmentVariables` > fetching the environment variables > binding the variables to the class
<br>
@RishabhJain2018 @Ram81 Please let me know if this can be a good change. I would like to work on this, + a GCI task on this would be cool!

Duplicate of #2542
Repository: Cloud-CV/EvalAI
Issue: [code] Common method to create module level constants for worker files

#### Currently:
The code to create module level constants like `CHALLENGE_DATA_DIR`, `SUBMISSION_DATA_DIR` is the same for both [`submission_worker.py`](https://github.com/Cloud-CV/EvalAI/blob/master/scripts/workers/submission_worker.py#L56-L72) and [`remote_submission_worker.py`](https://github.com/Cloud-CV/evalai/blob/master/scripts/workers/remote_submission_worker.py#L33-L44). 
It only differs in that they both depend on a temporary base directory, the rest of the directory structure is the same.

#### Proposing:
A common mechanism be used to generate all the module level constants in both files. This way changes will be consistent throughout the codebase.

#### Possible solution:
Create a `class Constants` > generate temporary file > compute corresponding structure > bind these constants to the instance
<br>
@RishabhJain2018 @Ram81 is this addition useful? 
if yes, I would like to work on it :)

Duplicate of #2542
Repository: Cloud-CV/EvalAI
Issue: [docs, urgent] Update CrowdAI status

The comparison table in the readme shows crowdAI, but according to this [blog post](https://www.crowdai.org/blogs/7), crowdAI has been shut down and replaced with a new closed-source platform AIcrowd.
Updates:
1. Change name CrowdAI -> AICrowd
2. Change open-source Yes -> No

Hey @nikochiko 
I would like to take up this issue. 

@apoorvkhare07 I'm not a maintainer but I don't think they will mind for a doc update, so sure! :+1:

@nikochiko @apoorvkhare07 
https://github.com/Cloud-CV/EvalAI-ngx/pull/245 
This is for Eval AI Angular Frontend, not for CrowdAI :smiley: 

@prakhargurunani Yes I know. But I think you misunderstood this issue. The problem mentioned here is that the status of the organization CrowdAI in the comparison table is outdated. You have implemented the same outdated comparison table in your PR.  

Ok @nikochiko 
I will make the changes.
Repository: Cloud-CV/EvalAI
Issue: [docs] Update FAQs which recommend Python 2.7
Root cause: Documentation Deficiency

Links with the issue: 
1. https://github.com/Cloud-CV/EvalAI/blob/master/docs/source/faq(developers).md#q-getting-the-following-error-while-running-python-managepy-seed :
    * Recommends using Python 2.7 as a solution
2. https://github.com/Cloud-CV/EvalAI/blob/master/docs/source/faq(developers).md#q-while-trying-to-install-npm-config-set-proxy-httpproxyport-on-ubuntu-i-get-the-following-error : 
    * Example output uses python 2.7

Refer: https://www.python.org/doc/sunset-python-2/ Python 2 will reach it's end-of-life on 1 January 2020
More issues could be found upon a more thorough look.

@nikochiko is this issue still open?
i would like to work on this.


Closing this since it is a very old issue.