zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: `leaderboard_decimal_precision` and `is_leaderboard_order_descending` cannot be set from `challenge_config.yaml`
Root cause: Configuration Error

I've been testing a challenge on an local EvalAI clone but have been unable to properly set `leaderboard_decimal_precision` and `is_leaderboard_order_descending` from my `challenge_config.yaml`.

**Expected behaviour**
Altering `leaderboard_decimal_precision` and `is_leaderboard_order_descending` should be reflected in the leaderboards on EvalAI.

**Observed behaviour**
Regardless of the values of those fields, all leaderboards have a decimal precision of 2 and are sorted in descending order. Manually setting these fields from the Django admin page does result in the expected leaderboard layout, though.

**Steps to reproduce the problem**
Clone [EvalAI-Starters](https://github.com/Cloud-CV/EvalAI-Starters), edit those two fields in `challenge_phase_splits` in `challenge_config.yaml`, run `./run.sh`, upload to a local EvalAI clone, make dummy submissions, and view the leaderboard.

Is this an issue with EvalAI or could there be something wrong on my end?

Hi @felixp8,

Thanks for reaching out. This doesn't use to happen with EvalAI earlier, but we can check and get back to you.
cc: @Ram81 

I have exactly the same problem. Is there any update to solve this issue?

Hello all! I have the same problem for [this leaderboard](https://eval.ai/web/challenges/challenge-page/1111/leaderboard/2862) and [this one](https://eval.ai/web/challenges/challenge-page/1111/leaderboard/3428). I set my precision to 4 via the config, but the leaderboard is still 2.

Hi @felixp8 @seokhwankim @rcannood,

Thanks for pointing out the issue. We are working on fixing it. We will update on this thread once we have released a fix.

Hi @Ram81 Is there any update on this bug fix?
Repository: Cloud-CV/EvalAI
Issue: Database backup quickly growing until eating up all space 

We created a local EvalAI server and it runs well until we encountered no space errors. We found there are over one hundred of large files under `docker/volumnes/xxxxxxxxxxx/_data/12994/758505.*`... It seems to be some backup files for a same entry 758505. Can you help on this and is there a way to avoid these backup files? Thank you!


HI @scorpionsky,

Thanks for reaching out. Could you please give me a bit more context on how you are running the dockers, i.e. using the development setup or the production setup?

Closing the issue due to inactivity
Repository: Cloud-CV/EvalAI
Issue: Redesign 404 page for Clientside.

Need to redesign a 404 page as shown in the given attachment. 
In case of any help or requirement, let me know.
(use evalai.cloudcv.org as a link to redirect user to homepage)
![eval-404](https://cloud.githubusercontent.com/assets/11537940/21596089/36beb6e8-d15c-11e6-9c44-095a7a6c050a.png)


Suggestions are also welcome related to design.
One can also use some AI related image or robot image in place of owl because our platform is based on AI and it will be good if we go for the same (evalAi) :D :)
(make sure that image shouldn't contain any copyright issue)

@aka-jain Can You assign this to me ?

@Ram81 : let PR #314 be merged, then you can start working on this.

@Ram81: You can work on this now. Please be ready with the updated code

@Ram81 : PFA of image of OWL.
![owl](https://cloud.githubusercontent.com/assets/11537940/21653385/d29e1646-d2d6-11e6-92ee-5954fd0ee795.png)


@aka-jain  I will add it. :+1: 

Closing it, fix with #359
Repository: Cloud-CV/EvalAI
Issue: Remove shadow from view button on leaderboard page
GitHub labels: frontend

good first issue

GSOC-2021

### Description

Remove the shadow from view button on leaderboard page to make it consistent with EvalAI UI. Screenshot below shows the current style.

![Screen Shot 2021-01-29 at 10 50 32 AM](https://user-images.githubusercontent.com/16323427/106392240-fa84d700-6416-11eb-9306-4f4ce3c55b06.png)
Repository: Cloud-CV/EvalAI
Issue: [FrontendV2] Item on every navbar page is floating towards right in  for screen width more than 1440px

Frontend v2 is unoptimized for screen width greater than 1440px.

Item on Participant challenges navbar page is floating towards right in  for screen width more than 1440px, Same behaviour can be seen under in all navbar page section.

Please look at following image for better understanding.
![Screenshot from 2021-02-01 21-22-09](https://user-images.githubusercontent.com/57143358/106642510-6fd6e000-65ae-11eb-89f4-aef17d3ac9b6.png)

Frontend v2 is unoptimized for screen width greater than 1440px

@Alabhya268 Do you want to work on this issue? If yes, then please feel free to take this up.

> @Alabhya268 Do you want to work on this issue? If yes, then please feel free to take this up.

@RishabhJain2018, I would like to work on this.
Assign me please
Repository: Cloud-CV/EvalAI
Issue: this.logger is not defined in challengesettings.component.ts
Root cause: Validation Gap

`this.logger` is not defined in [`challengesettings.component.ts`](https://github.com/Cloud-CV/EvalAI/blob/master/frontend_v2/src/app/components/challenge/challengesettings/challengesettings.component.ts)
It causes the `frontend_v2` compilation to fail.

#### Expected Behaviour:
Build to compile successfully.

#### Observed Behaviour:
Compilation fails for `frontend_v2`

LOGS:
```
ERROR in src/app/components/challenge/challengesettings/challengesettings.component.ts(530,22): error TS2339: Property 'logger' does not exist on type 'ChallengesettingsComponent'.
ℹ ｢wdm｣: Failed to compile.
```

#### Steps to reproduce:
1. run `docker-compose up`
2. Check `frontend_v2` logs

**I would like to work on this issue. Thanks**
Repository: Cloud-CV/EvalAI
Issue: [FrontendV2] Buttons are not easily clickable in Get Auth Token at /profile

**Cancel**, **Download JSON** and **Refresh Token** buttons are not easily clickable in **Get Your Auth Token** Modal at `/profile`.

In order to click the above mentioned buttons, one needs to click precisely right below the button instead of clicking on them.
This problem becomes adverse in mobile screens.

If you'd like to report a bug, please include the following information:
#### Expected behaviour
Buttons should be easily clickable.

#### Observed behaviour
The button is not clickable even when you hover on them.
![image](https://user-images.githubusercontent.com/31778302/106770721-3e205080-6664-11eb-9ff7-f1d470699268.png)

### Steps to reproduce the problem
1. Go to `/profile` on the frontend.
2. Click **Get your Auth Token**.
3. Hover over **Cancel**, **Download JSON**, or **Refresh Token** button.

**I would like to work on this issue. Thanks**


Thanks @ShauryaAg for creating this issue
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix spacing of get auth token dialog
GitHub labels: frontend_v2

GSOC-2021

### Description

The spacing in the `Get your Auth Token` modal is inconsistent. The token appears to be floating because of too much space in the text box. The spacing shouldn't be this big. 

Refer the following gif:

![dummy](https://user-images.githubusercontent.com/16323427/106896896-30c49e00-6718-11eb-8875-1b7e654c1f75.gif)



@Ram81 I would like to work on this.
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix inconsistent padding on Submit page
GitHub labels: frontend_v2

GSOC-2021

### Description

The padding for the list of phases and submission meta attributes is inconsistent on the challenge submit page. It should be the same for the whole page.

Refer the screenshot:

<img width="1440" alt="Screen Shot 2021-02-03 at 4 59 36 PM" src="https://user-images.githubusercontent.com/16323427/106897118-81d49200-6718-11eb-9df0-12f0b9e1e3ba.png">


@Ram81  , Could you please explain more precisely as to what needs to be done?

Hi @Alabhya268 , the alignment of file upload and submission metadata components is incorrect in frontend v2. It should be same as current version. Please see this screenshot for reference.

![Screen Shot 2021-02-04 at 8 01 58 PM](https://user-images.githubusercontent.com/16323427/106907209-04af1a00-6724-11eb-8387-4bdeecddf0e5.png)
 

Thanks @Ram81 , I would like to work on this issue.

@Ram81 , I've PR for this , Please a have look on #3220 .
Repository: Cloud-CV/EvalAI
Issue: [Backend] Add tests for GET/PATCH/DELETE allowed_email_ids APIs
GitHub labels: backend

GSOC-2021

### Description

PR #3194 adds an API to get, append and delete email ids allowed to participate in a challenge phase. The PR is missing tests. We need to add tests to fetch, append a set of email ids and delete existing email ids from `allowed_email_ids` field.

Hey can i take it up ?

@codeboy5 sure, go ahead. PR #3194 will be merged tonight, till then you could pull the PR branch and go through the codebase.

Can I work on this issue?

@cgoxo sure, go ahead.

Sorry for a beginner question, what is adding a test for some API?

I was talking about this issue how to proceed!
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix padding of select phase placeholder on All submissions and My submissions page
GitHub labels: frontend_v2

GSOC-2021

### Description

The padding of the placeholder `Select Phase` is inconsistent in the dropdown on All Submissions page. Following screenshots show the current style :

No phase is selected:

<img width="1440" alt="Screen Shot 2021-02-04 at 7 19 03 PM" src="https://user-images.githubusercontent.com/16323427/106901840-3329f680-671e-11eb-84f3-8c365c131ed1.png">


Phase selected:

<img width="1440" alt="Screen Shot 2021-02-04 at 7 19 28 PM" src="https://user-images.githubusercontent.com/16323427/106901865-38874100-671e-11eb-96ab-952cb0290006.png">

Padding is expected to be same for both placeholder text and selected phase name in the dropdown. Same issue occurs on the `My Submissions` page.

Can I work on it?

@gautamjajoo Sure, assigning issue to you.

@gautamjajoo , Are you working on this, If not  @Ram81  could you please assign this issue to me.

@Ram81 Actually my end semester exams are going on so cannot resolve the issues. After this Sunday will start working on them once again.

@Alabhya268 sure, you can work on this issue. 

@gautamjajoo please pick up another issue once you are available.

@Alabhya268 are you working on this? If not, can I work on it @Ram81 ?

@lovesh12 , I have open a PR for this issue, it has been already approved. Feel free to take up any other issue. 

#3294 fixes this issue.

@Alabhya268 sorry, mybad
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix padding of select phase placeholder on Leaderbord page
GitHub labels: frontend_v2

GSOC-2021

### Description

The padding of the placeholder `Challeng Phase` is inconsistent in the dropdown on Leaderboard page. Following screenshots show the current style :

No phase is selected:
<img width="1440" alt="Screen Shot 2021-02-04 at 7 27 15 PM" src="https://user-images.githubusercontent.com/16323427/106902584-032f2300-671f-11eb-91bd-f423a9bc6abd.png">

Phase selected:

<img width="1440" alt="Screen Shot 2021-02-04 at 7 27 18 PM" src="https://user-images.githubusercontent.com/16323427/106902605-088c6d80-671f-11eb-8a8e-f247028580f3.png">


Padding is expected to be same for both placeholder text and selected phase name in the dropdown.
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix edit button alignment on Evaluation page
GitHub labels: frontend_v2

GSOC-2021

### Description

<img width="1440" alt="Screen Shot 2021-02-04 at 7 28 25 PM" src="https://user-images.githubusercontent.com/16323427/106902852-4ab5af00-671f-11eb-908a-2dc1a33d3d18.png">

The  `Edit` buttons are misaligned for `Evaluation` and `Terms and Conditions` cards. We should move `Edit` buttons next to `Upload` button on `Evaluation` card and make sure buttons are aligned between cards.

@Ram81, may I please take up this issue?

@burnerlee Sure, go ahead

@Ram81 #3218 made for the same

Closing the issue as #3218 is merged
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix Private tag alignment on Leaderboard page
GitHub labels: frontend_v2

GSOC-2021

### Description

<img width="1000" alt="Screenshot_2020-10-11_at_11 30 29_AM" src="https://user-images.githubusercontent.com/16323427/106905090-ef38f080-6721-11eb-900f-3cc599afa6e3.png">

The private tag for a phase split is misaligned. It should appear next to the challenge phase split name itself and not downwards.


@Ram81 I have done the necessary changes. Please take a look,
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] P tag should not appear for private leaderboards
Root cause: Validation Gap

### Description

<img width="1000" alt="Screenshot_2020-10-11_at_11 38 42_AM" src="https://user-images.githubusercontent.com/16323427/106905953-b3eaf180-6722-11eb-90ce-7e48fcfef12c.png">

P tag should not appear for submissions on the private leaderboards. And change column `Last Submitted At` to `Submitted At` on the leaderboard

@Ram81 may I take up this issue?

using the selectedPhaseSplit in the file, I am able to access the challenge_phase's id but not the leaderboard_public property in angular. I saw some solutions for this. Am I allowed to make some change in the serializer to achieve this?

@Ram81 ping^

@Ram81 ping

@burnerlee sure, adding fields to serializer is fine

@burnerlee any updates on this issue?

@Ram81 sorry for the delay, completely slipped off my mind. Made a PR for the same. During resolving this, I found another error. I'll open it up in the issues section
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Size of team name filter and team list cards should be same
GitHub labels: frontend_v2

GSOC-2021

### Description

<img width="1440" alt="Screen Shot 2021-02-04 at 7 56 12 PM" src="https://user-images.githubusercontent.com/16323427/106906437-2cea4900-6723-11eb-8cd1-a3beac8c071d.png">

The size of the team name filter component and team list cards should be the same


@Ram81 , I've attached PR for this, Please have a look.
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix alignment of private phase details on the submite page
GitHub labels: frontend_v2

GSOC-2021

### Description

<img width="1440" alt="Screen Shot 2021-02-04 at 7 51 22 PM" src="https://user-images.githubusercontent.com/16323427/106906667-6c189a00-6723-11eb-8856-91c94d32ec9d.png">

If a challenge phase is private the challenge details appear misaligned. The alignment style should be the same for all phases on Submit page irrespective of phase type/visibility.
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Add option to set submission visibility on Submit page
Root cause: Unimplemented Feature Gap

### Description

In current EvalAI frontend we allow user to specify submission visibility on the `Submit` page. This feature is not present in frontend v2. We need to add an option on the Submit page in frontend v2 to allow users to submit submission visibility (i.e. public/private)

Please the screenshot of current version:

![Screen Shot 2021-02-04 at 8 01 58 PM](https://user-images.githubusercontent.com/16323427/106907482-4dff6980-6724-11eb-97ab-48222cf26c7b.png)


@Ram81 , I would like to work on this issue .
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Fix alignment for Precision Value buttons on leaderboard

Leaderboard Precision value `-` and `+` buttons are not properly aligned for **Screen size < 375px**
![image](https://user-images.githubusercontent.com/31778302/107059790-3c899080-67fc-11eb-846a-8021c8a9bef8.png)


##### I would like to work on this issue.
Repository: Cloud-CV/EvalAI
Issue: Dataset management?

Hello Eval.Ai people!

I'm writing to ask about dataset management. So far, datasets are organized manually, which reduces the overall usefulness of the platform. The clear examples of what I'm suggesting are OpenML [1] and Kaggle [2] dataset management. The possibility to fetch the data from the challenge with something akin to an api key, and being able to log such downloads by the challengers, and control bandwidth, would be most welcome. 

[1] https://www.openml.org/search?type=data
[2] https://www.kaggle.com/datasets

Thanks for the request @surak but at the moment this is not on our roadmap. Hence, closing this issue.
Repository: Cloud-CV/EvalAI
Issue: Change `created_by` field from integer to username in `api/hosts/challenge_host_team/` API endpoint
Root cause: Configuration Error


can i try?

Sure. Go ahead. 

@gauthamzz are you working on it? If yes, can you please do it quicker since we need to fix it soon. 

@deshraj I'm trying but something is wrong with testing it . cos of proxy . ill try to do it fast 

I'm getting an error Value: Unable to parse connection string: ""

btw can you give me some hints 

Oh wait, I know this error. We recently integrated memcache backend with the codebase so you hace to include those settings. Please re-copy the `dev.sample.py` to `dev.py` since there are new changes in there. 

Its working now . 

the dev.sample.py needs to be fixed it has an issue

Can you tell me that what was the issue?

This was how it was supposed to look 

'default': {
'ENGINE': 'django.db.backends.postgresql_psycopg2',
'NAME': 'evalai',
'USER': 'your username',
'PASSWORD': 'your password',
'HOST': 'localhost',
'PORT': '5432',
}

but the field password is not there and field NAME is not equal to EVALAI @deshraj #357 

close this ?

Thanks @gauthamzz  :-)
Repository: Cloud-CV/EvalAI
Issue: [Frontendv2] Overlapping issues in Challenge detail section for screen width more than 1440px.

![Screenshot from 2021-02-14 10-02-56](https://user-images.githubusercontent.com/57143358/107868687-4ff7c400-6eac-11eb-82fe-35029158942e.png)
![Screenshot from 2021-02-14 10-06-22](https://user-images.githubusercontent.com/57143358/107868688-51c18780-6eac-11eb-8a36-67b7ba5e7613.png)


I would like to work on this.

Issue will be fixed with #3203.
Repository: Cloud-CV/EvalAI
Issue: [Frontendv2] Dynamically changing web container width with screen width.

Currently width of web container does not change dynamically with screen width greater than 768p and number of challenge card are also fixed .

![now](https://user-images.githubusercontent.com/57143358/107871714-19c93d00-6eca-11eb-9b36-618a9897509d.png)


I can make it dynamic like this - 


![after](https://user-images.githubusercontent.com/57143358/107871683-e090cd00-6ec9-11eb-82c1-7fcb6e132e88.png)
![after2](https://user-images.githubusercontent.com/57143358/107871686-e5558100-6ec9-11eb-9553-399b7e9182b1.png)

But, First #3203(already approved) needs to be merged as few of those changes are required for PR to fix this issue.


@Ram81 @RishabhJain2018 ,I want to work on this issue, Please assign it to me.
Repository: Cloud-CV/EvalAI
Issue: [Frontendv2] Unapproved challenge card chips has no padding at bottom.

"Not Published" chip in challenge card has no padding at bottom.

![unapproved](https://user-images.githubusercontent.com/57143358/107871795-cc010480-6eca-11eb-981d-2827d37551ff.png)


@Ram81 @RishabhJain2018 , I want to work on this issue.

Closing this since we are not working on Frontend_v2
Repository: Cloud-CV/EvalAI
Issue: [Frontend_v2] Input field colors changes to white after autofill

Input Field color changes to white after autofill in `template-challenge-create`

If you'd like to report a bug, please include the following information:
#### The expected behaviour
color should remain `black`
#### The observed behaviour
color changes to `white` after autofill

#### Steps to reproduce the problem
1. Create a new challenge using a template
2. Use autocomplete to fill `Challenge Title` or `Challenge Description` field
3. Observe

Refer to the GIF below for additional context:
![localhost_4200_template-challenge-create_1_1_gif](https://user-images.githubusercontent.com/31778302/107873338-c8c04580-6ed7-11eb-960e-8066496eae7d.gif)

**I would like to work on this issue.**


@Ram81 Is this behavior by choice and expected? 

Seems like it is from this code spinnet:

https://github.com/Cloud-CV/EvalAI/blob/5a5c28abb7687a82e18379e0f02a02d3748d1bf8/frontend_v2/src/styles/base.scss#L1625-L1633

@ShauryaAg no, this is not the expected behavior. If you are interested you could pick this issue. Thanks for reporting it 🙂 

@Ram81 Sure, I would like to work on this issue.

@ShauryaAg sure, go ahead. Also, it would be good if you look at the comments on this [PR](https://github.com/Cloud-CV/EvalAI/pull/3234) 

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: Backend: Submit page on EvalAI for code upload challenges shows old auth token
Root cause: Configuration Error

**Issue**: Since we recently changed to JWT auth token, the submit page for code upload challenges on EvalAI still shows the old token.
![image](https://user-images.githubusercontent.com/12206047/108097490-2d9eab80-7050-11eb-9f31-1f3b0be74361.png)

**Fix**:
- [x] Replace the current auth token with the  new token.

@RishabhJain2018 May I take this?

Hey @ShauryaAg , Yes you can take this up. Please note that this is `high priority` issue.

Sure. I'll get it done as soon as possible.
Repository: Cloud-CV/EvalAI
Issue: [Frontendv1] Dynamic width for web container.

Width of container in not dynamic, hence challenge list grid always show only 4 items in row and footer does not use full width in wider screen width.

For better understanding see following screenshots -

All screenshots are taken in screenwidth 1080p.

![before1](https://user-images.githubusercontent.com/57143358/108620392-f5350e00-7451-11eb-868f-474d1c866f15.png)
![before2](https://user-images.githubusercontent.com/57143358/108620394-f6fed180-7451-11eb-9712-df26e5175ccd.png)
![before3](https://user-images.githubusercontent.com/57143358/108620395-f7976800-7451-11eb-9957-3122b5bae04a.png)
![before4](https://user-images.githubusercontent.com/57143358/108620396-f7976800-7451-11eb-9b42-83f8a57cf5d1.png)



@RishabhJain2018 I want to work on this issue .

Hi @Alabhya268,
Thank you for the effort but it is a design choice. We actually don't want to make the challenge cards scale dynamically. We would like to keep it centered only.

Please feel free to pick up another issue. Also, please be on the lookout as @Ram81 will open more issues in the next few days.
Repository: Cloud-CV/EvalAI
Issue: [Backend] Add submission meta attributes in All submissions download API
Root cause: Unimplemented Feature Gap

### Description

Currently, in `download_all_submissions` API we don't add `submission_meta_attributes`.  The `download_all_submissions` API should also add `submission_meta_attributes` in the response data. You can find the API [here](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/views.py#L1747). 

@Ram81 could you please more elaborate this issue ? 
Thanks in advance.

Can I take up this issue?

@Alabhya268 the `download_all_submissions` API allows challenge hosts to download the submissions as a csv. In this csv we provide submission details like score, participant team, submission metadata (method name, description, etc). Recently we added a feature to allow challenge hosts to ask for additional metadata attributes when a participant makes a submission. Participant can fill this data when making a new submission. Now when host tries to download submissions using the `download_all_submissions` API they don't get additional submission metadata attributes in the result csv. This issue is for adding the feature to add submission meta data attributes in the result of `download_all_submissions` API.


@afif-fahim sure, go ahead

hI, @Ram81   i have  build the eval ai in my system .can you guide me to reproduce this issue.
Thanks!!