zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: [Frontend] Fix leaderboard column css inconsistencies
Root cause: Validation Gap

### Description

Currently, when the leaderboard has > 10 metrics the columns look too compact and metrics are unreadable. Here's an example of how the leaderboard looks

![Screen Shot 2021-03-22 at 12 18 49 AM](https://user-images.githubusercontent.com/16323427/111917191-a73d1580-8aa4-11eb-8533-93e443e9c0aa.png)

 Expected behavior: Columns should have bigger width so its clear to read the metrics and leaderboard table should have horizontal scroll if columns overflow because of large number of metrics


To reproduce this leaderboard use the following leaderboard schema in the starters challenge config

```
leaderboard:
  - id: 1
    schema:
      {
        "labels": ["Energy MAE (eV) -- ID", "Forces MAE (eV / A) -- ID", "EFwT -- ID", "Energy MAE (eV) -- OOD Ads", "Forces MAE (eV / A) -- OOD Ads", "EFwT -- OOD Ads", "Energy MAE (eV) -- OOD Cat", "Forces MAE (eV / A) -- OOD Cat", "EFwT -- OOD Cat", "Energy MAE (eV) -- OOD Both", "Forces MAE (eV / A) -- OOD Both", "EFwT -- OOD Both"],
        "default_order_by": "EFwT -- OOD Both",
      }
```

and the following evaluation script to test the results.

[Archive.zip](https://github.com/Cloud-CV/EvalAI/files/6178106/Archive.zip)




@Alabhya268 would you be interested in working on this issue?

Yes @Ram81 I want to work on this issue.

@Ram81, This issue was not causing because leaderboard has 10+ metrics, It was happening because ```table cell``` was inheriting width of longest word present in ```table head``` text as it can be seen in ```Last submission``` and ```participant team``` heading's case.

With changing css like submission page table I was able to make it look like this as table in submission page was handling this case better - 

https://user-images.githubusercontent.com/57143358/112015230-a31b0180-8b51-11eb-81a1-3d3a0808c17c.mp4

It is more readable this way and also I did not wanted to give  ```table cell```  full width of ```table head``` text as it would make cells unnecessarily long.

Let me know if what shown in video is good enough or something else needs to be done.

@Alabhya268 this looks pretty good 🙂

Thanks for the quick fix. Let me know once you open a PR I'll review it.
Repository: Cloud-CV/EvalAI
Issue: [FrontendV2] Show submission details in 3 columns on All submissions page
GitHub labels: frontend_v2

GSOC-2021

### Description

Current UI:
![Screen Shot 2021-03-24 at 11 42 45 AM](https://user-images.githubusercontent.com/16323427/112263963-2180bc00-8c96-11eb-88d6-43b5d09fc50f.png)


When a user selects the submission to see the submission details on All submissions page we should the content in 2 columns. We should show the submission details in 3 columns. Here's how the fields will be divided in columns:

1. Column 1: Team members, Team members email id (list should be wrapped when overflows), stdout file, stderr file
2. Column 2: Status, Submission Number, Submitted At, metadata file
3. Column 3: Show on leaderboard, Flagged, Re-run submission, Delete submission

@Ram81 Could I please work on this?

@Ram81  Can I work on this issue?


@Ram81 can i work on this?
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Remove filter by team name from My submissions tab 
GitHub labels: frontend_v2

GSOC-2021

### Description

Currently, we have a filter to search results by team name on `My Submissions` tab. As one user can be a part of only 1 team in a challenge we don't need a filter results by team name option on `My submissions` tab. We should remove the filter.

@Ram81, I want to work on this.

@Alabhya268 sure, go ahead
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Show execution time and submitted at for each entry on My submissions page
Root cause: Unimplemented Feature Gap

### Description

Currently, we show `Execution time` and `Submitted at` for each submission on the `My submission` tab once use clicks on the submission entry.  Here's how it looks currently

![Screen Shot 2021-03-24 at 11 52 40 AM](https://user-images.githubusercontent.com/16323427/112264854-7cff7980-8c97-11eb-87da-f68fb56936b6.png)

For each entry in the `My submissions` table we should move `Execution time` and `Submitted at` out of collapsible div and show it for each row


@Ram81 Could I please work on this?

@savish28 sure, go ahead
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Set font-weight 300 and reduce width of row separator on My submissions and All submissions tab
GitHub labels: frontend_v2

GSOC-2021

### Description

Font-weight is inconsistent on the `My submissions` and `All submissions` page. We should set font-weight: 300 for both tabs and reduce the width of row separator. Refer to frontend v1 css for the style. We should also remove highlighting of text on hover for a row

Can I work on it?

@gautamjajoo  sure go ahead.

There is no zoom on hovering a row instead the text gets bold. Should that be removed?

Yes, the highlighting of the text should be removed. I'll update the description

@Ram81 Would this look better for the row separator? Or we should have a line above the expanded row as well?

![Screenshot from 2021-03-24 20-51-27](https://user-images.githubusercontent.com/24366008/112336230-e9539a80-8ce2-11eb-9018-21adc6045f8f.png)
![Screenshot from 2021-03-24 20-51-42](https://user-images.githubusercontent.com/24366008/112336240-ea84c780-8ce2-11eb-8596-cb77672e5d4f.png)
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Fix bug in filter by team name in All submission page
Root cause: Algorithmic Error

### Description

When a user goes to the `All submissions` page and tries to use the filter by team name feature the results are inconsistent. Filter shows the results for few seconds then the results are overridden. As part of this task, we have to find the root cause of the inconsistent results and make the required changes

@Ram81, This is also the issue with frontendv1 leaderboard, Whenever we refresh or go to page table data on leaderboard table loads twice and then overrides itself.

@Alabhya268 this issue happens even when you don't refresh the page in frontend v2

@Ram81, I will try to fix this issue.

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Serial number not visible when moving to next page on All submissions tab
GitHub labels: frontend_v2

GSOC-2021

### Description

When a user moves to second or third page on the `All submissions` tab the serial number for the submissions is not visible. 
Expected behavior, serial number should be updated and visible for all results in the page.

@Ram81 Can I try this?

@June-Han I saw that you have picked up #3341 already. Once you complete that issue you can come back to this one

Can I work on it? @Ram81 

@Ram81 Can I work on this? I was previously assigned the issue #3343, but it seems that it had been fixed by #3295.

@Ram81 as the issue is still open can I work on this? 

@Ram81 can i work on this?


Closing this since we are not working on Frontend_V2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Show message when downloading > 5k results from All submissions page
Root cause: Unimplemented Feature Gap

### Description

When a user tries to download results from the `All submissions` tab if there are > 5k results for the challenge phase the download API breaks because of the large packet size. We should show a message to the user that should say the `Results are greater than 5k you should use the following API to download results` where we redirect user to the API documentation for `get_all_submissions`

@Ram81 Can I work on this?

@June-Han  sure, go ahead

@Ram81 may I take up this issue? I'll make a PR by today

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Reduce padding below selected phase name and dropdown
GitHub labels: frontend_v2

GSOC-2021

### Description

Here's how the dropdown for the selected phase looks on the `Leaderboard` tab.

![Screen Shot 2021-03-24 at 12 06 21 PM](https://user-images.githubusercontent.com/16323427/112266128-9bff0b00-8c99-11eb-8bd1-a1177d6f6eca.png)


After a phase is selected the padding-bottom should be less for the selected option in the dropdown.

@Ram81, Basically we need to reduce padding enough so dropdown icon and selected phase look even right ?

i want to work on this.

@Alabhya268 you already picked #3336, it would be good if you work on 1 issue at a time and then move on to the next issue once the first one is done 🙂 


>@Ram81, Basically we need to reduce padding enough so dropdown icon and selected phase look even right ?

yes, that's correct

@Ram81 what submission do i make so that it makes it to the leaderboard in order for me to replicate the padding issue.

Can i work on this?

When i take a look at my leaderboard i don't get the P that shows up on the screenshot you've sent
![image](https://user-images.githubusercontent.com/49815751/112941284-f1c92c80-914b-11eb-8260-8414b8d94f92.png)

am i missing something here?


@Ram81 

> @Alabhya268 you already picked #3336, it would be good if you work on 1 issue at a time and then move on to the next issue once the first one is done 
> 
> > @Ram81, Basically we need to reduce padding enough so dropdown icon and selected phase look even right ?
> 
> yes, that's correct
@Ram81 since #3336 has already been merged can I work on this .


>@Ram81 what submission do i make so that it makes it to the leaderboard in order for me to replicate the padding issue.

@ankitpal1029 you have to create a private phase to reproduce the issue.

>Can i work on this?

@ankitpal1029 as you are working on #3376 you can pick up another issue after you are done with it.


>@Ram81 since #3336 has already been merged can I work on this .

@Alabhya268 sure, go ahead



![leaderboard](https://user-images.githubusercontent.com/57143358/113010872-d0416280-9196-11eb-826b-55214b4f9a66.png)

@Ram81, Padding looks fine in my system in the leaderboard tab. Could you please try to recreate this and explain under what circumstance this is happening ?


@Alabhya268 please try with a phase that is private. You can set it private from django admin or you could upload a new challenge using starters [repo](https://github.com/Cloud-CV/EvalAI-starters) which already has private phases.

![Screenshot from 2021-03-30 20-39-22](https://user-images.githubusercontent.com/57143358/113012053-0af7ca80-9198-11eb-85b4-a9734cbe42f2.png)

@Ram81, It still looks fine even when the tag is private. Please look at the image above.

@Ram81, did you checked it?

Closing this since we are not working on Frontend_v2
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Modifications for Privacy policy page
GitHub labels: frontend_v2

GSOC-2021

### Description

![Screen Shot 2021-03-24 at 12 28 41 PM](https://user-images.githubusercontent.com/16323427/112268208-9fe05c80-8c9c-11eb-93fd-8944b7da1ded.png)

Following are the modifications for Privacy policy page:

- [ ] Center the page content for large screens
- [ ] Start the sidebar from the top of the page, currently the sidebar is centered on the page it should start from the top
- [ ] Remove the rocket, cloud and birds animation from the page

Hi @Ram81 may I work on this issue?
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Fix the media assets endpoint
Root cause: Configuration Error

### Description

We recently moved to `https://evalai.s3.amazonaws.com/` endpoint for our media assets. Frontend v2 is still using `https://staging-evalai.s3.amazonaws.com/` endpoint. We should switch to new enpdoint in frontend v2.

Can I work on it? @Ram81 

@gautamjajoo sure, go ahead

Hi @Ram81, I am sorry to bring this up now. It seems the media URL on the staging website is wrongly set. This cannot be fixed with our local machines. 

To be specific, the "AWS_STORAGE_BUCKET_NAME" environment variable present on the **STAGING_MACHINE/EvalAI/docker/prod/docker_staging.env** needs to be changed from **"staging-evalai"** to **"evalai"**. Since these environment variables are currently hidden from the contributors, there is very little we can do here. Please let me know if I am missing something here.
Thanks.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Center the content for large screens
GitHub labels: frontend_v2

GSOC-2021

### Description

We follow the design of centering the page content for larger screens. The `Dashboard` and `Challenge` page don't follow the content center style in frontend v2. Here's how frontend v2 looks on larger screen

![Screen Shot 2021-03-24 at 12 34 24 PM](https://user-images.githubusercontent.com/16323427/112268882-a6bb9f00-8c9d-11eb-9dc1-0358e750457e.png)


Expected:

![Screen Shot 2021-03-24 at 12 35 30 PM](https://user-images.githubusercontent.com/16323427/112268900-ac18e980-8c9d-11eb-9998-82b83401d915.png)


Hi @Ram81, I would like to work on this. Could you please confirm? Thanks a Lot.

@Ram81 can i make a pr for this?


@niharsalunke sure, go ahead

@ankitpal1029 you can look for another issue as @niharsalunke asked for this issue first

@Ram81 sure


@Ram81, Nobody seems to be working on this issue currently, Can I work on this.

@ankitpal1029, @Alabhya268 I have been struggling with this task so I believe there is no point in delaying. You may take it. Thanks.


@Alabhya268  are you working on this?

@Ram81 @Alabhya268
can I work on it , I think I have figured the solution for the problem

> @Ram81 @Alabhya268
> can I work on it , I think I have figured the solution for the problem

@shikhar168 , you can work on this as I am not currently working on this issue.

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] After login redirect user to All challenge page
GitHub labels: frontend_v2

GSOC-2021

### Description

Currently, when a user logs in on the frontend v2 we redirect user to the `Hosted challenges` page. We should redirect user to the `All challenges` page after login

Can I work on this? @Ram81 

I am not being able to reproduce this. I have tried to log in as participant, host and admin, and I have been always redirected to `All challenges`.

> I am not being able to reproduce this. I have tried to log in as participant, host and admin, and I have been always redirected to `All challenges`.

:+1:  @Ram81, as @xavierfigueroav said, As soon I log in I have been redirected to the `All challenges` page.

I can also confirm that right after login with all default users and a new user i created ,upon login leads to all challenges page.


@Ram81 there's one behaviour that i noticed today which is if the user is already logged in and opens up the site , it doesn't lead to the all challenged rather sits on root

If you want the user to always be directed to the all challenges page if he's logged in then let me know as i'd like to  make a pr for the same.

@Ram81 can I work on this issue??

@Ram81 can I work on this issue?



@Ram81 is this issue still up to be taken?

Closing this since we are not working on Frontend_v2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Add option to submit using evalai cli
Root cause: Unimplemented Feature Gap

### Description

In frontend v1 we show the option to make a submission using EvalAI-cli. We should add the same feature in frontend v2. Here's how the option looks in frontend v1.

![Screen Shot 2021-03-24 at 12 42 02 PM](https://user-images.githubusercontent.com/16323427/112269563-893b0500-8c9e-11eb-8838-caa4049dbb5b.png)


@Ram81 made a small PR to add this feature. Please review
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Fix alignment of visibility option on submit page
GitHub labels: frontend_v2

GSOC-2021

### Description

The `Select submission visibility` option is misaligned on the `Submit` tab of the challenge page. It should be aligned with submission metadata fields. Here's how it looks currently.
![Screen Shot 2021-03-24 at 12 43 47 PM](https://user-images.githubusercontent.com/16323427/112269743-cc957380-8c9e-11eb-8c0f-82445d821236.png)
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Stop leaderboard polling when user switches to another tab or page
GitHub labels: frontend_v2

GSOC-2021

### Description

Currently, after a user visits the leaderboard page in frontend v2 the polling for updating leaderboard is not stopped. Because of this issue user experience is bad and it slows down UI access until you refresh the page.

@Ram81 can I please take up this issue and make a PR by today?

@burnerlee sure, go ahead

Closing this since we are not working on Frontend_v2
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Fix data loader on the leaderboard page
Root cause: Algorithmic Error

### Description

Currently, the Leaderboard data population is quite slow. While the leaderboard API is being called the leaderboard shows `No results to show` message. We should ideally show a loader in this case. The data loading API calls are quite slow in frontend v2. We also want to fix the issue of slow loading of the leaderboard data.

@Ram81 do we plan to use some library to render to Loader for this?

@burnerlee we can add any data loader. The main thing we need to debug for this issue is why is the data loading in the leaderboard table slow and fix that issue. If you compare frontend v1 leaderboard loading with frontend v2 loading you will see that frontend v2 is quite slow.

oh I see, I will look for the issue and fix this

@Ram81 can you please provide me with some bulk dummy data, so that the leaderboard api slows down in my PC? It would help me a lot. Thanks

@Ram81 ping

> @Ram81 can you please provide me with some bulk dummy data, so that the leaderboard api slows down in my PC? It would help me a lot. Thanks

@RishabhJain2018 can you please guide me where can I find this 😅 

Closing this since we are not working on Frontend_V2.
Repository: Cloud-CV/EvalAI
Issue: [Frontend V2] Bug in leaderboard with no data
Root cause: Validation Gap

### Description

When a phase split leaderboard has no data we are showing `Page is outdated` message after few seconds and when a user tries to update the page using the option there is no data updated on the leaderboard. Part of this task is to debug the issue, find the root cause and fix the bug.

@Ram81 May I take this one?

@ShauryaAg suer, go ahead

@Ram81 I am unable to recreate this issue on my local machine. Can you please guide me a little?

The leaderboard with no submission shows `No results to show!`
![image](https://user-images.githubusercontent.com/31778302/112342627-62a1bc00-8ce8-11eb-8a57-fc23bf967b51.png)


@ShauryaAg could you try creating a new challenge and try making >10 submissions to two phases and 1 phase without any submissons and see if you are able to reproduce the issue in any of these 3 leaderboards

@Ram81 Even after following the steps you mentioned above I am unable to reproduce the issue.

@ShauryaAg this issue and #3350 are related. We tested this with challenges that have > 5k submissions. You can try changing seed script to populate ~5k entries in the leaderboard and use that for reproducing this issue.

Note: This issue doesn't happen when you first visit the page. While we were testing we visited the page multiple times and saw that after few visits the data loading into the leaderboard fails. 

I'll try to reproduce this and let you know what are the steps you can follow to reproduce the issue.

@Ram81 Can you please mention the browser(s)/Operating System(s) that the issue was tested on?

As you have mentioned that the issue is present only after a number a visits to the page, it may be due to some caching issue (which could be browser specific).

@Ram81 Were you able to reproduce it on your machine? If yes, please let me know how.

@ShauryaAg I haven't had a chance to try this. I'll let you know once I try it meanwhile you can pick some other issue to work on.

Closing this since we are not working on Frontend_V2.
Repository: Cloud-CV/EvalAI
Issue: [Backend] Returns with code 500 upon submission of wrong URL
GitHub labels: bug

enhancement

easy_to_fix

frontend

good first issue

GSOC-2025

Backend returns with code **500 (Internal server error** when a file with wrong extension is submitted for a challenge. It should return with **400 (Bad request)**

Example: Submitting a `.py` file URL to a challenge that doesn't accept `.py` files

If you'd like to report a bug, please include the following information:
- Expected behaviour
It should return with a `400 Bad Request`

- Observed behaviour
Server gives a `500 Internal Server Error`

- Steps to reproduce the problem
  1. Choose any challenge
  2. Submit a file URL with `.py` (or `.cpp`, etc) extension
  3. Observe the error

Upon submitting a file URL with `.py` extension
![image](https://user-images.githubusercontent.com/31778302/112475602-021d8800-8d97-11eb-8e23-90f41c43ee35.png)



@ShauryaAg would you like to work on this issue?

Yeah, sure. @Ram81 

Hi can I work on this, the previous if the previous PR is not being worked on ? 


Hey @Ram81, is this issue not solved yet?  Though I am a beginner, I would love to solve this issue with some guidance. 

Please build on #3371 and and open a new PR with the changes in the backend and frontend only.

Hello, I am new to EvalAI and would like to be assigned to this issue

Hey, is this issue still open. I would like to contribute.

@RishabhJain2018 @ShauryaAg  Hi, I’m interested in working on this task. If it’s unassigned, could you please assign it to me? I’d be happy to take it forward.
Repository: Cloud-CV/EvalAI
Issue: Create an API for deleting a user from a Participant Team
GitHub labels: enhancement

GSOC-2019

medium-difficulty

backend

API endpoint: `/api/participants/<participant_team_id>/`
Method: `DELETE`

A user can request this API to remove himself from the participant team. You can get the user from `request.user`. 

Please comment here for more details. Also, check other APIs to delete.

@deshraj Can I work on this?

Sure, go ahead. Let me know if you need help. 

okk.
Repository: Cloud-CV/EvalAI
Issue: Add tests for testing urls in challenges app.
GitHub labels: enhancement

GSOC-2019

easy_to_fix

backend

The tests file must be located at tests/unit/challenges/test_urls.py. Create one, if it doesn't exists.
For reference please use http://stackoverflow.com/questions/18987051/how-do-i-unit-test-django-urls

@deshraj  shall i try this too....its similar

Sure. Assigning it to you. :-) 

@deshraj I am not able to get what challenge_time is and where is it declared....can u please tell we what is to be done there
last url test which is commented in the pull request
Repository: Cloud-CV/EvalAI
Issue: The padding for Challenge Cards is off on Hosted Challenges page

- **The Expected behaviour**
![image](https://user-images.githubusercontent.com/65081055/112762988-32c42280-9020-11eb-86c3-53cb8b77f830.png)

- **The Observed behaviour**
![image](https://user-images.githubusercontent.com/65081055/112763000-4079a800-9020-11eb-8567-95207945d9be.png)

- **Steps To Reproduce The Problem**
1. Login as Host and then browse to Hosted Challenges.
2. Now try adjusting your view to various zoom levels.
3. You will observe that at higher zoom levels (small display monitors), the "Approved" and "Publish" buttons are cut-off.



Hi @Ram81 , may I work on this issue?

I noticed that this issue is already addressed in #3244 and there @RishabhJain2018 pointed out that this was a design choice. However, the "approved" and "published" buttons are being cut-off on the standard 1366 x 768 monitors which are fairly common.