zhiminy/EvalEng huggingface dataset:
Repository: Cloud-CV/EvalAI
Issue: Add a feature to contact host using a form
GitHub labels: easy_to_fix

frontend

new-feature

good first issue

javascript

GSoC-2023

### Description
Currently, the contact form provided on EvalAI is to reach EvalAI admins. There should be a feature where the challenge hosts put up contact email on challenge configuration, which can then be used to send a message via the participants to the challenge hosts via EvalAI. This will make things easier for admins as well as the participants.

### Pre-requisites/Learnings
This issue essentially requires background on a few things:

- An overall understanding of [EvalAI challenges](https://evalai.readthedocs.io/en/latest/host_challenge.html).
- An understanding of the [EvalAI frontend](https://github.com/Cloud-CV/EvalAI/tree/master/frontend).

### How to Approach
- You can start by setting up EvalAI locally. Set up the dev version locally (preferred) using the steps [here](https://github.com/Cloud-CV/EvalAI/tree/master#installation-instructions).
- Add a new attribute to the challenge model `contact_email`.
- Add a form section on the challenge Overview page to send messages to challenge hosts.
- Reach out to us regarding any issues that you face or if you need any help with understanding any of the above.

Next step for this would be allowing the hosts to update the contact email via challenge configuration.


@gchhablani hey! i would like to work on this issue can you assign this to me?


I would like to work on this issue,could you please assign t to me

@gchhablani hey! i would like to work on this issue can you assign this to me? I can do it , i have worked on more than 10 projects 

@ADITYA97-CODER I have assigned this issue to you. Please create a PR when you're ready and let me know! :)
@anandkr47 I have assigned another issue to you, can you please check?
@karthiknadar1204 Please find another issue and let me know, I will assign it to you.

Sure @gchhablani ,thank you 

@gchhablani  Just wanted to know, are you still merging the PR's so that i can solve this issue? 

can i ?

@gchhablani

hey! i would like to work on this issue..
 cud you pls assign this to me?
Repository: Cloud-CV/EvalAI
Issue: Fix leaderboard column inconsistencies
Root cause: Validation Gap

### Description
This issue is similar to #3331 and has been reported by our current users.
The leaderboard has CSS inconsistencies because of which the column names do not appear properly when there are several columns.

### Pre-requisites/Learnings
This issue essentially requires background on a few things:
- An overall understanding of the models related to [Challenges](https://github.com/Cloud-CV/EvalAI/blob/master/apps/challenges/models.py) on EvalAI.
- An understanding of the [EvalAI frontend](https://github.com/Cloud-CV/EvalAI/tree/master/frontend).

### How to Approach
- You can start by setting up EvalAI locally. Set up the dev version locally (preferred) using the steps [here](https://github.com/Cloud-CV/EvalAI/tree/master#installation-instructions).
- Create a challenge locally using GitHub starter template with `ngrok`. This will need some reading.
- One possible solution is given on the above mentioned issue. Feel free to experiment with the frontend locally and open a PR with screenshots.
- Reach out to us regarding any issues that you face or if you need any help with understanding any of the above.


Hi @gchhablani, I would love to work on this issue, could you please assign it to me.


@snehalchaudhari98 Thanks for taking this up. Please start working on it, I will assign this issue to you.

I am a beginner to Open source and have knowledge of frontend. I think I can solve the issue if i get a proper guidance about how to start of making change in the code

@snehalchaudhari98 I have assigned the issue to you.
@ashwaq06 Can you please find another issue to work on? In case you don't find any, we'll find something for you.

@gchhablani  I have knowledge on various AWS services. It would be great if I got assigned to the issues related to AWS and cloud

@gchhablani Hey there, as a part of GSoC even I would like to contribute and if the issue is still open and no one is working on it, I would like to take this up.

@gchhablani Hey there, I would like to contribute and if the issue is still open and no one is working on it, I would like to take this up.
Repository: Cloud-CV/EvalAI
Issue: Add meaningful error message on form validation
Root cause: Validation Gap

**Observed Behaviour**
- An error message "This field is required" appears when we add special characters in the form field of "Create a new Team", which is unclear and doesn't make sense.

<img width="537" alt="Screenshot 2023-03-21 at 11 19 54 PM" src="https://user-images.githubusercontent.com/25618739/226700613-b5d126bf-39be-47e4-99e8-b0748357013c.png">


**Expected Behaviour**
- The error message should be more precise, a better message would be "Team Name is invalid".

**Steps To Reproduce**
- On the home page, click on "Host Challenge"
- Add special characters (Example ; @ etc) in the "Create a new team" form fields on the right
- Click on "Create Host Team"





@rahul2240, I would love to take up this ticket. can you please assign it to me?

@Koosha-Owji sure go ahead!

@rahul2240 Thanks a lot for posting this issue.

@Koosha-Owji I have assigned this issue to you. Please create a PR and let us know.


Hey there since this issue is till open, I tried to work on it. I have made the code changes necessary and committed them but unable to create a PR I worked in the participant-fix branch and named my commit as "fix#3899 added meaningful error message". Hope someone can help me on creating a PR.

@Dedeepya-K Please check this to know how to create a PR: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request

Thank you, but the thing is I made my commits first as below and now unable
to find this commit in the participant-fix branch, while trying to create a
PR.
To explain my scenario better I have added two images please do take a look
at it.
[image: image.png]
[image: image.png]
I don't understand what went wrong. All help is much appreciated.


Thanks & Regards
Dedeepya Korukonda


On Tue, Apr 4, 2023 at 10:10 AM Gunjan Chhablani ***@***.***>
wrote:

> @Dedeepya-K <https://github.com/Dedeepya-K> Please check this to know how
> to create a PR:
> https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/Cloud-CV/EvalAI/issues/3899#issuecomment-1495335000>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AUZ75EUB4PMKLRECCC5I2JDW7OQ3FANCNFSM6AAAAAAWCZ32J4>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>


can I have this issue resolved ? I am new to open source contribution 

Can I solve this problem?

Hello @rahul2240 , please let me know is this issue need to fix?
Repository: Cloud-CV/EvalAI
Issue: Create endpoint for creating a new Challenge
Root cause: Unimplemented Feature Gap

Details about the endpoint:
- Url: /api/challenges/
- Header: Authorization: Token <token>
- Method: POST
- Response: 
  - status on success: HTTP_201_CREATED
  - status on exception:  HTTP_406_NOT_ACCEPTABLE
  - status on Unauthorized access: HTTP_203_NON_AUTHORITATIVE_INFORMATION

For more details, feel free to discuss on thread or gitter channel https://gitter.im/Cloud-CV/EvalAI

Fixed in #123
Repository: Cloud-CV/EvalAI
Issue: Increase the code quality in landscape. 
GitHub labels: enhancement

easy_to_fix

backend

@deshraj I found the code quality is low in landscape.io . Please refer to this [link](https://landscape.io/github/Cloud-CV/EvalAI/547/messages/smell).

Can I work on this to fix this??

Oh this looks like a good initiative. Do you want to work on this? I was going to open an issue for the same. 

@deshraj yeah sure, I will work on this.

@deshraj I am interested in working on the issue if no one else is working


@souravsingh: Sorry, @RishabhJain2018 is already working on this. 

@deshraj I think we should close this?

Thanks. :-)
Repository: Cloud-CV/EvalAI
Issue: Documentation: Correct the spelling mistake
GitHub labels: easy_to_fix

docs

minor issue

GSOC-2025

**Expected Behaviour**
- Change "acccess" to "access" in Point 2 of "Challenge creation using GitHub".
<img width="696" alt="Screenshot 2023-03-22 at 10 00 42 AM" src="https://user-images.githubusercontent.com/25618739/226803167-0e1cb216-cd6b-43d5-a824-0be9f2d883ff.png">

**Steps To Reproduce**
- Host A challenge
- Create A Team
- Select A Team and Click on Next
- Check the point 2 of "Challenge creation using Github"

@rahul2240, I am at a beginner level right now and would love to take up this ticket. can you please assign it to me? thanks in advance!

@Jaishree2310 sure go ahead 👍 

@rahul2240 - I have raised #3903 . can you please review it?

@rahul2240 Thanks for posting this issue.

@Jaishree2310 Thanks for raising a PR. I will review your PR on this.

Hey there, as a part of GSoC even I would like to contribute and if the issue is still open, I would like to take this up.

@rahul2240 - I have raised https://github.com/Cloud-CV/EvalAI/pull/3903 . can you please review it once you are able to check?

> @rahul2240 Thanks for posting this issue.
> 
> @Jaishree2310 Thanks for raising a PR. I will review your PR on this.

Can you please review it?

I will like to take this issue up if not being worked by anyone. 

hello!,
I am interested in working on this issue, kindly assign me this issue.

@gchhablani @rahul2240  can you please merge my PR which I have opened. and you can close this issue as it is completed.

Hello @RishabhJain2018  I am at a beginner and I would love to fix this issue.  I'm wondering can you please assign it to me? thanks in advance!

Sure, @WncFht .

Hello @RishabhJain2018 , I think maybe I created the right PR, could you please review it?

https://github.com/Cloud-CV/EvalAI/pull/4513

Hello @RishabhJain2018 , I would like to work on this issue as a beginner contributor. Kindly assign it to me if it is available. Thank you.
Repository: Cloud-CV/EvalAI
Issue: Bug: Duplicate rows for a second on Leaderboard on selecting any dropdown option
Root cause: Algorithmic Error

**Expected Behaviour**
- No duplicate entry should appear when applying a filter on the leaderboard

**Observed Behaviour**
- Duplicate rows appear for a second after changing filters on the leaderboard
![evaliai](https://user-images.githubusercontent.com/25618739/227228839-18aab82a-d4bd-4269-b9f8-8af32740054c.gif)

**Steps To Reproduce**
- Open any challenge
- Go to the leaderboard
- Select any dropdown option

Hi @rahul2240 can I work on this issue but I am beginner to this project so if it is good to start.

Thanks @rahul2240 for posting this issue. If you are looking to participate in GSoC with us, please feel free to work on this.

@Adi9235 This is currently not a GSoC issue but if @rahul2240 is not working on this, we can assign you this one.

@gchhablani, let @Adi9235 take this 😄 

Hey there, as a part of GSoC even I would like to contribute and if the issue is still open and no one is working on it, I would like to take this up.
Repository: Cloud-CV/EvalAI
Issue:  Unable to view Leaderboard Ranking - Seizure Forecasting Challenge 
Root cause: Others

Hi,
I am a participant in challenge - https://eval.ai/web/challenges/challenge-page/1693/overview.

While making my submission, I noticed the leaderboard ranking in not visible today. Can anybody suggest here?

Though, the ranking board was visible in last few days.

Thanks.
Repository: Cloud-CV/EvalAI
Issue: Frontend: Show new value on validation success only
GitHub labels: bug

easy_to_fix

frontend

good first issue

javascript

GSoC-2023

**Observed Behaviour**
- A host can update submission values in the "phases section" to any number, though it has a validation check which is failing but still host can see these new values at the client till the page is reloaded.

![client_validation](https://user-images.githubusercontent.com/25618739/228011023-c49f6ac1-8131-49e6-8b0f-7149f89773eb.gif)

**Expected Behaviour**
- New values should only be reflected at the client when the validation succeeds.

**Steps To Reproduce**
- Go to all challenges
- Select Any 1 challenge
- Go to "Phases" Section
- Edit any phase
- Type a very long number


Thanks @rahul2240 for posting this issue!

@gchhablani @rahul2240 
May I work on this? I kinda got the idea of how to fix it. I will work on getting the PR ready.

A fix for this issue can be found [here](https://github.com/Cloud-CV/EvalAI/pull/3911)
Please feel free to review and add comments.

Hey there, as a part of GSoC even I would like to contribute and if the issue is still open and no one is working on it, I would like to take this up.

Hi 👋

I’d like to work on this issue and add the MongoDB version check instructions to the README for Ubuntu users.
I have 2+ years of industry experience in a product-based company, have contributed to multiple open-source projects, and have hands-on experience working with MongoDB.

Please assign this issue to me so I can start working on it and submit a PR.

Thanks!
Repository: Cloud-CV/EvalAI
Issue: ERROR: for nodejs  : Cannot start service nodejs: failed to create shim task: OCI runtime create failed:
Root cause: Environment Incompatibility

@gchhablani 

Unfortunately, for

docker-compose up --build


I got an error:



ERROR: for evalai_nodejs_1  Cannot start service nodejs: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: 
error mounting "/var/lib/docker/volumes/2c6eb8573bf180a2293c2fa3f54ade1e56131a0f1225b76910172b40788f0a91/_data" to rootfs at "/code/bower_components": mkdir /var/liStarting evalai_worker_py3_8_1



although the docker is running.

Any ideas to fix this
![Screenshot 2023-03-28 234100](https://user-images.githubusercontent.com/76548079/228330190-97f133ef-97b9-4141-a301-3a47de77383d.png)
 Thank you!

@DhruvChaurasia3418 Can you share the specs of the machine that you are using?

> @DhruvChaurasia3418 Can you share the specs of the machine that you are using?

Intel Core i7, 8.00 GB RAM, Windows 10 Version 21H2.
Docker version 20.10.23, build 7155243


Hey @DhruvChaurasia3418 , have you considered testing the code in a Linux environment? I've encountered same issues running it on my Windows machine as well. Its working fine in Linux for me
Else there are some dependencies that we have to manually install consider checking https://evalai.readthedocs.io/en/latest/faq(developers).html#common-errors-during-installation
Repository: Cloud-CV/EvalAI
Issue: Fix #3899 & New Bug: Team name verification failure and meaningless prompts
Root cause: Validation Gap

I have fixed issue #3899 and found another related bug. I am working on the new bugs.

**Observed Behaviour**

- An error message "This field is required" appears when we add special characters in the form field of "Create a new Team", which is unclear and doesn't make sense. (As issue in [Add meaningful error message on form validation #3899](https://github.com/Cloud-CV/EvalAI/issues/3899))
- No verification for “Update Host Team”, which means that special characters can appear.

![image](https://user-images.githubusercontent.com/59676354/228891399-60d823d5-fbec-4749-9477-563f729c99d7.png)


**Expected Behaviour**

- The error message should be more precise, for example, "Team Name is invalid".
- Perform verification at both frontend and backend.

**Steps To Reproduce**
- On the home page, click on "Host Teams".
- Input some special characters (Such as @,[,{ etc.) in the "Create a new team" form fields on the right
- Click on "Create Host Team"
- Click on the pencil icon on the left fields of "Select a Challenge Host Team".
- Change the team name and then submit.
- You will find that illegal characters for team name present.

@gchhablani Hey there, can you please assign me this task I think I know how to fix this (having a certain pattern of values be accepted using validators for team name-since, in the "ChallengeHostTeam" model we have created already has no code to validate the type of team name data, simply a "CharField" is given, I would like to add validation). Please do assign me this task, I would like to fix this.

@Dedeepya-K  Hi Dedeepya-k. I have solved this issue and PR. So I think you can choose another one! (There is no need to add additional code to validate. They have the built in implementation😀

Okay

On Thu, 6 Apr, 2023, 4:54 pm www, ***@***.***> wrote:

> @Dedeepya-K <https://github.com/Dedeepya-K> Hi Dedeepya-k. I have solved
> this issue and PR. So I think you can choose another one! (There is no need
> to add additional code to validate. They have the built in implementation
> 😀
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/Cloud-CV/EvalAI/issues/3912#issuecomment-1498912291>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AUZ75EQ2X4VXGG3M527MGK3W72RXZANCNFSM6AAAAAAWNQ7KFA>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
Repository: Cloud-CV/EvalAI
Issue: Documentation: Host challenge: Fix duplication

In [docs/source/host_challenge.md ](https://evalai.readthedocs.io/en/latest/host_challenge.html)the paragraph "We support two types of code-upload-based challenges..." is repeated twice. This repetition can be confusing for readers,

To improve clarity, one of the sentences should be removed. 

![image](https://user-images.githubusercontent.com/22369791/228919363-20e21f95-4ae7-4608-a097-99e5a590c4f2.png)



Hi @AyushR1  can I work on this issue but I am beginner to this project so if it is good to start.

Hey there, as a part of GSoC even I would like to contribute and if the issue is still open and no one is working on it, I would like to take this up.
Repository: Cloud-CV/EvalAI
Issue: Validate URLs of social handles in accounts

**Description**
The [Profile](https://github.com/Cloud-CV/EvalAI/blob/master/apps/accounts/models.py) model in the `accounts` app has the following attributes to store the profile of a user: user, contact_number, affiliation, receive_participated_challenge_updates, receive_newsletter, github_url, google_scholar_url, linked_url. It would be nice to have validated GitHub, Google Scholar, and LinkedIn URLs to avoid any kind of discrepancies. 

**Problem**
The current behavior of `github_url`, `google_scholar_url`, and `linked_url` might take into account any random URL which should not be the case ideally. Here's the reference to the [field](https://github.com/Cloud-CV/EvalAI/blob/master/apps/accounts/models.py#L47).

**Fix**
To have a foolproof path, I propose adding proper validation in the required model attribute. A simple solution might be to modify the `github_url` in the following way:

```
github_url = models.URLField(max_length=200, null=True, blank=True, validators=[validate_github_url])
```

```
def validate_github_url(value):
    if not value:
        return
    obj = urlparse(value)
    if not obj.hostname in ("github.com"):
        raise ValidationError(f"Only URLs from GitHub are allowed")
```

P.S. The same can be extended to `web` app as well. [Link](https://github.com/Cloud-CV/EvalAI/blob/master/apps/web/models.py#L58)

Hey @gchhablani, 
I'd be happy to consider your thoughts on this.


@priyapahwa I would like to work on the validate function. Could you assign this issue to me? 

I am a GSOC 2023 participant as well.

@priyapahwa This feels like a reasonable feature. Can you please create a PR?

Yes, sure.
Repository: Cloud-CV/EvalAI
Issue: Feature: Show Users The challenges They've Participated In
Root cause: Unimplemented Feature Gap

# Feature - My Challenges Tab

Currently, we do not show users the current challenge or the past challenge they have participated in, which will be kinda cool to have in the user profile section.

**Proposed Solution**
- To show the user his/her participation in challenges.
- Rows, for now, will be in paginated chronological order (we can have filters in the future)
- A new row will be created when the user accepts all terms and conditions and clicks on Participate

**Flow**
- Profile -> Challenges -> Active/Past tabs -> Show Challenges in paginated chronological order

**Skills**: Frontend, Backend, Databases

Hi @rahul2240, I am interested in adding this new feature. May I work on this ?

@TriveniBhat sure go ahead! 

@rahul2240 I am designing the front end to resemble the image below. Please share your comments.
![IMG-0065](https://user-images.githubusercontent.com/49990128/229881114-24657e1c-e318-49f2-9b8d-0fb073a47ec7.jpg)


PR for the issue can be found [here](https://github.com/Cloud-CV/EvalAI/pull/3929)
Please review

New contributors are requested to build upon the existing PR(https://github.com/Cloud-CV/EvalAI/pull/3929)
Repository: Cloud-CV/EvalAI
Issue: Missing terms in challenge configuration docs
Root cause: Documentation Deficiency

The current [docs for challenge configuration] (https://evalai.readthedocs.io/en/latest/configuration.html) do not contain all the terms we allow in [challenge configuration](https://github.com/Cloud-CV/EvalAI-Starters/blob/master/challenge_config.yaml).

It should be fixed asap to help the hosts understand what the terms mean.

Additional next issue (probably slightly harder than this) would be explaning what all is required and what is optional (if anything) in the challenge configuration.

@gchhablani I will take this up
Repository: Cloud-CV/EvalAI
Issue: Remove File URL option from frontend on submit page
GitHub labels: easy_to_fix

frontend

good first issue

GSoC-2023

This option needs to be removed from the frontend.

![image](https://user-images.githubusercontent.com/29076344/230246160-9c772dd4-de5b-46dc-b51d-1cf4f4cb5ba8.png)

We do not use this option as we use CLI for larger files now.

@gchhablani I am interested in working on it 

Fix is provided in [this](https://github.com/Cloud-CV/EvalAI/pull/3924) PR
Please review

@gchhablani I can fix this . please assign this to me .




hey @gchhablani , please let me know is this issue need to fix?


Clsong this since this is already merged!
Repository: Cloud-CV/EvalAI
Issue: Show user timezone on submission worker logs
Root cause: Unimplemented Feature Gap

Currently, the timezone used on submission worker logs is UTC.

![image](https://user-images.githubusercontent.com/29076344/230247599-7c8ad225-14cf-47a3-89b1-7d3489c5d05e.png)

We would like to show the user's timezone on frontend. This will require processing the logs to convert the time from UTC and taking the user timezone. Might also require changes on the backend.

@gchhablani I can take the issue! Please assign it

@AyushR1 Assigned!
Repository: Cloud-CV/EvalAI
Issue: Negative Execution Time on Django Admin during submission run
Root cause: Validation Gap

The current Django Admin shows negative run time during the submission run. This is because we do not have a final time while the code is running but it should either be `None` (easy) or it should show elapsed time (harder).

![D2151881-4DFF-40C0-B01F-8F24D8A2EA4F_4_5005_c](https://user-images.githubusercontent.com/29076344/230675385-17b9ce36-24b6-4af4-adb0-ce08597af8e6.jpeg)


@gchhablani I am interested in working on this. Could you assign this to me?

@TriveniBhat Please go ahead. I will assign it to you.

Hey @TriveniBhat 
Are you still working on this issue?

Hi @priyapahwa, I'm still working on it