Talip7/scikit-learn-issues-multilabel huggingface dataset:
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
This sounds like an interesting idea and even nicer that it is supported financially.

One thing I don't understand from the original comment is which part of the website you plan to translate (API docs, examples, user guide, ..?) and how the translations would appear in the scikit-learn website (how would a user discover that translations exist)? What would the process be to keep things up to date across releases but also within a release?

Labels: Needs Decision
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
I think setting up the account on crowdin makes sense then. The danger here that we're gonna have translated docs, which people will read and then complain about, and we have no idea what those translations say. I wonder how much the translations from crowdin is going to be better than a auto google translate button on our website.

WDYT @scikit-learn/core-devs

Labels: Needs Decision
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
> WDYT ***@***.***/core-devs

Worried...

What I would want to know is: what's the mechanism for updating (hum, there is a business opportunity here to provide a system for automated translation, with fixes, that learns from the fixes and tries to apply them to new versions).

I would really want to have a written plan for updating the translation, and one that have a realistic approach.

Labels: Needs Decision
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
I'm working on an FAQ that will hopefully contain most of the information project maintainers will want to see before deciding if they want to participate, and plan to put that together before continuing discussions with more projects. After the FAQ,  I plan work on a draft SPEC that gives the kind of detailed plan  @GaelVaroquaux would like to see.

Labels: Needs Decision
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
Hi everyone. The FAQ I'd promised is now available here: https://scientific-python-translations.github.io/faq/. Feel free to take a look and let me know if you'd be interested in participating or if you have any other questions. We're going to start moving forward only with the more enthusiastic projects, so if you're still unsure, you can wait to see how things work out for other project websites before making a final decision.

Labels: Needs Decision
Localization of scikit-learn website content.

Hi,

I work for Quansight Labs and am helping set things up for translation of main project website content for core projects in the Scientific Python ecosystem. This work is supported by the [Scientific Python Community & Communications Infrastructure grant](https://scientific-python.org/doc/scientific-python-community-and-communications-infrastructure-2022.pdf) from CZI. I created a Github discussion for this here: https://github.com/scikit-learn/scikit-learn/discussions/28105, but @glemaitre pointed out that an issue would be more appropriate.

A deliverable for this grant is to have the brochure websites of at least 8 of the 10 Scientific Python core projects translated into at least 3 commonly used languages. You may have seen the language drop-down selector at https://numpy.org/.  The goal is for a cross functional team of Quansight staff and volunteers to handle the bulk of the work, taking the burden off of project maintainers.

The localization management platform [Crowdin](https://crowdin.com/) is offering a free supported enterprise organization for Scientific Python translations. This is the platform we used for numpy.org. At this moment you would not need to decide what if anything you would do with translated content. *However, to get things started, I'd like to ask permission to fill out the [Crowdin Open Source Project Setup Request ](https://crowdin.com/page/open-source-project-setup-request) form on your behalf, to allow me to add a project to the Scientific Python Crowdin organization for Scikit-Learn.* 

For those interested. Here are the specifics of what I'd do with this.

- Create a GitHub repository which mirrors the content from the Scikit-Learn brochure website.
- Setup a cron github action which polls for updates to the Scikit-Learn website content and helps keep the mirror up to date.
- Sync this repository to the Scikit-Learn Crowdin project. Translate can then translate the content, and Crowdin will automatically push commits to a PR against the repository mirroring the website content.

The end product will be a repository with parallel versions of the website content in a variety of languages which is kept up to date. If you want to host the translations on your webpage like NumPy does, myself and/or a colleague from Quansight would be supported by the grant to help make that happen.

Please let me know if you have any questions.

COMMENT:
I personally would like to see how this looks like. Since we now have moved to the pydata-theme, I suspect the theme would also support this language switch which should make it easy for us to adopt it.

When that happens, and the translations infrastructure is set nicely, then I don't see much of a risk to proceed.

Labels: Needs Decision
Add metrics.gini_index_score()

### Describe the workflow you want to enable

The [Gini index](https://en.wikipedia.org/wiki/Gini_coefficient) metric (that is based on [Lorenz curve](https://en.wikipedia.org/wiki/Lorenz_curve)) is widely used in the insurance industry for evaluating the performance (ranking power) of various risk models.

### Describe your proposed solution

2 sklearn examples already includes code for calculating the gini index metric [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_poisson_regression_non_normal_loss.py#L517) and [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_tweedie_regression_insurance_claims.py#L676)

Related to #28534

### Describe alternatives you've considered, if relevant

_No response_

### Additional context

_No response_

COMMENT:
Recently, there was a discussion about this in https://github.com/scikit-learn/scikit-learn/issues/28144 (PR https://github.com/scikit-learn/scikit-learn/pull/28156).

Quote from one of the core developers (https://github.com/scikit-learn/scikit-learn/issues/28144#issuecomment-1894342745):
> You will find this simple formula implemented in some of our examples, too. Because it is so simple, I‘m against adding it to the already large metrics API.

Labels: New Feature
Add metrics.gini_index_score()

### Describe the workflow you want to enable

The [Gini index](https://en.wikipedia.org/wiki/Gini_coefficient) metric (that is based on [Lorenz curve](https://en.wikipedia.org/wiki/Lorenz_curve)) is widely used in the insurance industry for evaluating the performance (ranking power) of various risk models.

### Describe your proposed solution

2 sklearn examples already includes code for calculating the gini index metric [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_poisson_regression_non_normal_loss.py#L517) and [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_tweedie_regression_insurance_claims.py#L676)

Related to #28534

### Describe alternatives you've considered, if relevant

_No response_

### Additional context

_No response_

COMMENT:
I'm not sure, but there seems to be 2 different gini index/coefficient definitions:
1. Defined on the output of a binary classifier:
Defines here: https://en.wikipedia.org/wiki/Gini_coefficient#Relation_to_other_statistical_measures and in [roc_auc_score()](https://scikit-learn.org/stable/modules/generated/sklearn.metrics.roc_auc_score.html) notes (`gini = 2 * roc_auc - 1`)

2. Defined on a more general float variable. (not necessarily the output of a binary classifier):
Defines here: https://en.wikipedia.org/wiki/Gini_coefficient and in this code example:
   ```python
   ordered_samples, cum_claims = lorenz_curve(y_true, y_pred, exposure)
   gini = 1 - 2 * auc(ordered_samples, cum_claims)
   ```
   Note that this code does not use `roc_auc_score()`, it uses `lorenz_curve()` and then calculate the area under the Lorenz curve (not the area under the ROC curve) using `auc()`

Labels: New Feature
Add metrics.gini_index_score()

### Describe the workflow you want to enable

The [Gini index](https://en.wikipedia.org/wiki/Gini_coefficient) metric (that is based on [Lorenz curve](https://en.wikipedia.org/wiki/Lorenz_curve)) is widely used in the insurance industry for evaluating the performance (ranking power) of various risk models.

### Describe your proposed solution

2 sklearn examples already includes code for calculating the gini index metric [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_poisson_regression_non_normal_loss.py#L517) and [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_tweedie_regression_insurance_claims.py#L676)

Related to #28534

### Describe alternatives you've considered, if relevant

_No response_

### Additional context

_No response_

COMMENT:
You are right, but I'm assuming that a similar argument (too simple to include in the library) could be made for Gini coefficient you are requesting (sklearn/core-devs will know better).

Labels: New Feature
Add metrics.gini_index_score()

### Describe the workflow you want to enable

The [Gini index](https://en.wikipedia.org/wiki/Gini_coefficient) metric (that is based on [Lorenz curve](https://en.wikipedia.org/wiki/Lorenz_curve)) is widely used in the insurance industry for evaluating the performance (ranking power) of various risk models.

### Describe your proposed solution

2 sklearn examples already includes code for calculating the gini index metric [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_poisson_regression_non_normal_loss.py#L517) and [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_tweedie_regression_insurance_claims.py#L676)

Related to #28534

### Describe alternatives you've considered, if relevant

_No response_

### Additional context

_No response_

COMMENT:
See https://github.com/scikit-learn/scikit-learn/pull/21320#issuecomment-1983962648 .

Labels: New Feature
Add metrics.gini_index_score()

### Describe the workflow you want to enable

The [Gini index](https://en.wikipedia.org/wiki/Gini_coefficient) metric (that is based on [Lorenz curve](https://en.wikipedia.org/wiki/Lorenz_curve)) is widely used in the insurance industry for evaluating the performance (ranking power) of various risk models.

### Describe your proposed solution

2 sklearn examples already includes code for calculating the gini index metric [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_poisson_regression_non_normal_loss.py#L517) and [here](https://github.com/scikit-learn/scikit-learn/blob/4e8253703013b38da503e2354d82fb7fa43dd4ec/examples/linear_model/plot_tweedie_regression_insurance_claims.py#L676)

Related to #28534

### Describe alternatives you've considered, if relevant

_No response_

### Additional context

_No response_

COMMENT:
Almost a duplicate: #10003.

Labels: New Feature