Talip7/scikit-learn-issues-multilabel huggingface dataset:
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
Seen in https://github.com/scikit-learn/scikit-learn/pull/24682 as well, looks like a real problem.
```
ERROR:root:
ERROR:root:ChecksumMismatchError: Conda detected a mismatch between the expected content and downloaded content
ERROR:root:for url 'https://repo.anaconda.com/pkgs/main/linux-64/blas-1.0-openblas.conda'.
ERROR:root:  download saved to: /usr/share/miniconda/pkgs/blas-1.0-openblas.conda
ERROR:root:  expected md5: 9ddfcaef10d79366c90128f5dc444be8
ERROR:root:  actual md5: 3dd8fc0a1d2d4442c273e29755b53416
ERROR:root:
ERROR:root:
Traceback (most recent call last):
  File "/usr/share/miniconda/bin/conda-lock", line 10, in <module>
    sys.exit(main())
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/share/miniconda/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/share/miniconda/lib/python3.9/site-packages/conda_lock/conda_lock.py", line 1288, in install
    install_func(file=lockfile)
  File "/usr/share/miniconda/lib/python3.9/site-packages/conda_lock/conda_lock.py", line 206, in do_conda_install
    _conda(
  File "/usr/share/miniconda/lib/python3.9/site-packages/conda_lock/invoke_conda.py", line 127, in _invoke_conda
    raise subprocess.CalledProcessError(
poetry.utils._compat.CalledProcessError: Command '['/usr/share/miniconda/bin/conda', 'create', '--file', 'build_tools/azure/py38_conda_defaults_openblas_linux-64_conda.lock', '--yes', '--name', 'testvenv']' returned non-zero exit status 1.
```

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
Since this is a problem of checksum, we should probably ping people at conda-forge?

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
This is the defaults channel ... I can reproduce locally with only conda:
```
conda create -n del 'blas=1=*openblas*' -c defaults
```

Full output:
```
❯ conda create -n del 'blas=1=*openblas*' -c defaults
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /home/lesteve/miniconda3/envs/del

  added / updated specs:
    - blas==1[build=*openblas*]


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |         openblas          46 KB
    ------------------------------------------------------------
                                           Total:          46 KB

The following NEW packages will be INSTALLED:

  blas               pkgs/main/linux-64::blas-1.0-openblas None


Proceed ([y]/n)? 


Downloading and Extracting Packages
blas-1.0             | 46 KB     | ################################################################################################################## | 100% 

ChecksumMismatchError: Conda detected a mismatch between the expected content and downloaded content
for url 'https://repo.anaconda.com/pkgs/main/linux-64/blas-1.0-openblas.conda'.
  download saved to: /home/lesteve/miniconda3/pkgs/blas-1.0-openblas.conda
  expected sha256: c85b5d0a336b5be0f415c71fd7fe2eca59e09f42221bfa684aafef5510ba5487
  actual sha256: 5dc5483db0d9785b19e021cee418a8ee03e0ff0e5ebd0b75af4927746604e187
```

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
It would be great if others could confirm they reproduce as well, just to make sure this is not something broken with my environment.

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
I can reproduce it as well. Getting in touch with the default channel is a bit more tricky.

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
I created https://github.com/ContinuumIO/anaconda-issues/issues/13075 to report it to Anaconda since this is the `defaults` channel.

Not sure what work-around we have to avoid breaking our CI, beside switching to conda-forge ...

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
Not sure what we can do in the mean time. Shall we temporarily disable this CI entry while anaconda maintainers investigate and fix the corrupted file problem?

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
I would say:
- disable the build as a quick fix
- switch to conda-forge if there is no fix in sight in the not too far future

**Edit**: actually this build is from a few days ago ~One weird thing is that it seems the build pass sometimes e.g. https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47707&view=logs&jobId=c8afde5f-ef70-5983-62e8-c6b665ad6161&j=c8afde5f-ef70-5983-62e8-c6b665ad6161&t=4847942d-b90f-54a0-fc95-41b9c6d77c84 ...~

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
"I opened https://github.com/scikit-learn/scikit-learn/pull/24693 to temporarily disable the build.

**Edit:** the PR has now been merged so the py38_conda_defaults_openblas has been temporarily disabled.

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
## CI is no longer failing! ✅

[Successful run](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47876&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161) on Oct 23, 2022

Labels: Build / CI
⚠️ CI failed on Linux.py38_conda_defaults_openblas ⚠️

**CI failed on [Linux.py38_conda_defaults_openblas](https://dev.azure.com/scikit-learn/scikit-learn/_build/results?buildId=47750&view=logs&j=c8afde5f-ef70-5983-62e8-c6b665ad6161)** (Oct 18, 2022)
Unable to find junit file. Please see link for details.

COMMENT:
Closing then.

Labels: Build / CI
Path to HDBSCAN Inclusion

## Introduction
The HDBSCAN estimator implementation from [`scikit-learn-contrib/hdbscan`](https://github.com/scikit-learn-contrib/hdbscan) has been adopted, modified and refactored to conform to scikit-learn API and is now merged into the [`hdbscan`](https://github.com/scikit-learn/scikit-learn/tree/hdbscan) feature branch. There are still several changes to be made both before and after merging `hdbscan-->main`, and the goal of this issue is to serve as a tracker for the remaining changes, as well as to host meta discussion regarding the estimator as a whole as needed.

In particular, I would encourage discussion regarding:
1. What other tasks may be relevant/necessary for `HDBSCAN` overall.
2. What tasks should be promoted from follow-up work to mandatory work _before_ merging into `main`.

## To do for merger into `main`
Mandatory work before consideration for final merger

- [x] #24857
- [x] https://github.com/scikit-learn/scikit-learn/pull/24701
- [x] Clean `_hdbscan/_tree.pyx` 
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25768
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25826
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25827
    - [x] `HDBSCAN` `_tree.pyx` overhaul
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26011
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26096
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26101
- [x] https://github.com/scikit-learn/scikit-learn/pull/24698
- [x] https://github.com/scikit-learn/scikit-learn/pull/25538
- [x] #25134 

## Follow-up after merger into `main`
Discussion regarding follow-up tasks has been moved to #26801

CC: @thomasjpfan @jjerphan @glemaitre

COMMENT:
@Micky774 is HDBSCAN already available? Or are there still some things pending?

Labels: New Feature, module:cluster
Path to HDBSCAN Inclusion

## Introduction
The HDBSCAN estimator implementation from [`scikit-learn-contrib/hdbscan`](https://github.com/scikit-learn-contrib/hdbscan) has been adopted, modified and refactored to conform to scikit-learn API and is now merged into the [`hdbscan`](https://github.com/scikit-learn/scikit-learn/tree/hdbscan) feature branch. There are still several changes to be made both before and after merging `hdbscan-->main`, and the goal of this issue is to serve as a tracker for the remaining changes, as well as to host meta discussion regarding the estimator as a whole as needed.

In particular, I would encourage discussion regarding:
1. What other tasks may be relevant/necessary for `HDBSCAN` overall.
2. What tasks should be promoted from follow-up work to mandatory work _before_ merging into `main`.

## To do for merger into `main`
Mandatory work before consideration for final merger

- [x] #24857
- [x] https://github.com/scikit-learn/scikit-learn/pull/24701
- [x] Clean `_hdbscan/_tree.pyx` 
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25768
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25826
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25827
    - [x] `HDBSCAN` `_tree.pyx` overhaul
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26011
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26096
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26101
- [x] https://github.com/scikit-learn/scikit-learn/pull/24698
- [x] https://github.com/scikit-learn/scikit-learn/pull/25538
- [x] #25134 

## Follow-up after merger into `main`
Discussion regarding follow-up tasks has been moved to #26801

CC: @thomasjpfan @jjerphan @glemaitre

COMMENT:
> @Micky774 is HDBSCAN already available? Or are there still some things pending?

It is currently available on `main` and will be included in the [`1.3.0` release](https://scikit-learn.org/1.3/whats_new/v1.3.html#sklearn-cluster) ([see docs](https://scikit-learn.org/1.3/modules/generated/sklearn.cluster.HDBSCAN.html#sklearn.cluster.HDBSCAN)) 😄

Labels: New Feature, module:cluster
Path to HDBSCAN Inclusion

## Introduction
The HDBSCAN estimator implementation from [`scikit-learn-contrib/hdbscan`](https://github.com/scikit-learn-contrib/hdbscan) has been adopted, modified and refactored to conform to scikit-learn API and is now merged into the [`hdbscan`](https://github.com/scikit-learn/scikit-learn/tree/hdbscan) feature branch. There are still several changes to be made both before and after merging `hdbscan-->main`, and the goal of this issue is to serve as a tracker for the remaining changes, as well as to host meta discussion regarding the estimator as a whole as needed.

In particular, I would encourage discussion regarding:
1. What other tasks may be relevant/necessary for `HDBSCAN` overall.
2. What tasks should be promoted from follow-up work to mandatory work _before_ merging into `main`.

## To do for merger into `main`
Mandatory work before consideration for final merger

- [x] #24857
- [x] https://github.com/scikit-learn/scikit-learn/pull/24701
- [x] Clean `_hdbscan/_tree.pyx` 
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25768
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25826
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25827
    - [x] `HDBSCAN` `_tree.pyx` overhaul
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26011
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26096
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26101
- [x] https://github.com/scikit-learn/scikit-learn/pull/24698
- [x] https://github.com/scikit-learn/scikit-learn/pull/25538
- [x] #25134 

## Follow-up after merger into `main`
Discussion regarding follow-up tasks has been moved to #26801

CC: @thomasjpfan @jjerphan @glemaitre

COMMENT:
> > @Micky774 is HDBSCAN already available? Or are there still some things pending?
> 
> It is currently available on `main` and will be included in the [`1.3.0` release](https://scikit-learn.org/1.3/whats_new/v1.3.html#sklearn-cluster) ([see docs](https://scikit-learn.org/1.3/modules/generated/sklearn.cluster.HDBSCAN.html#sklearn.cluster.HDBSCAN)) 😄 

Ah awesome!

Labels: New Feature, module:cluster
Path to HDBSCAN Inclusion

## Introduction
The HDBSCAN estimator implementation from [`scikit-learn-contrib/hdbscan`](https://github.com/scikit-learn-contrib/hdbscan) has been adopted, modified and refactored to conform to scikit-learn API and is now merged into the [`hdbscan`](https://github.com/scikit-learn/scikit-learn/tree/hdbscan) feature branch. There are still several changes to be made both before and after merging `hdbscan-->main`, and the goal of this issue is to serve as a tracker for the remaining changes, as well as to host meta discussion regarding the estimator as a whole as needed.

In particular, I would encourage discussion regarding:
1. What other tasks may be relevant/necessary for `HDBSCAN` overall.
2. What tasks should be promoted from follow-up work to mandatory work _before_ merging into `main`.

## To do for merger into `main`
Mandatory work before consideration for final merger

- [x] #24857
- [x] https://github.com/scikit-learn/scikit-learn/pull/24701
- [x] Clean `_hdbscan/_tree.pyx` 
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25768
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25826
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25827
    - [x] `HDBSCAN` `_tree.pyx` overhaul
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26011
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26096
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26101
- [x] https://github.com/scikit-learn/scikit-learn/pull/24698
- [x] https://github.com/scikit-learn/scikit-learn/pull/25538
- [x] #25134 

## Follow-up after merger into `main`
Discussion regarding follow-up tasks has been moved to #26801

CC: @thomasjpfan @jjerphan @glemaitre

COMMENT:
You can try the release candidate by installing it from PyPi with:

```bash
pip install scikit-learn==1.3.0rc1
```

You can also install it from conda-forge with:

```bash
mamba install -c conda-forge/label/scikit-learn_rc scikit-learn==1.3.0rc1
```

Labels: New Feature, module:cluster
Path to HDBSCAN Inclusion

## Introduction
The HDBSCAN estimator implementation from [`scikit-learn-contrib/hdbscan`](https://github.com/scikit-learn-contrib/hdbscan) has been adopted, modified and refactored to conform to scikit-learn API and is now merged into the [`hdbscan`](https://github.com/scikit-learn/scikit-learn/tree/hdbscan) feature branch. There are still several changes to be made both before and after merging `hdbscan-->main`, and the goal of this issue is to serve as a tracker for the remaining changes, as well as to host meta discussion regarding the estimator as a whole as needed.

In particular, I would encourage discussion regarding:
1. What other tasks may be relevant/necessary for `HDBSCAN` overall.
2. What tasks should be promoted from follow-up work to mandatory work _before_ merging into `main`.

## To do for merger into `main`
Mandatory work before consideration for final merger

- [x] #24857
- [x] https://github.com/scikit-learn/scikit-learn/pull/24701
- [x] Clean `_hdbscan/_tree.pyx` 
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25768
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25826
    - [x] https://github.com/scikit-learn/scikit-learn/pull/25827
    - [x] `HDBSCAN` `_tree.pyx` overhaul
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26011
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26096
        - [x] https://github.com/scikit-learn/scikit-learn/pull/26101
- [x] https://github.com/scikit-learn/scikit-learn/pull/24698
- [x] https://github.com/scikit-learn/scikit-learn/pull/25538
- [x] #25134 

## Follow-up after merger into `main`
Discussion regarding follow-up tasks has been moved to #26801

CC: @thomasjpfan @jjerphan @glemaitre

COMMENT:
Closing due to inclusion in `1.3.0`

For discussion regarding follow-up work, please see #26801

Thanks again to everyone involved 😄

Labels: New Feature, module:cluster
correct SAGA weight update with prox

It seems that saga weights are being updated here with saga bit after the prox operator has been applied to SAG update
https://github.com/scikit-learn/scikit-learn/blob/8610e14f8a9acd488253444b8e551fb3e0d60ef7/sklearn/linear_model/_sag_fast.pyx.tp#L430

Should the prox operator be applied again here after SAGA weight update? 
Looks like it is what is happeng in lightning [implementation](https://github.com/scikit-learn-contrib/lightning/blob/dbbe833963280e675c124bbd5caadfcb13d89bd7/lightning/impl/sag_fast.pyx#L441)

COMMENT:
ping @arthurmensch

Labels: help wanted
correct SAGA weight update with prox

It seems that saga weights are being updated here with saga bit after the prox operator has been applied to SAG update
https://github.com/scikit-learn/scikit-learn/blob/8610e14f8a9acd488253444b8e551fb3e0d60ef7/sklearn/linear_model/_sag_fast.pyx.tp#L430

Should the prox operator be applied again here after SAGA weight update? 
Looks like it is what is happeng in lightning [implementation](https://github.com/scikit-learn-contrib/lightning/blob/dbbe833963280e675c124bbd5caadfcb13d89bd7/lightning/impl/sag_fast.pyx#L441)

COMMENT:
Maybe @agramfort @mblondel or @pierreablin would like to confirm this and someone might want to open a PR with non-regression test if possible?

Labels: help wanted
correct SAGA weight update with prox

It seems that saga weights are being updated here with saga bit after the prox operator has been applied to SAG update
https://github.com/scikit-learn/scikit-learn/blob/8610e14f8a9acd488253444b8e551fb3e0d60ef7/sklearn/linear_model/_sag_fast.pyx.tp#L430

Should the prox operator be applied again here after SAGA weight update? 
Looks like it is what is happeng in lightning [implementation](https://github.com/scikit-learn-contrib/lightning/blob/dbbe833963280e675c124bbd5caadfcb13d89bd7/lightning/impl/sag_fast.pyx#L441)

COMMENT:
ping @TomDLT 

I don't know this code very well

Labels: help wanted