BrandonFors/pandas-github-issues huggingface dataset:
BUG  fix for str.startswith and str.endswith with tuple arg for `"string[pyarrow]"` dtype (GH#54942)
State: closed


- [x] closes #54942
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Bug
name: Strings
description: String extension data type and string data

Comments:
I will probably have time to fix this tonight.
This pull request is stale because it has been open for thirty days with no activity. Please [update](https://pandas.pydata.org/pandas-docs/stable/development/contributing.html#updating-your-pull-request) and respond to this comment if you're still interested in working on this.
Thanks @ChronoJon
BUG df.plot.box handles matplotlib Axes with sharey=True
State: closed

- [x] closes #54941 
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Visualization
description: plotting

Comments:
I think this is a first fix. However, there is still a discrepancy between `df.boxplot` and `df.plot.box`:

### `df.plot.box`

<img width="859" alt="image" src="https://github.com/pandas-dev/pandas/assets/7454015/4a06e68d-e221-479d-ab91-de1428b07370">

### `df.boxplot`

<img width="828" alt="image" src="https://github.com/pandas-dev/pandas/assets/7454015/99339d8f-d320-47e5-8e16-194516a9f17f">

On the `df.plot.box`, the minor ticks are visible mainly due to calling this function:

https://github.com/pandas-dev/pandas/blob/ac8d34dd9a3a05bf0c5108e808d3ab0a4e80a93b/pandas/plotting/_matplotlib/tools.py#L318-L331

The `plt.boxplot` will not create the minor ticks but with the plot accessor, the `_adorn_subplots` is calling `handle_shared_axes` that is calling the function above and somehow recreating the minor ticks.

I would leave this issue for another PR because touching this part should have some other side effect on other plots.
Thanks @glemaitre
DEPR: deprecate string H, BH, CBH in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs
State: closed

xref #54061

- deprecated for Timedelta units 'H' in favour of 'h'
- deprecated for time series frequencies aliases 'H', 'BH', 'CBH' in favour of 'h', 'bh', 'cbh'
- deprecated resolution 'H' for Timedelta.resolution_string in favour of 'h'

Labels:
name: Frequency
description: DateOffsets
name: Deprecate
description: Functionality to remove in pandas

Comments:
I added tests for Hour and CustomBusinessHour and corrected the definition of `to_offset`. @MarcoGorelli, could you please take a look at the update?
looks like we're close, just got some conflicts from the A -> Y one (but I think you've mastered resolving conflicts now, so should be fine 😄 )
> looks like we're close, just got some conflicts from the A -> Y one (but I think you've mastered resolving conflicts now, so should be fine 😄 )

thanks, I resolved conflicts, ci is green.
Convert test_sql to pytest idiom
State: closed

Should make onboarding the new ADBC drivers a little easier.

This can be done in a few phases/PRs

@jorisvandenbossche 

Labels:
name: Testing
description: pandas testing functions or related to the test suite
name: IO SQL
description: to_sql, read_sql, read_sql_query

Comments:
I think this is mergable. Plan is to keep getting rid of these classes in follow ups; let me know of any feedback
Thanks @WillAyd
DOC: fixes Sphinx parallel build error on `doc/source/whatsnew/v0.24.0.rst`
State: closed

- Solves #54782
- Adding `from io import StringIO` in line 289 in `doc/source/whatsnew/v0.24.0.rst` solves Sphinx parallel build error when running `python make.py html` (or just `python make.py --single whatsnew/v0.24.0.rst`)

I'm new here and would like to contribute. Any advice would be very much appreciated! This should fix just a minor issue I came across when trying to build the doc.

Labels:
name: Docs

Comments:
Thanks @JohannaTrost
REGR: interpolate raising if fill_value is given
State: closed

- [ ] closes #54920 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Bug
name: Missing-data
description: np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate

Comments:
Is this a good time to remove the keyword from EA.interpolate?
There is not a straightforward equivalent for no fill_value, but not a string opinion
Thanks @phofl
DOC: add missing periods in JSON section
State: closed

Hello, I am new here and this is my first contribution (following the advice on how to start contributing from [here](https://blog.afeld.me/contributing-to-pandas-1a68692c4d47)). I just added 2 periods that were missing in the JSON section of the user guide.

Labels:
name: Docs

Comments:
Thanks for the suggestion, I'll make the changes immediately.

Thanks @JohannaTrost
BUG: Fix Rolling where duplicate datetimelike indexes are treated as consecutive rather than equal with closed='left' and closed='neither'
State: closed

- [x] closes #20712
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/v2.2.0.rst` file if fixing a bug or adding a new feature.


Labels:
name: Window
description: rolling, ewma, expanding

Comments:
Thanks @ihsansecer
DEPR: deprecate element-wise operations in (Series|DataFrame).transform
State: closed

- [x] closes #54906 
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

Still need to do docs, docstrings and whatsnew and possibly some separate deprecation tests but otherwise should be ready for review. 

Labels:
name: Deprecate
description: Functionality to remove in pandas
name: Stale

Comments:
> Still need to do docs, docstrings and whatsnew and possibly some separate deprecation tests but otherwise should be ready for review.

I think the implications of this PR can only be understood with appropriate changes to the docs.
The failure looks unrelated.
This pull request is stale because it has been open for thirty days with no activity. Please [update](https://pandas.pydata.org/pandas-docs/stable/development/contributing.html#updating-your-pull-request) and respond to this comment if you're still interested in working on this.
Thanks for the pull request, but it appears to have gone stale. Let's continue the affirm the choice to move forward with this in the issue before moving forward here
REGR: concat raising for 2 different ea dtypes
State: closed

- [ ] closes #54848 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Reshaping
description: Concat, Merge/Join, Stack/Unstack, Explode
name: Regression
description: Functionality that used to work in a prior pandas version

Comments:
Thanks @phofl
REGR: drop_duplicates raising for arrow strings
State: closed

- [ ] closes #54904 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Regression
description: Functionality that used to work in a prior pandas version
name: Algos
description: Non-arithmetic algos: value_counts, factorize, sorting, isin, clip, shift, diff

Comments:
Looks good just a merge conflict
DOC: updated docstring for deprecation of axis=1 in groupby
State: closed

- [x] closes #54873
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.


Labels:
name: Docs

Comments:
@rhshadrach @mroeschke I added a note on the deprecation. Would be great if you could give some inputs here?
Thanks @rsm-23
MAINT: Reflect changes from `numpy` namespace refactor Part 5
State: closed

Hi!
Here's a PR that reflects changes introduced in https://github.com/numpy/numpy/pull/24587. (The only item that needs to be modified in pandas is `np.recarray` access)

Labels:
name: Compat
description: pandas objects compatability with Numpy or Python functions

Comments:
Thanks @mtsokol
Update warning message for consistency
State: closed

- [ ] closes #54892 (Replace #54892 with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Warnings
description: Warnings that appear or should be added to pandas

Comments:
Fixed a typo on the warning message to maintain consistency with other warning with pandas type
Thanks @paulpellissiercompass
REGR: setitem with part of a MultiIndex raises
State: closed

- [x] closes #54875
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/v2.1.1.rst` file if fixing a bug or adding a new feature.


Labels:
name: Regression
description: Functionality that used to work in a prior pandas version
name: MultiIndex

Comments:
thx @lukemanley
PERF: sort_index with an already monotonic MultiIndex
State: closed

- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/v2.2.0.rst` file if fixing a bug or adding a new feature.

```
import pandas as pd
import numpy as np

mi = pd.MultiIndex.from_product([np.arange(1000)] * 2)
df = pd.DataFrame(np.random.randn(len(mi)), index=mi)

%timeit df.sort_index()

# 100 ms ± 2.22 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)  <- main
# 4.17 ms ± 62.6 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)  <- PR
```

Labels:
name: Performance
description: Memory or execution speed performance
name: MultiIndex

Comments:
Thanks @lukemanley
REGR: get_group raising with axis=1
State: closed

- [ ] closes #54858 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Groupby
name: Regression
description: Functionality that used to work in a prior pandas version

Comments:
Owee, I'm MrMeeseeks, Look at me.

There seem to be a conflict, please backport manually. Here are approximate instructions:

1. Checkout backport branch and update it.

```
git checkout 2.1.x
git pull
```

2. Cherry pick the first parent branch of the this PR on top of the older branch:
```
git cherry-pick -x -m1 ab34dd68d5cda8476298c2422b98f34090e2e7e4
```

3. You will likely have some merge/cherry-pick conflict here, fix them and commit:

```
git commit -am 'Backport PR #54882: REGR: get_group raising with axis=1'
```

4. Push to a named branch:

```
git push YOURFORK 2.1.x:auto-backport-of-pr-54882-on-2.1.x
```

5. Create a PR against branch 2.1.x, I would have named this PR:

> "Backport PR #54882 on branch 2.1.x (REGR: get_group raising with axis=1)"

And apply the correct labels and milestones.

Congratulations — you did some good work! Hopefully your backport PR will be tested by the continuous integration and merged soon!

Remember to remove the `Still Needs Manual Backport` label once the PR gets merged.

If these instructions are inaccurate, feel free to [suggest an improvement](https://github.com/MeeseeksBox/MeeseeksDev).
                
@meeseeksdev backport 2.1.x
Owee, I'm MrMeeseeks, Look at me.

There seem to be a conflict, please backport manually. Here are approximate instructions:

1. Checkout backport branch and update it.

```
git checkout 2.1.x
git pull
```

2. Cherry pick the first parent branch of the this PR on top of the older branch:
```
git cherry-pick -x -m1 ab34dd68d5cda8476298c2422b98f34090e2e7e4
```

3. You will likely have some merge/cherry-pick conflict here, fix them and commit:

```
git commit -am 'Backport PR #54882: REGR: get_group raising with axis=1'
```

4. Push to a named branch:

```
git push YOURFORK 2.1.x:auto-backport-of-pr-54882-on-2.1.x
```

5. Create a PR against branch 2.1.x, I would have named this PR:

> "Backport PR #54882 on branch 2.1.x (REGR: get_group raising with axis=1)"

And apply the correct labels and milestones.

Congratulations — you did some good work! Hopefully your backport PR will be tested by the continuous integration and merged soon!

Remember to remove the `Still Needs Manual Backport` label once the PR gets merged.

If these instructions are inaccurate, feel free to [suggest an improvement](https://github.com/MeeseeksBox/MeeseeksDev).
REGR: read_csv raising when dtypes is specified with usecols
State: closed

- [ ] closes #54868 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Regression
description: Functionality that used to work in a prior pandas version
name: IO CSV
description: read_csv, to_csv

Comments:
Thanks @phofl 
Owee, I'm MrMeeseeks, Look at me.

There seem to be a conflict, please backport manually. Here are approximate instructions:

1. Checkout backport branch and update it.

```
git checkout 2.1.x
git pull
```

2. Cherry pick the first parent branch of the this PR on top of the older branch:
```
git cherry-pick -x -m1 75781c26d174b35a8ce3e788201bc949fb92be02
```

3. You will likely have some merge/cherry-pick conflict here, fix them and commit:

```
git commit -am 'Backport PR #54881: REGR: read_csv raising when dtypes is specified with usecols'
```

4. Push to a named branch:

```
git push YOURFORK 2.1.x:auto-backport-of-pr-54881-on-2.1.x
```

5. Create a PR against branch 2.1.x, I would have named this PR:

> "Backport PR #54881 on branch 2.1.x (REGR: read_csv raising when dtypes is specified with usecols)"

And apply the correct labels and milestones.

Congratulations — you did some good work! Hopefully your backport PR will be tested by the continuous integration and merged soon!

Remember to remove the `Still Needs Manual Backport` label once the PR gets merged.

If these instructions are inaccurate, feel free to [suggest an improvement](https://github.com/MeeseeksBox/MeeseeksDev).
REGR: comparing datetime vs None raises
State: closed

- [ ] closes #54870 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Regression
description: Functionality that used to work in a prior pandas version

Comments:
Looks good just needs a whatsnew
Added
```bash
2023-08-31T21:16:54.9053450Z /home/runner/work/pandas/pandas/doc/source/whatsnew/v2.1.1.rst:32: WARNING: Bullet list ends without a blank line; unexpected unindent.
```
BUG: read_parquet from public parquet file with AWS credentials in environment gives OSError
State: closed

- [x] closes #53701
- [ ] [Tests added and passed]
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

Added retry mechanism so public parquet files from s3 can be read regardless of valid or invalid credentials.

Labels:

Comments:
> I think the idea is to reuse `_get_filepath_or_buffer` if possible

I don't think it's possible to use `_get_filepath_or_buffer` because pyarrow doesn't support `storage_options`. If there is a work around to reuse `_get_filepath_or_buffer`, it would no longer be using the pyarrow FileSystem then and would default to fsspec. 
It would be good to unify the two since they perform very similar things
Thanks for the pull request, but it appears to have gone stale. If interested in continuing, please merge in the main branch, address any review comments and/or failing tests, and we can reopen.
WEB: Add 2.1 to the switcher
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Web
description: pandas website

Comments:
Let's give this a shot.
@lithomas1 FYI, no need to tag this with 2.1.1, because it doesn't need to be backported (This is hosted on the website, which is always built from main)
DOC issue 54822: per @DavidToneian recommendation, I used a specific …
State: closed

…version of the wikipedia source page for the example of reading HTML content.

- [ ] closes #54822
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
Thanks @idealcrouch 
Thanks a lot!

On Tue, Aug 29, 2023 at 3:58 PM Matthew Roeschke ***@***.***>
wrote:

> Thanks @idealcrouch <https://github.com/idealcrouch>
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/pandas-dev/pandas/pull/54859#issuecomment-1698047620>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AEMUBZO3VL4GJ37TFJUNKKDXXZCV3ANCNFSM6AAAAAA4DLMRCM>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>