BrandonFors/pandas-github-issues huggingface dataset:
DOC: Updated set_index doc with a warning
State: closed

- [x] closes #60973 
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.


Labels:
name: Docs

Comments:
Thanks @SaraInCode
MNT: Bump dev pin on NumPy
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Dependencies
description: Required and optional dependencies

Comments:
@mroeschke @WillAyd  - it will be a significant change to start returning Python objects instead of NumPy across the board. Do we want to make that (in separate PRs) before merging this?
If it is a significant effort then I would say as long as we don't introduce new NumPy scalars in return values then we are good. We can leave it to separate exercises to hack away at that
> as long as we don't introduce new NumPy scalars in return values then we are good

Right - this PR does not introduce any new instances of NumPy scalars, just adjusts the docstrings with the new repr as of NumPy 2.0.
So prior to NumPy 2.0 these returned Python scalars but now they return NumPy scalars? 
No, the same object is being returned - always a NumPy scalar. Only the repr is changing when you go from NumPy < 2 to NumPy >= 2.
@Dr-Irv - friendly ping
> @Dr-Irv - friendly ping

Sorry - I was out the past 5 days!  Will look now
Thanks @rhshadrach
Update describe.py
State: closed

This PR fixes an issue where passing a single value to .describe(percentiles=[...]) would incorrectly include the 50th percentile (median) in the output. The fix ensures that only the explicitly requested percentiles are returned.

Changes:
Modified the .describe() method to avoid adding the 50th percentile by default when a custom percentiles list is provided.

Closes: #60550

Labels:
name: Enhancement

Comments:
Thanks for the PR, but https://github.com/pandas-dev/pandas/pull/61158 has addressed and closed the original issue so closing this PR. Happy to have your contributions towards other PRs
BUG(string dtype): groupby/resampler.min/max returns float on all NA strings
State: closed

- [x] closes #60810 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

Built on top of #60936

Labels:
name: Bug
name: Groupby
name: Missing-data
description: np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate
name: Strings
description: String extension data type and string data
name: Reduction Operations
description: sum, mean, min, max, etc.

Comments:
@mroeschke I think this is ready.
Thanks @rhshadrach 
Owee, I'm MrMeeseeks, Look at me.

There seem to be a conflict, please backport manually. Here are approximate instructions:

1. Checkout backport branch and update it.

```
git checkout 2.3.x
git pull
```

2. Cherry pick the first parent branch of the this PR on top of the older branch:
```
git cherry-pick -x -m1 a811388727bb0640528962191b0f4e50d8235cfd
```

3. You will likely have some merge/cherry-pick conflict here, fix them and commit:

```
git commit -am 'Backport PR #60985: BUG(string dtype): groupby/resampler.min/max returns float on all NA strings'
```

4. Push to a named branch:

```
git push YOURFORK 2.3.x:auto-backport-of-pr-60985-on-2.3.x
```

5. Create a PR against branch 2.3.x, I would have named this PR:

> "Backport PR #60985 on branch 2.3.x (BUG(string dtype): groupby/resampler.min/max returns float on all NA strings)"

And apply the correct labels and milestones.

Congratulations — you did some good work! Hopefully your backport PR will be tested by the continuous integration and merged soon!

Remember to remove the `Still Needs Manual Backport` label once the PR gets merged.

If these instructions are inaccurate, feel free to [suggest an improvement](https://github.com/MeeseeksBox/MeeseeksDev).
                
Backport -> https://github.com/pandas-dev/pandas/pull/61633
BUG: Fix concat DataFrame and Series with ignore_index=True
State: closed

- [x] closes #60723 
- [x] closes #56257 
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Bug
name: Reshaping
description: Concat, Merge/Join, Stack/Unstack, Explode

Comments:
Hi @rhshadrach

Requesting a review as no reviewer is assigned to the PR

Thanks
Hi @rhshadrach I have done the requested changes from the review
Thanks @Anurag-Varma
DOC: Add missing punctuation to pandas documentation
State: closed

Add missing punctuation to pandas documentation:

1. `doc/source/user_guide/text.rst`
2. `doc/source/reference/arrays.rst`

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
Thanks @star1327p
DOC: Add missing attributes to Styler class
State: closed

- [x] closes #60815
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Validated changes using `python scripts/validate_docstrings.py pandas.io.formats.style.Styler`

### Tasks performed

- Added documentation for `index` and `columns` under `Attributes` in `pandas.io.formats.style.Styler` as [discussed](https://github.com/pandas-dev/pandas/issues/60815#issuecomment-2665924948).

### Additional Comments

- First PR on this project, your feedback is highly valuable to me, looking forward to contributing more and more in the coming days!


Labels:
name: Docs

Comments:
Thanks @Rishab260
DOC: Clarify the magnitude for truncation
State: closed

Original statement: When values differ with magnitude :math:`1/np.finfo(np.double).eps` this results in truncation.

Added clarification: `1/np.finfo(np.double).eps` is approximately `4.5 x 10^{15}`.

https://pandas.pydata.org/docs/dev/user_guide/window.html

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
Thanks @star1327p
GH60942 Update docs and overload for Series.rename
State: closed

- [x] closes #60942 
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs
name: Typing
description: type annotations, mypy/pyright type checking
name: Series
description: Series data structure

Comments:
@loicdiridollou If you are new to the repo, you should run pre commit check so that the commits and checks dont fail.

[Docs link](https://pandas.pydata.org/docs/dev/development/contributing_codebase.html#id3)
> @loicdiridollou If you are new to the repo, you should run pre commit check so that the commits and checks dont fail.
> 
> [Docs link](https://pandas.pydata.org/docs/dev/development/contributing_codebase.html#id3)

Sorry my bad, I thought they would install automatically so when I committed I did not bother checking, this is fixed.
Thanks @loicdiridollou
BUG: fix error message for multiindex.fillna
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

It's very surprising to me that there's 3 different tests which explicitly check this error message, yet the discrepancy was never noticed (unless I'm missing something here, which is definitely a possibility)

Labels:
name: Error Reporting
description: Incorrect or improved errors from pandas
name: MultiIndex

Comments:
Thanks @MarcoGorelli
DOC: Correct a typo in merging.rst
State: closed

Correct a typo in merging.rst.

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
Thanks @star1327p
Feature auto infer orient as table or split in read_json
State: closed

- [x] closes #52713
- [x] [Tests added and passed]
- [x] All [code checks passed]
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

### Example:

This example demonstrates how to use the updated functionality of `read_json` to correctly handle the new `orient='table'` format.

#### Saving DataFrame to JSON with orient='table':

```python
import pandas as pd

# Create a sample DataFrame
df = pd.DataFrame({"A": [1, 2, 3]})

df.to_json('test.json', indent=1, orient='table')
read = pd.read_json('test.json')
print(read)

   A
0  1
1  2
2  3
```

#### Saving DataFrame to JSON with orient='split':

```python
df = pd.DataFrame({"A": [1, 2, 3]})

df.to_json('test.json', indent=1, orient='split')
read = pd.read_json('test.json')
print(read)

   A
0  1
1  2
2  3
```

Labels:
name: IO JSON
description: read_json, to_json, json_normalize

Comments:
I am also generally -1 on this feature. We've tried to move toward explicit behaviors over time, and inferencing goes against explicitness.
Hi @mroeschke 
Oh alright.
Thanks for the interest in a PR @chandra-teajunkie , but from the discussion I don't think this is one we will move forward with
Thanks for the feedbacks!
Backport PR #60940: ENH: Add dtype argument to str.decode
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Enhancement
name: Strings
description: String extension data type and string data

Comments:
Thanks @rhshadrach
remove unused dtype from MultiIndex constructor
State: closed

One possible fix for #60962

This could go through a deprecation warning, although anyone currently passing `dtype` to `MultiIndex` is already having their code (silently) not behave as intended. Keeping the parameter but raising an error wouldn't be any less breaking that removing the argument. Happy to take a different strategy if people prefer though

- [ ] closes #60962 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: MultiIndex

Comments:
If no end user has ever complained about this I would be OK with removing as well. Can always add back at a later date if the need arises
Thanks @MarcoGorelli
DOC: Improve examples in Series.str.isnumeric shared docstring to include decimal, fraction, negatives and exponents (#60750)
State: closed

- [x] closes #60750 
- [x] All [code checks passed](https://pandas.pydata.org/docs/dev/development/contributing_documentation.html#previewing-changes)
- [x] Validated changes for formatting issues using `scripts/validate_docstrings.py`

### Tasks performed

1.  Improved the existing example for `Series.str.isnumeric` to include Unicode fractions using shared docs.

2. Add a new example to clear confusion regarding decimals, exponents and negative values

### Before
![image](https://github.com/user-attachments/assets/e599b678-2736-4200-8e01-21445e5b59de)


### After 
![image](https://github.com/user-attachments/assets/c6180846-de53-4058-829d-5fb7da8c58a3)






Labels:
name: Docs

Comments:
Thanks @akj2018
ENH: updated str_is_numeric(), allows floats
State: closed

- [X] closes #60750 
- [X] Tests added and passed
- [X] All code checks passed
- [X] Added type annotations to new arguments/methods/functions.
- [X] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:

Comments:
Thanks for the pull request.

The original issue is not a bug and only a doc improvement is required which I believe is being addressed by #60960
Thanks for the PR but the original issue has been addressed by https://github.com/pandas-dev/pandas/pull/60960, so closing.
Bug: Fix convert_dtypes not preserving timezone details for ArrowDtype
State: closed

- [x] closes #60237
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Dtype Conversions
description: Unexpected or buggy dtype conversions

Comments:
Hi @mroeschke 

I have done the requested changes, please review it at your convenience. 

Thanks 
Thanks @Anurag-Varma
DOC: Correct a typo: Gitlens -> GitLens
State: closed

Correct a typo: Gitlens -> GitLens

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
Thanks @star1327p
Bug fix contribution
State: closed

- [ ] closes #60766 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:

Comments:
Thanks for the pull request, but it appears to have gone stale. If interested in continuing, please merge in the main branch, address any review comments and/or failing tests, and we can reopen.
Fix error `value_counts` result with pyarrow categorical columns
State: closed

- [x] closes #60563 
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/v3.0.0.rst` file if fixing a bug or adding a new feature.


Labels:
name: Categorical
description: Categorical Data Type
name: Arrow
description: pyarrow functionality

Comments:
Thanks @chilin0525
[backport 2.3.x] API: ignore empty range/object dtype in Index setop operations (string dtype compat) (#60797)
State: closed

(cherry picked from commit ee06e714fcb35e0b6d321b3edd454eb0e363e5e4)

Backport of https://github.com/pandas-dev/pandas/pull/60797

Labels:

Comments:
This pull request is stale because it has been open for thirty days with no activity. Please [update](https://pandas.pydata.org/pandas-docs/stable/development/contributing.html#updating-your-pull-request) and respond to this comment if you're still interested in working on this.
I guess this is not happening. Feel free to reopen if needed.
@mroeschke FWIW best not to remove milestones from backport PRs, because then we will certainly loose track of them .. (or in general please add a comment when doing so, such that it generates a notification, because unfortunately github makes milestone changes silent)

I of course should have updated this a while ago, but ideally this still goes into 2.3.x (assuming there might be some more bugfix release)
Ah sorry about that @jorisvandenbossche. Thanks for the reminder 
There are a bunch of failures in the expression tests, eg `pandas/tests/test_expressions.py::TestExpressions::test_run_binary[eq-True-_integer_integers]`, but that doesn't seem related (and also seeing it on another backport PR)
> There are a bunch of failures in the expression tests, eg `pandas/tests/test_expressions.py::TestExpressions::test_run_binary[eq-True-_integer_integers]`, but that doesn't seem related (and also seeing it on another backport PR)

Handling that in https://github.com/pandas-dev/pandas/pull/61638
ENH: Add HalfYear offsets
State: closed

- [ ] closes #60928
- [ ] closes #22362
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Frequency
description: DateOffsets

Comments:
@rhshadrach I was able to add the half-year offset classes without too much added complexity. However, I haven't enabled them to be used as periods - that will take more code changes and tests. Do you recommend concluding this here or go all the way to supporting half-year periods? cc: @MarcoGorelli 
@snitish - I think holding off on periods makes sense. This is already a sizable PR.
Thanks again @snitish
BUG: Fix MultiIndex from_tuples on tuples with NaNs
State: closed

- [x] closes #60695 
       closes #60988 
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Bug
name: MultiIndex

Comments:
@Anurag-Varma - I think this looks good, just need to resolve the conflict by merging main.
> @Anurag-Varma - I think this looks good, just need to resolve the conflict by merging main.

Thanks @rhshadrach I fixed the changes which you have mentioned in the review and sent the new commit
Thanks @Anurag-Varma!