BrandonFors/pandas-github-issues huggingface dataset:
BUG: guess_datetime_format doesn't guess just year 
State: closed

- [ ] closes #49126 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Datetime
description: Datetime data dtype

Comments:
thanks for reviewing!
DOC: fix versionchanged blank line usage (#49117)
State: closed

- [ ] closes #49117 
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Docs

Comments:
@datapythonista thank you for the review. Yes, docs built locally are rendered as expected ("Changed in version 0.25.0"). However, the CI doc build failed for a reason that looks unrelated to the changes introduced by the commit (URLError: <urlopen error [Errno 104] Connection reset by peer>).
Thanks! Connection errors happen sometimes, let's rerun the CI and see if we're lucky.
thx @mathpn
BUG: setitem raising for rhs with midx columns and tuple indexer
State: closed

- [x] closes #49121 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Indexing
description: Related to indexing on series/frames, not to indexes themselves
name: MultiIndex

Comments:
Thanks @phofl
REF: reso->creso
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Clean
name: Timestamp
description: pd.Timestamp and associated methods

Comments:
thx @jbrockmendel
BUG: _guess_datetime_format_for_array doesn't guess if first element is '' or 'NaT'
State: closed

- [ ] closes #49119 (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Bug
name: Datetime
description: Datetime data dtype

Comments:
thx @MarcoGorelli
BLD: Add meson build scripts
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

In preparation for the rest of the meson build system support.

Labels:
name: Build
description: Library building on various platforms

Comments:
Thanks, just some questions to follow up
PERF: StringArray from np.str_ array
State: closed

- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added an entry in the latest `doc/source/whatsnew/v2.0.0.rst` file if fixing a bug or adding a new feature.

Perf improvement when constructing a `StringArray` from a numpy array with type `np.str_`. 

```
       before           after         ratio
     [fb19ddbf]       [a4b0d732]
     <main>           <string-array-np-str>
-      23.0±0.8ms      6.15±0.04ms     0.27  array.StringArray.time_from_np_str_array
- ```

Labels:
name: Performance
description: Memory or execution speed performance
name: Strings
description: String extension data type and string data

Comments:
Thanks @lukemanley
REF: _reso->_creso
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:

Comments:
thx @jbrockmendel
ENH: date_range support reso keyword
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Datetime
description: Datetime data dtype
name: Non-Nano
description: datetime64/timedelta64 with non-nanosecond resolution

Comments:
Thanks @jbrockmendel
BUG: Timestamp.__richcmp__(dt64_unsupported_reso)
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Numeric Operations
description: Arithmetic, Comparison, and Logical operations
name: Non-Nano
description: datetime64/timedelta64 with non-nanosecond resolution
name: Timestamp
description: pd.Timestamp and associated methods

Comments:
Thanks @jbrockmendel
DOC: Update documentation for window parameter of rolling() to account for all possible data types
State: closed

- [X] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [X] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.

Related to https://github.com/pandas-dev/pandas-stubs/pull/385

Labels:
name: Docs
name: Window
description: rolling, ewma, expanding

Comments:
Thanks @gandhis1
CLN: simplify maybe_normalize_endpoints
State: closed

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Clean

Comments:
Thanks @jbrockmendel
REF: reso->creso in TSObject
State: closed

Based on the call on Wednesday I'm planning to make a reso keyword in Timestamp/Timedelta constructors, and change _as_unit to as_reso.  In preparation for that, I'm changing usages of reso to creso, and will be changing the existing _as_reso to _as_creso.

Labels:
name: Refactor
description: Internal refactoring of code
name: Non-Nano
description: datetime64/timedelta64 with non-nanosecond resolution

Comments:
Thanks @jbrockmendel
DEPS: Bump PyArrow to 6.0
State: closed

- [x] closes #48014 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Would help https://github.com/pandas-dev/pandas/pull/47781 and https://github.com/pandas-dev/pandas/pull/49078

1.0.1 was released on August 21, 2020 and 5.0.0 was released July 28 2021 (almost a year later).

Last time optional dependencies were bumped (https://github.com/pandas-dev/pandas/pull/47048), the versions were based on the version released ~1 year _prior_, so given that logic, could even bump to 6.0.0 (October 26, 2021)

Labels:
name: Dependencies
description: Required and optional dependencies
name: Arrow
description: pyarrow functionality

Comments:
> could even bump to 6.0.0

Go for it.  For a major release I think we're OK being really aggressive on this front.
I would also be +1 to a 6.0 bump
+1 in 6.0 as well
thx @mroeschke
CLN/TST: Convert `tests/tseries/offset` to pytest idioms
State: closed

- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).


* Converted `setup_method` to `pytest.fixture`s where needed
* Removed `Base` class (tests were moved in #49017) and refactored to a stand alone function


Labels:
name: Testing
description: pandas testing functions or related to the test suite
name: Frequency
description: DateOffsets
name: Clean

Comments:
Addressed and green
thanks @mroeschke
BUG: unstack accessing wrong index level when midx has mixed names
State: closed

- [x] closes #48763 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Reshaping
description: Concat, Merge/Join, Stack/Unstack, Explode
name: MultiIndex

Comments:
Thanks @phofl
ENH: Add use nullable dtypes to read_excel
State: closed

- [x] closes #36712 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

This sits on top of #49089. 

Would prefer round tripping during testing instead of adding those files to the repository

Labels:
name: Enhancement
name: IO Excel
description: read_excel, to_excel
name: NA - MaskedArrays
description: Related to pd.NA and nullable extension arrays

Comments:
This is ready now
Thanks @phofl
DEP: Enforce deprecation of mangle_dup cols and convert_float in read_excel
State: closed

I'll take care of the mangle dup cols within csv in a follow up when the other csv deprecations are merged

#41176 #34418


Labels:
name: IO Excel
description: read_excel, to_excel
name: Deprecate
description: Functionality to remove in pandas

Comments:
Thanks @phofl 
Coming from pandas v1:

We would get `float(cell.value)` then `str(...)` it via `dtype=str` and get `1.34e+56` as output.
Now we get an `int` of `133999999999999996199207003536481209407184768050474778624` with no way of getting the real value anymore.

![image](https://github.com/pandas-dev/pandas/assets/53433222/2db3db0d-7bd5-44f9-9d0e-67262c5431db)

openpyxl `3.1.3` or `3.0.10` doesn't make a difference.
Remove out-of-date external compatibility section from hdf_store docs
State: closed

- [x] closes #35419 (Replace xxxx with the GitHub issue number)
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


The code in this section is just wrong (in multiple ways – see issue), and the suggestion from @TomAugspurger was to just remove this section. Kinda late follow up 😅

Labels:
name: Docs
name: IO HDF5
description: read_hdf, HDFStore

Comments:
Thanks @ivirshup nice cleanup!
DEP: Enforce deprecation of date converters for csv
State: closed

- [x] closes #35741 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: IO CSV
description: read_csv, to_csv
name: Deprecate
description: Functionality to remove in pandas

Comments:
Thanks @phofl
DEP: Enforce numpy keyword deprecation in read_json
State: closed

#30636


Labels:
name: IO JSON
description: read_json, to_json, json_normalize
name: Deprecate
description: Functionality to remove in pandas

Comments:
Can you also remove the relevant code from JSONToObj.c?
Some pointers that may be helpful:

1. Should be able to remove the dtype struct member:
https://github.com/pandas-dev/pandas/blob/8b503a8ca06c6370fc3fbd972fc6b0a621df9531/pandas/_libs/src/ujson/python/JSONtoObj.c#L54

2. Can remove from kwargs:
https://github.com/pandas-dev/pandas/blob/8b503a8ca06c6370fc3fbd972fc6b0a621df9531/pandas/_libs/src/ujson/python/JSONtoObj.c#L497

3. Can remove local variable reference:
https://github.com/pandas-dev/pandas/blob/8b503a8ca06c6370fc3fbd972fc6b0a621df9531/pandas/_libs/src/ujson/python/JSONtoObj.c#L508

And any references of that variable you find
Not sure if I got everything.

I don't think we can remove the dtype, it is also used for dtype inference if nothing is passed
Nice cleanup - lgtm after conflict fixup
REGR: midx.values resetting freq of underyling index
State: closed

- [x] closes #49054 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [x] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.

We can not reset the freq with a shallow copy, since the freq is an attribute of the underlying DatetimeArray. A deep copy would cost performance, but calling take before converting to object nicely solves this issue.

Labels:
name: Regression
description: Functionality that used to work in a prior pandas version
name: MultiIndex

Comments:
Thanks @phofl
Backport PR #49053 on branch 1.5.x (REVERT caching in find_stack_level)
State: closed

#49053

Revert "PERF cache find_stack_level (#48023)"

This reverts commit 2f8d0a36703e81e4dca52ca9fe4f58c910c1b304.

Co-authored-by: MarcoGorelli <>
(cherry picked from commit 0106c26529900bad0561efb9c9180f7f016365b0)

- [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
- [ ] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [ ] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [ ] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: Warnings
description: Warnings that appear or should be added to pandas

Comments:
Sorry should have asked first, so this is not really a backport?
sorry not sure what you mean, isn't it a backport?
I got a bit confused, sorry for that. Did you revert this strictly on the 1.5.x branch or did you cherry pick #49053 onto the 1.5.x branch?
I followed the instructions from https://github.com/pandas-dev/pandas/pull/49053#issuecomment-1278617081 - there were some conflicts to resolve
Ok got you, thx for clearing this up for me :)
no worries, thanks for checking

actually, looks like I got a different commit message than usual as, after fixing the conflicts, I did
```
git cherry-pick --continue
```
rather than
```
git commit -am 'Backport PR #49053: REVERT caching in find_stack_level'
```
It looks like we removed a couple of find_stack_levels on main that are still present on 1.5.x
@phofl good to merge? I've been through the diff and it looks fine to me, doesn't look like anything unexpected has crept in when resolving conflicts
thx @MarcoGorelli
BUG: pickling subset of Arrow-backed data would serialize the entire data
State: closed

- [x] closes #42600 (Replace xxxx with the GitHub issue number)
- [x] [Tests added and passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#writing-tests) if fixing a bug or adding a new feature
- [x] All [code checks passed](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#pre-commit).
- [ ] Added [type annotations](https://pandas.pydata.org/pandas-docs/dev/development/contributing_codebase.html#type-hints) to new arguments/methods/functions.
- [x] Added an entry in the latest `doc/source/whatsnew/vX.X.X.rst` file if fixing a bug or adding a new feature.


Labels:
name: IO Pickle
description: read_pickle, to_pickle
name: Arrow
description: pyarrow functionality

Comments:
> Should we bumpy the minimum pyarrow version so that combine_chunks is available everywhere? 

For 2.0 let's bump it as high as we can.
BUG: redirect from meeting to community was incorrect
State: closed

I noticed that the redirect I created had the following bug:
https://pandas.pydata.org/docs/dev/development/development/meeting.html
redirected to:
https://pandas.pydata.org/docs/dev/development/development/community.html
instead of:
https://pandas.pydata.org/docs/dev/development/community.html

After a full local docs build this fix seems to address the problem. Please check me.

Labels:
name: Docs

Comments:
I checked and this worked on the CI doc build artifact 😌.