PERF/CI: fix benchmark import error + run asv check on all builds
State: closed

Fix benchmark suite import error on master and 0.23.
Run `asv check` on all commits to lint the benchmark suite.

Also, fixed a timeout error that appears on newer asv versions, 
which have an updated asizeof.py module.

Labels:
name: Benchmark
description: Performance (ASV) benchmarks

Comments:
# [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=h1) Report
> Merging [#26575](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=desc) into [master](https://codecov.io/gh/pandas-dev/pandas/commit/a60d1bd45a99519fad5024068db956e0aa1cc6a1?src=pr&el=desc) will **decrease** coverage by `<.01%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/pandas-dev/pandas/pull/26575/graphs/tree.svg?width=650&token=eZ4WkYLtcO&height=150&src=pr)](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master   #26575      +/-   ##
==========================================
- Coverage   91.84%   91.84%   -0.01%     
==========================================
  Files         174      174              
  Lines       50643    50643              
==========================================
- Hits        46515    46511       -4     
- Misses       4128     4132       +4
```

| Flag | Coverage Δ | |
|---|---|---|
| #multiple | `90.37% <ø> (ø)` | :arrow_up: |
| #single | `41.71% <ø> (-0.06%)` | :arrow_down: |

| [Impacted Files](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [pandas/io/gbq.py](https://codecov.io/gh/pandas-dev/pandas/pull/26575/diff?src=pr&el=tree#diff-cGFuZGFzL2lvL2dicS5weQ==) | `78.94% <0%> (-10.53%)` | :arrow_down: |
| [pandas/core/frame.py](https://codecov.io/gh/pandas-dev/pandas/pull/26575/diff?src=pr&el=tree#diff-cGFuZGFzL2NvcmUvZnJhbWUucHk=) | `97% <0%> (-0.12%)` | :arrow_down: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=footer). Last update [a60d1bd...6020370](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).

# [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=h1) Report
> Merging [#26575](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=desc) into [master](https://codecov.io/gh/pandas-dev/pandas/commit/a60d1bd45a99519fad5024068db956e0aa1cc6a1?src=pr&el=desc) will **decrease** coverage by `<.01%`.
> The diff coverage is `n/a`.

[![Impacted file tree graph](https://codecov.io/gh/pandas-dev/pandas/pull/26575/graphs/tree.svg?width=650&token=eZ4WkYLtcO&height=150&src=pr)](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master   #26575      +/-   ##
==========================================
- Coverage   91.84%   91.84%   -0.01%     
==========================================
  Files         174      174              
  Lines       50643    50643              
==========================================
- Hits        46515    46511       -4     
- Misses       4128     4132       +4
```

| Flag | Coverage Δ | |
|---|---|---|
| #multiple | `90.37% <ø> (ø)` | :arrow_up: |
| #single | `41.71% <ø> (-0.06%)` | :arrow_down: |

| [Impacted Files](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [pandas/io/gbq.py](https://codecov.io/gh/pandas-dev/pandas/pull/26575/diff?src=pr&el=tree#diff-cGFuZGFzL2lvL2dicS5weQ==) | `78.94% <0%> (-10.53%)` | :arrow_down: |
| [pandas/core/frame.py](https://codecov.io/gh/pandas-dev/pandas/pull/26575/diff?src=pr&el=tree#diff-cGFuZGFzL2NvcmUvZnJhbWUucHk=) | `97% <0%> (-0.12%)` | :arrow_down: |

------

[Continue to review full report at Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=footer). Last update [a60d1bd...69a617f](https://codecov.io/gh/pandas-dev/pandas/pull/26575?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).

So I see the benchmark step took 15 minutes in this PR - that would essentially run every time now right?
No, `asv check` takes a few seconds. The second part of the benchmark check, which is not changed in this PR, still runs in the same way as before this PR --- only when the benchmark suite itself has been changed.
Makes sense - wasn't registering at first that the benchmarks here are part of the diff :-)
Thanks @pv!