PERF/CLN: infer Period in infer_dtype, later index inference is faster
Merge pull request #3329 from jreback/period_perf

PERF/CLN: infer Period in infer_dtype, later index inference is faster

doesn't completely fix the problem (though though could just be noise), but helps in lots of other cases....