BUG: to_timedelta of a scalar returns a scalar, closes #5410.