BUG: fix ValueError for byte_bounds() on datetime array
closes gh-4345