Scalar datetime64 and timedelta64 support

I seem to recall seeing a few bugs in the past that only happened in object mode, so I do think it is valuable to test both directions.