Ensure we only deal with ns datetime64 arrays