Module Expr Str Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias Import alias identifier TryExcept body ImportFrom alias handlers ExceptHandler type NameLoad body Raise Call NameLoad Str Assign NameStore BinOpMult Num Num FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr Str NameLoad If CompareIs NameLoad NameLoad body Raise Call NameLoad Str Return TupleLoad Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body If NameLoad body Return Call AttributeLoad Call NameLoad NameLoad NameLoad attr NameLoad NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr If CompareIs Call NameLoad NameLoad Str NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad Call NameLoad NameLoad NameLoad attr NameLoad NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr NameLoad Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body If CompareIsNot NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults Str NameLoad Str body Expr Str If BoolOpOr CompareEq NameLoad Str CompareEq NameLoad Str body Return Call NameLoad AttributeLoad NameLoad attr NameLoad keyword NameLoad orelse If BoolOpOr CompareEq NameLoad Str CompareEq NameLoad Str body Return Call NameLoad AttributeLoad NameLoad attr NameLoad keyword NameLoad orelse Raise Call NameLoad BinOpMod Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Str NameLoad attr Num Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Assign NameStore ListLoad While NameLoad body Assign NameStore Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad For NameStore AttributeLoad NameLoad attr body If Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr orelse Break Return NameLoad decorator_list Call AttributeLoad NameLoad attr decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign TupleStore AttributeStore NameLoad attr AttributeStore NameLoad attr Call NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad name NameStore body If CompareEq AttributeLoad NameLoad attr Num body Raise Call NameLoad AttributeLoad NameLoad attr BinOpMod Str AttributeLoad NameLoad attr orelse Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr NameLoad Raise Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad keyword AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Return Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad decorator_list Call AttributeLoad NameLoad attr FunctionDef arguments args NameParam NameParam defaults Num body Expr Str Return Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults Num body Expr Str Return Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults Num NameLoad body Expr Str Expr Call AttributeLoad NameLoad attr If UnaryOpNot Call AttributeLoad NameLoad attr body Return Str Assign NameStore ListLoad If CompareIs NameLoad NameLoad body Assign NameStore Num Assign NameStore Call NameLoad NameLoad Call AttributeLoad NameLoad attr If CompareLt NameLoad Num body Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore NameLoad While CompareGt NameLoad Num body Expr Call AttributeLoad NameLoad attr Assign NameStore BinOpSub AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call NameLoad BinOpSub Call NameLoad AttributeLoad NameLoad attr NameLoad NameLoad If NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Call NameLoad AttributeLoad NameLoad attr If CompareNotEq NameLoad Num body Assign NameStore BinOpSub BinOpAdd Num NameLoad NameLoad Assign NameStore NameLoad Expr Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad BinOpAdd NameLoad NameLoad AugAssignAdd AttributeStore NameLoad attr NameLoad AugAssignSub NameStore NameLoad If NameLoad body Break Return Call AttributeLoad Str attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body If BoolOpOr UnaryOpNot AttributeLoad NameLoad attr CompareLtE BinOpAdd AttributeLoad NameLoad attr Call NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return BinOpSub AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str If CompareEq NameLoad Num body Return Str Assign NameStore BinOpSub BinOpAdd NameLoad NameLoad Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Num Assert CompareEq Call NameLoad NameLoad NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults AttributeLoad NameLoad attr body Expr Str Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr Num If CompareEq NameLoad AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr NameLoad orelse If CompareEq NameLoad AttributeLoad NameLoad attr body AugAssignAdd AttributeStore NameLoad attr NameLoad orelse If CompareEq NameLoad AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr BinOpAdd AttributeLoad NameLoad attr NameLoad orelse Raise Call NameLoad BinOpMod Str NameLoad Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Raise Call NameLoad Str decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list decorator_list ClassDef bases NameLoad body Expr Str ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore ListLoad Assign NameStore Num While CompareLt NameLoad NameLoad body Assign NameStore Call NameLoad BinOpSub NameLoad NameLoad Call NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Slice Num NameLoad Assign AttributeStore NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad AugAssignAdd AttributeStore NameLoad attr NameLoad AugAssignAdd NameStore NameLoad If UnaryOpNot AttributeLoad NameLoad attr body TryExcept body Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler type NameLoad body Break Return Call AttributeLoad Str attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults AttributeLoad NameLoad attr body If BoolOpAnd CompareEq NameLoad AttributeLoad NameLoad attr CompareEq NameLoad Num body Return orelse If BoolOpAnd CompareEq NameLoad AttributeLoad NameLoad attr CompareEq NameLoad AttributeLoad NameLoad attr body Return Raise NameLoad decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Raise Call NameLoad Str decorator_list decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Str body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign TupleStore AttributeStore NameLoad attr AttributeStore NameLoad attr Call NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Num Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr decorator_list AttributeLoad NameLoad attr FunctionDef arguments args NameParam NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad AugAssignAdd AttributeStore NameLoad attr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Raise Call NameLoad Str decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list decorator_list
N/A N/A Google Cloud Storage client.

This library evolved from the Google App Engine GCS client available at
https://github.com/GoogleCloudPlatform/appengine-gcs-client.
 N/A errno N/A fnmatch N/A logging N/A multiprocessing N/A os N/A re N/A StringIO N/A threading google.cloud.dataflow.internal auth google.cloud.dataflow.utils retry apitools.base.py.exceptions HttpError N/A apitools.base.py.transfer transfer N/A N/A google.cloud.dataflow.internal.clients storage N/A N/A N/A ImportError N/A N/A N/A RuntimeError Google Cloud Storage I/O not supported for this execution environment (could not import storage API client). N/A DEFAULT_READ_BUFFER_SIZE N/A 1024 1024 parse_gcs_path N/A N/A gcs_path N/A N/A N/A Return the bucket and object names of the given gs:// path. N/A match N/A N/A re match ^gs://([^/]+)/(.+)$ gcs_path N/A N/A match None N/A N/A N/A ValueError GCS path must be in the form gs://<bucket>/<object>. N/A N/A N/A N/A match group 1 N/A N/A match group 2 N/A GcsIO N/A object N/A N/A Google Cloud Storage I/O client. N/A _instance None __new__ N/A N/A cls storage_client N/A None N/A N/A storage_client N/A N/A N/A N/A N/A super GcsIO cls __new__ cls storage_client N/A N/A local_state N/A N/A threading local N/A N/A N/A getattr local_state gcsio_instance None None N/A N/A credentials N/A N/A auth get_service_credentials N/A storage_client N/A N/A storage StorageV1 credentials credentials N/A N/A local_state gcsio_instance N/A N/A N/A super GcsIO cls __new__ cls storage_client N/A N/A N/A local_state gcsio_instance client storage_client N/A N/A local_state gcsio_instance N/A __init__ N/A N/A self storage_client N/A None N/A N/A N/A storage_client None N/A N/A N/A self client storage_client N/A open N/A N/A self filename mode read_buffer_size mime_type N/A r DEFAULT_READ_BUFFER_SIZE application/octet-stream N/A N/A Open a GCS file path for reading or writing.

    Args:
      filename: GCS file path in the form gs://<bucket>/<object>.
      mode: 'r' for reading or 'w' for writing.
      read_buffer_size: Buffer size to use during read operations.
      mime_type: Mime type to set for write operations.

    Returns:
      file object.

    Raises:
      ValueError: Invalid open file mode.
     N/A N/A N/A mode r N/A mode rb N/A N/A N/A GcsBufferedReader N/A self client filename buffer_size read_buffer_size N/A N/A N/A N/A mode w N/A mode wb N/A N/A N/A GcsBufferedWriter N/A self client filename mime_type mime_type N/A N/A N/A ValueError N/A Invalid file open mode: %s. mode N/A glob N/A N/A self pattern N/A N/A N/A Return the GCS path names matching a given path name pattern.

    Path name patterns are those recognized by fnmatch.fnmatch().  The path
    can contain glob characters (*, ?, and [...] sets).

    Args:
      pattern: GCS file path pattern in the form gs://<bucket>/<name_pattern>.

    Returns:
      list of GCS file paths matching the given pattern.
     N/A N/A bucket name_pattern N/A parse_gcs_path pattern N/A prefix N/A N/A N/A N/A re match ^[^[*?]* name_pattern group 0 N/A request N/A N/A storage StorageObjectsListRequest bucket bucket prefix prefix N/A object_paths N/A N/A True N/A N/A response N/A N/A N/A N/A self client objects List request N/A item N/A response items N/A N/A N/A N/A fnmatch fnmatch N/A item name name_pattern N/A N/A N/A N/A object_paths append N/A gs://%s/%s N/A N/A item bucket N/A item name N/A N/A response nextPageToken N/A N/A N/A request pageToken N/A response nextPageToken N/A N/A N/A object_paths N/A N/A N/A retry with_exponential_backoff N/A GcsBufferedReader N/A object N/A N/A A class for reading Google Cloud Storage files. __init__ N/A N/A self client path buffer_size N/A DEFAULT_READ_BUFFER_SIZE N/A N/A N/A self client client N/A N/A self path path N/A N/A N/A self bucket N/A self name N/A parse_gcs_path path N/A N/A self buffer_size buffer_size N/A get_request N/A N/A storage StorageObjectsGetRequest bucket N/A self bucket object N/A self name N/A N/A N/A metadata N/A N/A self _get_object_metadata get_request N/A N/A N/A HttpError N/A http_error N/A N/A N/A N/A http_error status_code 404 N/A N/A N/A IOError N/A errno ENOENT N/A Not found: %s N/A self path N/A N/A N/A N/A logging error HTTP error while requesting file %s: %s N/A self path http_error N/A N/A N/A self size N/A metadata size N/A N/A get_request generation N/A metadata generation N/A N/A self download_stream N/A N/A StringIO StringIO N/A N/A self downloader N/A N/A transfer Download N/A self download_stream auto_transfer False N/A N/A N/A N/A N/A self client objects Get get_request download N/A self downloader N/A N/A self position 0 N/A N/A self buffer N/A N/A self buffer_start_position 0 N/A N/A self closed False N/A _get_object_metadata N/A N/A self get_request N/A N/A N/A N/A N/A N/A N/A self client objects Get get_request N/A N/A N/A retry with_exponential_backoff read N/A N/A self size N/A -1 N/A N/A Read data from a GCS file.

    Args:
      size: Number of bytes to read. Actual number of bytes read is always
            equal to size unless EOF is reached. If size is negative or
            unspecified, read the entire file.

    Returns:
      data read as str.

    Raises:
      IOError: When this buffer is closed.
     N/A N/A N/A self _read_inner size size readline False N/A readline N/A N/A self size N/A -1 N/A N/A Read one line delimited by '\n' from the file.

    Mimics behavior of the readline() method on standard file objects.

    A trailing newline character is kept in the string. It may be absent when a
    file ends with an incomplete line. If the size argument is non-negative,
    it specifies the maximum string size (counting the newline) to return.
    A negative size is the same as unspecified. Empty string is returned
    only when EOF is encountered immediately.

    Args:
      size: Maximum number of bytes to read. If not specified, readline stops
        only on '\n' or EOF.

    Returns:
      The data read as a string.

    Raises:
      IOError: When this buffer is closed.
     N/A N/A N/A self _read_inner size size readline True N/A _read_inner N/A N/A self size readline N/A -1 False N/A N/A Shared implementation of read() and readline(). N/A N/A N/A self _check_open N/A N/A N/A N/A self _remaining N/A N/A N/A data_list N/A N/A N/A size None N/A N/A size -1 N/A to_read N/A min size N/A N/A self _remaining N/A N/A to_read 0 N/A N/A to_read N/A N/A self _remaining N/A break_after False N/A N/A to_read 0 N/A N/A N/A N/A self _fetch_next_if_buffer_exhausted N/A buffer_bytes_read N/A N/A self position N/A self buffer_start_position N/A bytes_to_read_from_buffer N/A min N/A N/A len N/A self buffer buffer_bytes_read to_read N/A readline N/A N/A next_newline_position N/A N/A N/A self buffer find buffer_bytes_read N/A len N/A self buffer N/A N/A next_newline_position -1 N/A N/A bytes_to_read_from_buffer N/A N/A 1 next_newline_position buffer_bytes_read N/A break_after True N/A N/A N/A data_list append N/A N/A self buffer N/A buffer_bytes_read N/A buffer_bytes_read bytes_to_read_from_buffer N/A N/A self position bytes_to_read_from_buffer N/A to_read bytes_to_read_from_buffer N/A break_after N/A N/A N/A N/A N/A join data_list N/A _fetch_next_if_buffer_exhausted N/A N/A self N/A N/A N/A N/A N/A N/A self buffer N/A N/A N/A self buffer_start_position N/A len N/A self buffer N/A self position N/A N/A bytes_to_request N/A min N/A N/A self _remaining N/A self buffer_size N/A N/A self buffer_start_position N/A self position N/A N/A self buffer N/A N/A self _get_segment N/A self position bytes_to_request N/A _remaining N/A N/A self N/A N/A N/A N/A N/A self size N/A self position N/A close N/A N/A self N/A N/A N/A Close the current GCS file. N/A N/A self closed True N/A N/A self download_stream None N/A N/A self downloader None N/A N/A self buffer None N/A _get_segment N/A N/A self start size N/A N/A N/A Get the given segment of the current GCS file. N/A N/A size 0 N/A N/A N/A end N/A N/A start size 1 N/A N/A N/A N/A self downloader GetRange start end N/A value N/A N/A N/A self download_stream getvalue N/A N/A N/A N/A self download_stream truncate 0 N/A N/A N/A len value size N/A value N/A __enter__ N/A N/A self N/A N/A N/A self N/A __exit__ N/A N/A self exception_type exception_value traceback N/A N/A N/A N/A N/A self close N/A seek N/A N/A self offset whence N/A N/A os SEEK_SET N/A N/A Set the file's current offset.

    Note if the new offset is out of bound, it is adjusted to either 0 or EOF.

    Args:
      offset: seek offset as number.
      whence: seek mode. Supported modes are os.SEEK_SET (absolute seek),
        os.SEEK_CUR (seek relative to the current position), and os.SEEK_END
        (seek relative to the end, offset should be negative).

    Raises:
      IOError: When this buffer is closed.
      ValueError: When whence is invalid.
     N/A N/A N/A self _check_open N/A N/A self buffer N/A N/A self buffer_start_position -1 N/A N/A whence N/A os SEEK_SET N/A N/A N/A self position offset N/A N/A N/A whence N/A os SEEK_CUR N/A N/A N/A self position offset N/A N/A N/A whence N/A os SEEK_END N/A N/A N/A self position N/A N/A self size offset N/A N/A N/A ValueError N/A Whence mode %r is invalid. whence N/A N/A self position N/A min N/A self position N/A self size N/A N/A self position N/A max N/A self position 0 N/A tell N/A N/A self N/A N/A N/A Tell the file's current offset.

    Returns:
      current offset in reading this file.

    Raises:
      IOError: When this buffer is closed.
     N/A N/A N/A self _check_open N/A N/A self position N/A _check_open N/A N/A self N/A N/A N/A N/A self closed N/A N/A N/A IOError Buffer is closed. N/A seekable N/A N/A self N/A N/A N/A True N/A readable N/A N/A self N/A N/A N/A True N/A writable N/A N/A self N/A N/A N/A False N/A N/A GcsBufferedWriter N/A object N/A N/A A class for writing Google Cloud Storage files. PipeStream N/A object N/A N/A A class that presents a pipe connection as a readable stream. __init__ N/A N/A self recv_pipe N/A N/A N/A N/A self conn recv_pipe N/A N/A self closed False N/A N/A self position 0 N/A N/A self remaining N/A read N/A N/A self size N/A N/A N/A Read data from the wrapped pipe connection.

      Args:
        size: Number of bytes to read. Actual number of bytes read is always
              equal to size unless EOF is reached.

      Returns:
        data read as str.
       N/A data_list N/A N/A bytes_read 0 N/A N/A bytes_read size N/A N/A bytes_from_remaining N/A min N/A size bytes_read N/A len N/A self remaining N/A N/A N/A data_list append N/A N/A self remaining N/A 0 bytes_from_remaining N/A N/A self remaining N/A N/A self remaining N/A bytes_from_remaining N/A N/A self position bytes_from_remaining N/A bytes_read bytes_from_remaining N/A N/A N/A self remaining N/A N/A N/A N/A N/A self remaining N/A N/A N/A self conn recv_bytes N/A N/A N/A EOFError N/A N/A N/A N/A N/A join data_list N/A tell N/A N/A self N/A N/A N/A Tell the file's current offset.

      Returns:
        current offset in reading this file.

      Raises:
        IOError: When this stream is closed.
       N/A N/A N/A self _check_open N/A N/A self position N/A seek N/A N/A self offset whence N/A N/A os SEEK_SET N/A N/A N/A N/A whence N/A os SEEK_END N/A offset 0 N/A N/A N/A N/A N/A N/A whence N/A os SEEK_SET N/A offset N/A self position N/A N/A N/A NotImplementedError N/A _check_open N/A N/A self N/A N/A N/A N/A self closed N/A N/A N/A IOError Stream is closed. N/A N/A __init__ N/A N/A self client path mime_type N/A application/octet-stream N/A N/A N/A self client client N/A N/A self path path N/A N/A N/A self bucket N/A self name N/A parse_gcs_path path N/A N/A self closed False N/A N/A self position 0 N/A N/A parent_conn child_conn N/A N/A multiprocessing Pipe N/A N/A self conn parent_conn N/A N/A self insert_request N/A N/A storage StorageObjectsInsertRequest bucket N/A self bucket name N/A self name N/A N/A self upload N/A N/A transfer Upload N/A N/A GcsBufferedWriter PipeStream child_conn mime_type N/A N/A N/A self upload strategy N/A transfer RESUMABLE_UPLOAD N/A N/A self upload_thread N/A N/A threading Thread target N/A self _start_upload N/A N/A N/A self upload_thread daemon True N/A N/A N/A N/A self upload_thread start N/A _start_upload N/A N/A self N/A N/A N/A N/A N/A N/A N/A self client objects Insert N/A self insert_request upload N/A self upload N/A N/A retry no_retries write N/A N/A self data N/A N/A N/A Write data to a GCS file.

    Args:
      data: data to write as str.

    Raises:
      IOError: When this buffer is closed.
     N/A N/A N/A self _check_open N/A N/A data N/A N/A N/A N/A N/A N/A self conn send_bytes data N/A N/A self position N/A len data N/A tell N/A N/A self N/A N/A N/A Return the total number of bytes passed to write() so far. N/A N/A self position N/A close N/A N/A self N/A N/A N/A Close the current GCS file. N/A N/A N/A N/A self conn close N/A N/A N/A N/A self upload_thread join N/A __enter__ N/A N/A self N/A N/A N/A self N/A __exit__ N/A N/A self exception_type exception_value traceback N/A N/A N/A N/A N/A self close N/A _check_open N/A N/A self N/A N/A N/A N/A self closed N/A N/A N/A IOError Buffer is closed. N/A seekable N/A N/A self N/A N/A N/A False N/A readable N/A N/A self N/A N/A N/A False N/A writable N/A N/A self N/A N/A N/A True N/A N/A