Module Import alias Import alias Import alias Import alias Import alias identifier Import alias identifier Import alias identifier Import alias identifier Import alias identifier Import alias identifier Import alias identifier Import alias identifier ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr IfExp CompareIs NameLoad NameLoad AttributeLoad Call AttributeLoad NameLoad attr attr Call NameLoad Num NameLoad Assign AttributeStore NameLoad attr IfExp CompareIs NameLoad NameLoad AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr ListLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr BoolOpOr NameLoad AttributeLoad Call AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Str IfExp AttributeLoad NameLoad attr Str Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Str While UnaryOpNot AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Num If CompareIsNot NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad AugAssignAdd AttributeStore NameLoad attr Num TryFinally body Expr Call AttributeLoad NameLoad attr NameLoad finalbody AugAssignSub AttributeStore NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse Raise Call NameLoad BinOpMod Str NameLoad handlers ExceptHandler type AttributeLoad NameLoad attr name NameStore body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Call NameLoad NameLoad ExceptHandler type AttributeLoad NameLoad attr name NameStore body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Call NameLoad NameLoad ExceptHandler type AttributeLoad NameLoad attr name NameStore body Expr Call AttributeLoad NameLoad attr Str NameLoad If Call NameLoad NameLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr orelse If Call NameLoad NameLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr ExceptHandler body Expr Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr TryExcept body If BoolOpAnd Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr orelse Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr handlers ExceptHandler type AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr While NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If CompareIs NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Return Expr Call AttributeLoad NameLoad attr NameLoad If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad Return decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Expr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr handlers ExceptHandler body Assign NameStore BinOpMod Str TupleLoad NameLoad Call AttributeLoad NameLoad attr TryExcept body If CompareEq Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Num body Return handlers ExceptHandler body AugAssignAdd NameStore BinOpMod Str Call AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body While NameLoad body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr If CompareIs NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Return Expr Call AttributeLoad NameLoad attr NameLoad If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad Return decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr While NameLoad body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad If CompareIs NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr If CompareIs NameLoad NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr orelse Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Return Expr Call AttributeLoad NameLoad attr NameLoad If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad Return decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad handlers ExceptHandler body Assign NameStore BinOpMod Str TupleLoad NameLoad Call AttributeLoad NameLoad attr TryExcept body If CompareEq Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Num body Return TupleLoad NameLoad NameLoad handlers ExceptHandler body AugAssignAdd NameStore BinOpMod Str Call AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad handlers ExceptHandler body Assign NameStore BinOpMod Str TupleLoad NameLoad Call AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body While NameLoad body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr If CompareIs NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad Return Expr Call AttributeLoad NameLoad attr NameLoad If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad Return decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad handlers ExceptHandler body Assign NameStore BinOpMod Str TupleLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body With AttributeLoad NameLoad attr body AugAssignAdd AttributeStore NameLoad attr Num If BoolOpAnd CompareGtE AttributeLoad NameLoad attr AttributeLoad NameLoad attr CompareLt BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr body Return NameLoad Expr Call AttributeLoad NameLoad attr Num Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body With AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str NameLoad BinOpSub Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body With AttributeLoad NameLoad attr body If AttributeLoad NameLoad attr body Return Expr Call AttributeLoad NameLoad attr Str AttributeLoad Call AttributeLoad NameLoad attr attr For NameStore Call NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Expr Call AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index Num attr decorator_list FunctionDef arguments args NameParam defaults body With AttributeLoad NameLoad attr body If AttributeLoad NameLoad attr body Return Assign AttributeStore NameLoad attr NameLoad For NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr With AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr ListLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list decorator_list
N/A N/A logging N/A threading N/A time N/A traceback N/A ufora.distributed.S3.S3Interface S3Interface N/A ufora.FORA.python.PythonIoTasks PythonIoTasks N/A ufora.util.OutOfProcessDownloader OutOfProcessDownloader N/A ufora.native.Cumulus CumulusNative N/A ufora.util.ManagedThread ManagedThread N/A ufora.config.Setup Setup N/A ufora.native.FORA FORANative N/A ufora.native.ImmutableTreeVector NativeImmutableTreeVector PythonIoTaskService N/A object N/A __init__ N/A N/A self s3Interface objectStore vdm datasetRequestChannel threadCount maxObjectStoreAttempts objectStoreFailureIntervalSeconds N/A None None None N/A N/A N/A N/A object __init__ self N/A N/A self s3Interface s3Interface N/A N/A self objectStore objectStore N/A N/A self maxObjectStoreAttempts N/A N/A maxObjectStoreAttempts None N/A N/A N/A Setup config objectStoreMaxAttempts N/A max 1 maxObjectStoreAttempts N/A N/A self objectStoreFailureIntervalSeconds N/A N/A objectStoreFailureIntervalSeconds None N/A N/A N/A Setup config objectStoreFailureIntervalSeconds objectStoreFailureIntervalSeconds N/A N/A self objectStoreFailureCount 0 N/A N/A self lastSuccessfulObjectStoreAttempt 0.0 N/A N/A self vdm_ vdm N/A N/A self datasetRequestChannel_ datasetRequestChannel N/A N/A self threads_ N/A N/A N/A self teardown_ False N/A N/A self lock_ N/A N/A threading Lock N/A N/A self totalTasks 0 N/A N/A self threadcount N/A threadCount N/A N/A N/A Setup config externalDatasetLoaderServiceThreads N/A N/A N/A logging info OutOfProcessDownloader is %s N/A N/A s3Interface isCompatibleWithOutOfProcessDownloadPool out of process in memory N/A N/A self outOfProcessDownloaderPool N/A N/A OutOfProcessDownloader OutOfProcessDownloaderPool N/A self threadcount actuallyRunOutOfProcess N/A s3Interface isCompatibleWithOutOfProcessDownloadPool N/A loadLoop N/A N/A self N/A N/A N/A N/A N/A logging info PythonIoTaskService thread starting N/A N/A N/A self teardown_ N/A N/A request N/A N/A N/A self datasetRequestChannel_ getTimeout 0.1 N/A N/A request None N/A N/A N/A N/A logging info PythonIoTaskService loading %s request N/A N/A self totalTasks 1 N/A N/A N/A N/A N/A self processRequest request N/A N/A N/A self totalTasks 1 N/A processRequest N/A N/A self request N/A N/A N/A N/A N/A N/A N/A request isLoadExternalDatasetIntoVector N/A N/A N/A N/A self handleLoadExternalDatasetRequest N/A N/A request asLoadExternalDatasetIntoVector toLoad N/A request guid N/A N/A N/A N/A request isInitiateMultipartS3Upload N/A N/A N/A N/A self handleInitiateMultipartS3Upload request N/A N/A N/A N/A request isCompleteMultipartS3Upload N/A N/A N/A N/A self handleCompleteMultipartS3Upload request N/A N/A N/A N/A request isWriteMultipartS3UploadPart N/A N/A N/A N/A self handleWriteMultipartS3UploadPart request N/A N/A N/A N/A request isCheckS3BucketSizeAndEtag N/A N/A N/A N/A self handleCheckS3BucketSizeAndEtag request N/A N/A N/A N/A request isLoadExternalDatasetAsForaValue N/A N/A N/A N/A self handleLoadExternalDatasetAsForaValue request N/A N/A N/A N/A request isPersistObject N/A N/A N/A N/A self handlePersistObject request N/A N/A N/A N/A request isDeletePersistedObject N/A N/A N/A N/A self handleDeletePersistedObject request N/A N/A N/A N/A request isExtractPersistedObject N/A N/A N/A N/A self handleExtractPersistedObject request N/A N/A N/A N/A request isListPersistedObjects N/A N/A N/A N/A self handleListPersistedObjects request N/A N/A N/A UserWarning N/A Invalid request: %s request N/A N/A N/A N/A PythonIoTasks UserCausedException N/A e N/A N/A N/A N/A logging error PythonIoTaskService caught user-caused exception handling %s: %s request e N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse UserCausedFailure N/A request guid N/A str e N/A N/A N/A PythonIoTasks DatasetLoadException N/A e N/A N/A N/A N/A logging error PythonIoTaskService caught exception handling %s: %s request e N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid N/A str e N/A N/A N/A S3Interface S3InterfaceError N/A e N/A N/A N/A N/A logging error PythonIoTaskService caught S3InterfaceError %s e N/A N/A isinstance e N/A N/A S3Interface KeyNotFound N/A S3Interface BucketNotFound N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse S3KeyDoesNotExist N/A request guid N/A N/A N/A isinstance e N/A N/A S3Interface BucketAccessError N/A S3Interface KeyAccessError N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse S3PermissionError N/A request guid N/A N/A N/A N/A N/A logging error PythonIoTaskService caught unknown exception: %s N/A N/A traceback format_exc N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid Unknown python exception N/A handleInitiateMultipartS3Upload N/A N/A self request N/A N/A N/A uploadId N/A N/A PythonIoTasks initiateMultipartS3Upload N/A self s3Interface N/A self outOfProcessDownloaderPool N/A N/A N/A request asInitiateMultipartS3Upload credentials bucketname N/A N/A N/A request asInitiateMultipartS3Upload credentials keyname N/A N/A N/A request asInitiateMultipartS3Upload credentials awsAccessKey N/A N/A N/A request asInitiateMultipartS3Upload credentials awsSecretKey N/A N/A N/A request asInitiateMultipartS3Upload credentials region N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse MultipartS3UploadInitiated N/A request guid uploadId N/A handleCompleteMultipartS3Upload N/A N/A self request N/A N/A N/A N/A N/A PythonIoTasks completeMultipartS3Upload N/A self s3Interface N/A self outOfProcessDownloaderPool N/A N/A N/A request asCompleteMultipartS3Upload credentials bucketname N/A N/A N/A request asCompleteMultipartS3Upload credentials keyname N/A N/A N/A request asCompleteMultipartS3Upload credentials awsAccessKey N/A N/A N/A request asCompleteMultipartS3Upload credentials awsSecretKey N/A N/A N/A request asCompleteMultipartS3Upload credentials region N/A N/A request asCompleteMultipartS3Upload uploadId N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Success N/A request guid N/A handleWriteMultipartS3UploadPart N/A N/A self request N/A N/A N/A N/A N/A PythonIoTasks writeMultipartS3UploadPart N/A self s3Interface N/A self outOfProcessDownloaderPool N/A N/A N/A request asWriteMultipartS3UploadPart credentials bucketname N/A N/A N/A request asWriteMultipartS3UploadPart credentials keyname N/A N/A N/A request asWriteMultipartS3UploadPart credentials awsAccessKey N/A N/A N/A request asWriteMultipartS3UploadPart credentials awsSecretKey N/A N/A N/A request asWriteMultipartS3UploadPart credentials region N/A N/A request asWriteMultipartS3UploadPart uploadId N/A N/A request asWriteMultipartS3UploadPart part N/A N/A request asWriteMultipartS3UploadPart objectData N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Success N/A request guid N/A handleLoadExternalDatasetAsForaValue N/A N/A self toRequest N/A N/A N/A externalDataset N/A N/A toRequest asLoadExternalDatasetAsForaValue toLoad N/A result N/A N/A PythonIoTasks loadExternalDatasetAsForaValue externalDataset N/A self vdm_ N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse DatasetAsForaValue N/A toRequest guid result N/A handleCheckS3BucketSizeAndEtag N/A N/A self request N/A N/A N/A interface N/A N/A self s3Interface N/A N/A N/A N/A N/A N/A interface bucketExists N/A N/A request asCheckS3BucketSizeAndEtag bucketname N/A N/A interface keyExists N/A N/A request asCheckS3BucketSizeAndEtag bucketname N/A N/A request asCheckS3BucketSizeAndEtag keyname N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse S3BucketSizeAndEtag N/A request guid N/A N/A interface getKeySize N/A N/A request asCheckS3BucketSizeAndEtag bucketname N/A N/A request asCheckS3BucketSizeAndEtag keyname N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse S3KeyDoesNotExist N/A request guid N/A N/A N/A N/A S3Interface S3InterfaceError N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse S3PermissionError N/A request guid N/A handleDeletePersistedObject N/A N/A self request N/A N/A N/A keyname N/A N/A request asDeletePersistedObject objectPath N/A True N/A N/A errorMessage N/A N/A self deletePersistedObject keyname N/A N/A errorMessage None N/A N/A N/A N/A self resetObjectStoreFailureCount N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Success N/A request guid N/A N/A N/A N/A logging error errorMessage N/A N/A N/A self isAtMaxObjectStoreFailures N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid errorMessage N/A N/A deletePersistedObject N/A N/A self keyname N/A N/A N/A N/A N/A N/A N/A PythonIoTasks deletePersistedObject keyname N/A self objectStore N/A self outOfProcessDownloaderPool N/A N/A N/A N/A message N/A Error deleting serialized object: %s:
%s N/A keyname N/A N/A traceback format_exc N/A N/A N/A N/A N/A len N/A N/A N/A self objectStore listValues keyname 0 N/A N/A N/A N/A N/A N/A message N/A 

Error while trying to list object:
%s N/A N/A traceback format_exc N/A message N/A handleListPersistedObjects N/A N/A self request N/A N/A N/A True N/A N/A N/A errorMessage result N/A N/A self listPersistedObjects N/A N/A request asListPersistedObjects objectPathPrefix N/A N/A errorMessage None N/A N/A N/A N/A self resetObjectStoreFailureCount N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse ObjectPaths N/A request guid N/A N/A NativeImmutableTreeVector ImmutableTreeVectorOfString result N/A N/A N/A N/A logging error errorMessage N/A N/A N/A self isAtMaxObjectStoreFailures N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid errorMessage N/A N/A handleExtractPersistedObject N/A N/A self request N/A N/A N/A keyname N/A N/A request asExtractPersistedObject objectPath N/A True N/A N/A N/A errorMessage result N/A N/A self extractPersistedObject keyname N/A N/A errorMessage None N/A N/A N/A N/A self resetObjectStoreFailureCount N/A N/A result None N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse ObjectDoesNotExist N/A request guid N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse ObjectExtracted N/A request guid N/A N/A FORANative NoncontiguousByteBlock result N/A N/A N/A N/A logging error errorMessage N/A N/A N/A self isAtMaxObjectStoreFailures N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid errorMessage N/A N/A extractPersistedObject N/A N/A self keyname N/A N/A N/A N/A N/A result N/A N/A PythonIoTasks extractPersistedObject keyname N/A self objectStore N/A self outOfProcessDownloaderPool N/A N/A None result N/A N/A N/A N/A message N/A Error reading serialized object: %s:
%s N/A keyname N/A N/A traceback format_exc N/A N/A N/A N/A N/A len N/A N/A N/A self objectStore listValues keyname 0 N/A N/A N/A None None N/A N/A N/A N/A message N/A 

Error while trying to list serialized object:
%s N/A N/A traceback format_exc N/A N/A message None N/A listPersistedObjects N/A N/A self prefix N/A N/A N/A N/A N/A result N/A N/A PythonIoTasks listPersistedObjects prefix N/A self objectStore N/A self outOfProcessDownloaderPool N/A N/A None result N/A N/A N/A N/A message N/A Error listing persisted objects: %s:
%s N/A prefix N/A N/A traceback format_exc N/A N/A message None N/A handlePersistObject N/A N/A self request N/A N/A N/A True N/A N/A N/A errorMessage dataLen N/A N/A self writeToObjectStore N/A request asPersistObject N/A N/A errorMessage None N/A N/A N/A N/A self resetObjectStoreFailureCount N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse DataSuccessfullyPersisted N/A request guid dataLen N/A N/A N/A N/A logging error errorMessage N/A N/A N/A self isAtMaxObjectStoreFailures N/A N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Failure N/A request guid errorMessage N/A N/A writeToObjectStore N/A N/A self persistObjectRequest N/A N/A N/A N/A N/A dataSize N/A N/A PythonIoTasks persistObject persistObjectRequest N/A self objectStore N/A self outOfProcessDownloaderPool N/A N/A None dataSize N/A N/A N/A N/A message N/A Error writing serialized object: %s:
%s N/A N/A persistObjectRequest objectPath N/A N/A traceback format_exc N/A N/A message None N/A isAtMaxObjectStoreFailures N/A N/A self N/A N/A N/A N/A self lock_ N/A N/A N/A self objectStoreFailureCount 1 N/A N/A N/A N/A self objectStoreFailureCount N/A self maxObjectStoreAttempts N/A N/A N/A self lastSuccessfulObjectStoreAttempt N/A self objectStoreFailureIntervalSeconds N/A N/A time time N/A N/A True N/A N/A N/A time sleep 0.2 N/A False N/A resetObjectStoreFailureCount N/A N/A self N/A N/A N/A N/A self lock_ N/A N/A N/A self objectStoreFailureCount 0 N/A N/A self lastSuccessfulObjectStoreAttempt N/A N/A time time N/A handleLoadExternalDatasetRequest N/A N/A self request guid N/A N/A N/A t0 N/A N/A time time N/A N/A N/A PythonIoTasks loadExternalDataset N/A self s3Interface request N/A self vdm_ N/A self outOfProcessDownloaderPool N/A N/A N/A logging info PythonIoTaskService succeeded in loading %s in %s. tasks=%s request N/A N/A N/A time time t0 N/A self totalTasks N/A N/A N/A N/A self datasetRequestChannel_ write N/A N/A N/A CumulusNative PythonIoTaskResponse Success guid N/A stopService N/A N/A self N/A N/A N/A N/A N/A self teardown N/A startService N/A N/A self N/A N/A N/A N/A self lock_ N/A N/A N/A self threads_ N/A N/A N/A N/A N/A logging info Starting %s PythonIoTasks service threads N/A N/A N/A Setup config externalDatasetLoaderServiceThreads N/A ix N/A range N/A self threadcount N/A N/A N/A N/A N/A self threads_ append N/A N/A ManagedThread ManagedThread target N/A self loadLoop N/A N/A N/A N/A N/A self threads_ N/A -1 start N/A teardown N/A N/A self N/A N/A N/A N/A self lock_ N/A N/A N/A self teardown_ N/A N/A N/A N/A self teardown_ True N/A thread N/A self threads_ N/A N/A N/A N/A thread join N/A N/A N/A N/A self outOfProcessDownloaderPool teardown N/A N/A self lock_ N/A N/A N/A self threads_ N/A N/A N/A self s3Interface None N/A N/A self vdm_ None N/A N/A self datasetRequestChannel_ None N/A N/A self outOfProcessDownloaderPool None N/A N/A