Package: apache-airflow-backport-providers-google
Package apache-airflow-backport-providers-googleRelease: 2021.3.3Table of contentsBackport packageInstallationPIP requirementsCross provider package dependenciesProvider class summaryOperatorsNew operatorsMoved operatorsTransfer operatorsNew transfer operatorsMoved transfer operatorsSensorsNew sensorsMoved sensorsHooksNew hooksMoved hooksSecretsMoved secretsReleasesRelease 2021.3.3Release 2021.2.5Release 2020.11.23Release 2020.11.13Release 2020.10.29Release 2020.10.5Release 2020.6.24Backport packageThis is a backport providers package forgoogleprovider. All classes for this provider package
are inairflow.providers.googlepython package.Only Python 3.6+ is supported for this backport package.While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
want to use this backport package.ChangelogRelease 2021.3.3FeaturesCorrects order of argument in docstring in GCSHook.download method (#14497)Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)Add GoogleDriveToLocalOperator (#14191)Add &#39;exists_ok&#39; flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)Add materialized view support for BigQuery (#14201)Add BigQueryUpdateTableOperator (#14149)Add param to CloudDataTransferServiceOperator (#14118)Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook (#13982)Improve GCSToSFTPOperator paths handling (#11284)Bug fixesFixes to dataproc operators and hook (#14086)#9803 fix bug in copy operation without wildcard  (#13919)Release 2021.2.5Breaking changesUpdatedgoogle-cloud-*librariesThis release of the provider package contains third-party library updates, which may require updating your DAG files or custom hooks and operators, if you were using objects from those libraries. Updating of these libraries is necessary to be able to use new features made available by new versions of the libraries and to obtain bug fixes that are only available for new versions of the library.Details are covered in the UPDATING.md files for each library, but there are some details that you should pay attention to.Library namePrevious constraintsCurrent constraintsgoogle-cloud-automl&gt;=0.4.0,&lt;2.0.0&gt;=2.1.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-bigquery-datatransfer&gt;=0.4.0,&lt;2.0.0&gt;=3.0.0,&lt;4.0.0UPGRADING.mdgoogle-cloud-datacatalog&gt;=0.5.0,&lt;0.8&gt;=3.0.0,&lt;4.0.0UPGRADING.mdgoogle-cloud-dataproc&gt;=1.0.1,&lt;2.0.0&gt;=2.2.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-kms&gt;=1.2.1,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-logging&gt;=1.14.0,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-monitoring&gt;=0.34.0,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-os-login&gt;=1.0.0,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-pubsub&gt;=1.0.0,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdgoogle-cloud-tasks&gt;=1.2.1,&lt;2.0.0&gt;=2.0.0,&lt;3.0.0UPGRADING.mdThe field names use the snake_case conventionIf your DAG uses an object from the above mentioned libraries passed by XCom, it is necessary to update the naming convention of the fields that are read. Previously, the fields used the CamelSnake convention, now the snake_case convention is used.Before:set_acl_permission=GCSBucketCreateAclEntryOperator(task_id=&#34;gcs-set-acl-permission&#34;,bucket=BUCKET_NAME,entity=&#34;user-{{ task_instance.xcom_pull(&#39;get-instance&#39;)[&#39;persistenceIamIdentity&#39;]&#34;&#34;.split(&#39;:&#39;, 2)[1] }}&#34;,role=&#34;OWNER&#34;,)After:set_acl_permission=GCSBucketCreateAclEntryOperator(task_id=&#34;gcs-set-acl-permission&#34;,bucket=BUCKET_NAME,entity=&#34;user-{{ task_instance.xcom_pull(&#39;get-instance&#39;)[&#39;persistence_iam_identity&#39;]&#34;&#34;.split(&#39;:&#39;, 2)[1] }}&#34;,role=&#34;OWNER&#34;,)FeaturesAdd Apache Beam operators (#12814)Add Google Cloud Workflows Operators (#13366)Replace &#39;google_cloud_storage_conn_id&#39; by &#39;gcp_conn_id&#39; when using &#39;GCSHook&#39; (#13851)Add How To Guide for Dataflow (#13461)Generalize MLEngineStartTrainingJobOperator to custom images (#13318)Add Parquet data type to BaseSQLToGCSOperator (#13359)Add DataprocCreateWorkflowTemplateOperator (#13338)Add OracleToGCS Transfer (#13246)Add timeout option to gcs hook methods. (#13156)Add regional support to dataproc workflow template operators (#12907)Add project_id to client inside BigQuery hook update_table method (#13018)Bug fixesFix four bugs in StackdriverTaskHandler (#13784)Decode Remote Google Logs (#13115)Fix and improve GCP BigTable hook and system test (#13896)updated Google DV360 Hook to fix SDF issue (#13703)Fix insert_all method of BigQueryHook to support tables without schema (#13138)Fix Google BigQueryHook method get_schema() (#13136)Fix Data Catalog operators (#13096)InstallationYou can install this package on top of an existing airflow 1.10.* installation viapip install apache-airflow-backport-providers-googlePIP requirementsPIP packageVersion requiredPyOpenSSLgoogle-ads>=4.0.0,<8.0.0google-api-core>=1.25.1,<2.0.0google-api-python-client>=1.6.0,<2.0.0google-auth-httplib2>=0.0.1google-auth>=1.0.0,<2.0.0google-cloud-automl>=2.1.0,<3.0.0google-cloud-bigquery-datatransfer>=3.0.0,<4.0.0google-cloud-bigtable>=1.0.0,<2.0.0google-cloud-container>=0.1.1,<2.0.0google-cloud-datacatalog>=3.0.0,<4.0.0google-cloud-dataproc>=2.2.0,<3.0.0google-cloud-dlp>=0.11.0,<2.0.0google-cloud-kms>=2.0.0,<3.0.0google-cloud-language>=1.1.1,<2.0.0google-cloud-logging>=2.1.1,<3.0.0google-cloud-memcache>=0.2.0google-cloud-monitoring>=2.0.0,<3.0.0google-cloud-os-login>=2.0.0,<3.0.0google-cloud-pubsub>=2.0.0,<3.0.0google-cloud-redis>=2.0.0,<3.0.0google-cloud-secret-manager>=0.2.0,<2.0.0google-cloud-spanner>=1.10.0,<2.0.0google-cloud-speech>=0.36.3,<2.0.0google-cloud-storage>=1.30,<2.0.0google-cloud-tasks>=2.0.0,<3.0.0google-cloud-texttospeech>=0.4.0,<2.0.0google-cloud-translate>=1.5.0,<2.0.0google-cloud-videointelligence>=1.7.0,<2.0.0google-cloud-vision>=0.35.2,<2.0.0google-cloud-workflows>=0.1.0,<2.0.0grpcio-gcp>=0.2.2json-merge-patch~=0.2pandas-gbqCross provider package dependenciesThose are dependencies that might be needed in order to use all the features of the package.
You need to install the specified backport providers package in order to use them.You can install such cross-provider dependencies when installing from PyPI. For example:pipinstallapache-airflow-backport-providers-google[amazon]Dependent packageExtraapache-airflow-backport-providers-amazonamazonapache-airflow-backport-providers-apache-beamapache.beamapache-airflow-backport-providers-apache-cassandraapache.cassandraapache-airflow-backport-providers-cncf-kubernetescncf.kubernetesapache-airflow-backport-providers-facebookfacebookapache-airflow-backport-providers-microsoft-azuremicrosoft.azureapache-airflow-backport-providers-microsoft-mssqlmicrosoft.mssqlapache-airflow-backport-providers-mysqlmysqlapache-airflow-backport-providers-oracleoracleapache-airflow-backport-providers-postgrespostgresapache-airflow-backport-providers-prestoprestoapache-airflow-backport-providers-salesforcesalesforceapache-airflow-backport-providers-sftpsftpapache-airflow-backport-providers-sshsshProvider classes summaryIn Airflow 2.0, all operators, transfers, hooks, sensors, secrets for thegoogleprovider
are in theairflow.providers.googlepackage. You can read more about the naming conventions used
inNaming conventions for provider packagesOperatorsNew operatorsNew Airflow 2.0 operators:airflow.providers.googlepackageads.operators.ads.GoogleAdsListAccountsOperatorcloud.operators.automl.AutoMLBatchPredictOperatorcloud.operators.automl.AutoMLCreateDatasetOperatorcloud.operators.automl.AutoMLDeleteDatasetOperatorcloud.operators.automl.AutoMLDeleteModelOperatorcloud.operators.automl.AutoMLDeployModelOperatorcloud.operators.automl.AutoMLGetModelOperatorcloud.operators.automl.AutoMLImportDataOperatorcloud.operators.automl.AutoMLListDatasetOperatorcloud.operators.automl.AutoMLPredictOperatorcloud.operators.automl.AutoMLTablesListColumnSpecsOperatorcloud.operators.automl.AutoMLTablesListTableSpecsOperatorcloud.operators.automl.AutoMLTablesUpdateDatasetOperatorcloud.operators.automl.AutoMLTrainModelOperatorcloud.operators.bigquery.BigQueryInsertJobOperatorcloud.operators.bigquery.BigQueryUpdateTableOperatorcloud.operators.bigquery_dts.BigQueryCreateDataTransferOperatorcloud.operators.bigquery_dts.BigQueryDataTransferServiceStartTransferRunsOperatorcloud.operators.bigquery_dts.BigQueryDeleteDataTransferConfigOperatorcloud.operators.bigtable.BigtableUpdateInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreCreateInstanceAndImportOperatorcloud.operators.cloud_memorystore.CloudMemorystoreCreateInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreDeleteInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreExportAndDeleteInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreExportInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreFailoverInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreGetInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreImportOperatorcloud.operators.cloud_memorystore.CloudMemorystoreListInstancesOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedApplyParametersOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedCreateInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedDeleteInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedGetInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedListInstancesOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedUpdateInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreMemcachedUpdateParametersOperatorcloud.operators.cloud_memorystore.CloudMemorystoreScaleInstanceOperatorcloud.operators.cloud_memorystore.CloudMemorystoreUpdateInstanceOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceGCSToGCSOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceS3ToGCSOperatorcloud.operators.datacatalog.CloudDataCatalogCreateEntryGroupOperatorcloud.operators.datacatalog.CloudDataCatalogCreateEntryOperatorcloud.operators.datacatalog.CloudDataCatalogCreateTagOperatorcloud.operators.datacatalog.CloudDataCatalogCreateTagTemplateFieldOperatorcloud.operators.datacatalog.CloudDataCatalogCreateTagTemplateOperatorcloud.operators.datacatalog.CloudDataCatalogDeleteEntryGroupOperatorcloud.operators.datacatalog.CloudDataCatalogDeleteEntryOperatorcloud.operators.datacatalog.CloudDataCatalogDeleteTagOperatorcloud.operators.datacatalog.CloudDataCatalogDeleteTagTemplateFieldOperatorcloud.operators.datacatalog.CloudDataCatalogDeleteTagTemplateOperatorcloud.operators.datacatalog.CloudDataCatalogGetEntryGroupOperatorcloud.operators.datacatalog.CloudDataCatalogGetEntryOperatorcloud.operators.datacatalog.CloudDataCatalogGetTagTemplateOperatorcloud.operators.datacatalog.CloudDataCatalogListTagsOperatorcloud.operators.datacatalog.CloudDataCatalogLookupEntryOperatorcloud.operators.datacatalog.CloudDataCatalogRenameTagTemplateFieldOperatorcloud.operators.datacatalog.CloudDataCatalogSearchCatalogOperatorcloud.operators.datacatalog.CloudDataCatalogUpdateEntryOperatorcloud.operators.datacatalog.CloudDataCatalogUpdateTagOperatorcloud.operators.datacatalog.CloudDataCatalogUpdateTagTemplateFieldOperatorcloud.operators.datacatalog.CloudDataCatalogUpdateTagTemplateOperatorcloud.operators.dataflow.DataflowStartFlexTemplateOperatorcloud.operators.dataflow.DataflowStartSqlJobOperatorcloud.operators.datafusion.CloudDataFusionCreateInstanceOperatorcloud.operators.datafusion.CloudDataFusionCreatePipelineOperatorcloud.operators.datafusion.CloudDataFusionDeleteInstanceOperatorcloud.operators.datafusion.CloudDataFusionDeletePipelineOperatorcloud.operators.datafusion.CloudDataFusionGetInstanceOperatorcloud.operators.datafusion.CloudDataFusionListPipelinesOperatorcloud.operators.datafusion.CloudDataFusionRestartInstanceOperatorcloud.operators.datafusion.CloudDataFusionStartPipelineOperatorcloud.operators.datafusion.CloudDataFusionStopPipelineOperatorcloud.operators.datafusion.CloudDataFusionUpdateInstanceOperatorcloud.operators.dataprep.DataprepGetJobGroupOperatorcloud.operators.dataprep.DataprepGetJobsForJobGroupOperatorcloud.operators.dataprep.DataprepRunJobGroupOperatorcloud.operators.dataproc.DataprocCreateWorkflowTemplateOperatorcloud.operators.dataproc.DataprocSubmitJobOperatorcloud.operators.dataproc.DataprocUpdateClusterOperatorcloud.operators.datastore.CloudDatastoreAllocateIdsOperatorcloud.operators.datastore.CloudDatastoreBeginTransactionOperatorcloud.operators.datastore.CloudDatastoreCommitOperatorcloud.operators.datastore.CloudDatastoreDeleteOperationOperatorcloud.operators.datastore.CloudDatastoreGetOperationOperatorcloud.operators.datastore.CloudDatastoreRollbackOperatorcloud.operators.datastore.CloudDatastoreRunQueryOperatorcloud.operators.functions.CloudFunctionInvokeFunctionOperatorcloud.operators.gcs.GCSDeleteBucketOperatorcloud.operators.gcs.GCSFileTransformOperatorcloud.operators.gcs.GCSSynchronizeBucketsOperatorcloud.operators.life_sciences.LifeSciencesRunPipelineOperatorcloud.operators.mlengine.MLEngineCreateModelOperatorcloud.operators.mlengine.MLEngineCreateVersionOperatorcloud.operators.mlengine.MLEngineDeleteModelOperatorcloud.operators.mlengine.MLEngineDeleteVersionOperatorcloud.operators.mlengine.MLEngineGetModelOperatorcloud.operators.mlengine.MLEngineListVersionsOperatorcloud.operators.mlengine.MLEngineSetDefaultVersionOperatorcloud.operators.mlengine.MLEngineTrainingCancelJobOperatorcloud.operators.pubsub.PubSubPullOperatorcloud.operators.stackdriver.StackdriverDeleteAlertOperatorcloud.operators.stackdriver.StackdriverDeleteNotificationChannelOperatorcloud.operators.stackdriver.StackdriverDisableAlertPoliciesOperatorcloud.operators.stackdriver.StackdriverDisableNotificationChannelsOperatorcloud.operators.stackdriver.StackdriverEnableAlertPoliciesOperatorcloud.operators.stackdriver.StackdriverEnableNotificationChannelsOperatorcloud.operators.stackdriver.StackdriverListAlertPoliciesOperatorcloud.operators.stackdriver.StackdriverListNotificationChannelsOperatorcloud.operators.stackdriver.StackdriverUpsertAlertOperatorcloud.operators.stackdriver.StackdriverUpsertNotificationChannelOperatorcloud.operators.tasks.CloudTasksQueueCreateOperatorcloud.operators.tasks.CloudTasksQueueDeleteOperatorcloud.operators.tasks.CloudTasksQueueGetOperatorcloud.operators.tasks.CloudTasksQueuePauseOperatorcloud.operators.tasks.CloudTasksQueuePurgeOperatorcloud.operators.tasks.CloudTasksQueueResumeOperatorcloud.operators.tasks.CloudTasksQueueUpdateOperatorcloud.operators.tasks.CloudTasksQueuesListOperatorcloud.operators.tasks.CloudTasksTaskCreateOperatorcloud.operators.tasks.CloudTasksTaskDeleteOperatorcloud.operators.tasks.CloudTasksTaskGetOperatorcloud.operators.tasks.CloudTasksTaskRunOperatorcloud.operators.tasks.CloudTasksTasksListOperatorcloud.operators.vision.CloudVisionAddProductToProductSetOperatorcloud.operators.vision.CloudVisionDeleteReferenceImageOperatorcloud.operators.workflows.WorkflowsCancelExecutionOperatorcloud.operators.workflows.WorkflowsCreateExecutionOperatorcloud.operators.workflows.WorkflowsCreateWorkflowOperatorcloud.operators.workflows.WorkflowsDeleteWorkflowOperatorcloud.operators.workflows.WorkflowsGetExecutionOperatorcloud.operators.workflows.WorkflowsGetWorkflowOperatorcloud.operators.workflows.WorkflowsListExecutionsOperatorcloud.operators.workflows.WorkflowsListWorkflowsOperatorcloud.operators.workflows.WorkflowsUpdateWorkflowOperatorfirebase.operators.firestore.CloudFirestoreExportDatabaseOperatormarketing_platform.operators.analytics.GoogleAnalyticsDataImportUploadOperatormarketing_platform.operators.analytics.GoogleAnalyticsDeletePreviousDataUploadsOperatormarketing_platform.operators.analytics.GoogleAnalyticsGetAdsLinkOperatormarketing_platform.operators.analytics.GoogleAnalyticsListAccountsOperatormarketing_platform.operators.analytics.GoogleAnalyticsModifyFileHeadersDataImportOperatormarketing_platform.operators.analytics.GoogleAnalyticsRetrieveAdsLinksListOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerBatchInsertConversionsOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerBatchUpdateConversionsOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerDeleteReportOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerDownloadReportOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerInsertReportOperatormarketing_platform.operators.campaign_manager.GoogleCampaignManagerRunReportOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360CreateReportOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360CreateSDFDownloadTaskOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360DeleteReportOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360DownloadLineItemsOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360DownloadReportOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360RunReportOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360SDFtoGCSOperatormarketing_platform.operators.display_video.GoogleDisplayVideo360UploadLineItemsOperatormarketing_platform.operators.search_ads.GoogleSearchAdsDownloadReportOperatormarketing_platform.operators.search_ads.GoogleSearchAdsInsertReportOperatorsuite.operators.sheets.GoogleSheetsCreateSpreadsheetOperatorMoved operatorsAirflow 2.0 operators:airflow.providers.googlepackageAirflow 1.10.* previous location (usuallyairflow.contrib)cloud.operators.bigquery.BigQueryCheckOperatorcontrib.operators.bigquery_check_operator.BigQueryCheckOperatorcloud.operators.bigquery.BigQueryCreateEmptyDatasetOperatorcontrib.operators.bigquery_operator.BigQueryCreateEmptyDatasetOperatorcloud.operators.bigquery.BigQueryCreateEmptyTableOperatorcontrib.operators.bigquery_operator.BigQueryCreateEmptyTableOperatorcloud.operators.bigquery.BigQueryCreateExternalTableOperatorcontrib.operators.bigquery_operator.BigQueryCreateExternalTableOperatorcloud.operators.bigquery.BigQueryDeleteDatasetOperatorcontrib.operators.bigquery_operator.BigQueryDeleteDatasetOperatorcloud.operators.bigquery.BigQueryDeleteTableOperatorcontrib.operators.bigquery_table_delete_operator.BigQueryTableDeleteOperatorcloud.operators.bigquery.BigQueryExecuteQueryOperatorcontrib.operators.bigquery_operator.BigQueryOperatorcloud.operators.bigquery.BigQueryGetDataOperatorcontrib.operators.bigquery_get_data.BigQueryGetDataOperatorcloud.operators.bigquery.BigQueryGetDatasetOperatorcontrib.operators.bigquery_operator.BigQueryGetDatasetOperatorcloud.operators.bigquery.BigQueryGetDatasetTablesOperatorcontrib.operators.bigquery_operator.BigQueryGetDatasetTablesOperatorcloud.operators.bigquery.BigQueryIntervalCheckOperatorcontrib.operators.bigquery_check_operator.BigQueryIntervalCheckOperatorcloud.operators.bigquery.BigQueryPatchDatasetOperatorcontrib.operators.bigquery_operator.BigQueryPatchDatasetOperatorcloud.operators.bigquery.BigQueryUpdateDatasetOperatorcontrib.operators.bigquery_operator.BigQueryUpdateDatasetOperatorcloud.operators.bigquery.BigQueryUpsertTableOperatorcontrib.operators.bigquery_operator.BigQueryUpsertTableOperatorcloud.operators.bigquery.BigQueryValueCheckOperatorcontrib.operators.bigquery_check_operator.BigQueryValueCheckOperatorcloud.operators.bigtable.BigtableCreateInstanceOperatorcontrib.operators.gcp_bigtable_operator.BigtableInstanceCreateOperatorcloud.operators.bigtable.BigtableCreateTableOperatorcontrib.operators.gcp_bigtable_operator.BigtableTableCreateOperatorcloud.operators.bigtable.BigtableDeleteInstanceOperatorcontrib.operators.gcp_bigtable_operator.BigtableInstanceDeleteOperatorcloud.operators.bigtable.BigtableDeleteTableOperatorcontrib.operators.gcp_bigtable_operator.BigtableTableDeleteOperatorcloud.operators.bigtable.BigtableUpdateClusterOperatorcontrib.operators.gcp_bigtable_operator.BigtableClusterUpdateOperatorcloud.operators.cloud_build.CloudBuildCreateBuildOperatorcontrib.operators.gcp_cloud_build_operator.CloudBuildCreateBuildOperatorcloud.operators.cloud_sql.CloudSQLBaseOperatorcontrib.operators.gcp_sql_operator.CloudSqlBaseOperatorcloud.operators.cloud_sql.CloudSQLCreateInstanceDatabaseOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceDatabaseCreateOperatorcloud.operators.cloud_sql.CloudSQLCreateInstanceOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceCreateOperatorcloud.operators.cloud_sql.CloudSQLDeleteInstanceDatabaseOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceDatabaseDeleteOperatorcloud.operators.cloud_sql.CloudSQLDeleteInstanceOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceDeleteOperatorcloud.operators.cloud_sql.CloudSQLExecuteQueryOperatorcontrib.operators.gcp_sql_operator.CloudSqlQueryOperatorcloud.operators.cloud_sql.CloudSQLExportInstanceOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceExportOperatorcloud.operators.cloud_sql.CloudSQLImportInstanceOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceImportOperatorcloud.operators.cloud_sql.CloudSQLInstancePatchOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstancePatchOperatorcloud.operators.cloud_sql.CloudSQLPatchInstanceDatabaseOperatorcontrib.operators.gcp_sql_operator.CloudSqlInstanceDatabasePatchOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceCancelOperationOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceOperationCancelOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceCreateJobOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceJobCreateOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceDeleteJobOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceJobDeleteOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceGetOperationOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceOperationGetOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceListOperationsOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceOperationsListOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServicePauseOperationOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceOperationPauseOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceResumeOperationOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceOperationResumeOperatorcloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceUpdateJobOperatorcontrib.operators.gcp_transfer_operator.GcpTransferServiceJobUpdateOperatorcloud.operators.compute.ComputeEngineBaseOperatorcontrib.operators.gcp_compute_operator.GceBaseOperatorcloud.operators.compute.ComputeEngineCopyInstanceTemplateOperatorcontrib.operators.gcp_compute_operator.GceInstanceTemplateCopyOperatorcloud.operators.compute.ComputeEngineInstanceGroupUpdateManagerTemplateOperatorcontrib.operators.gcp_compute_operator.GceInstanceGroupManagerUpdateTemplateOperatorcloud.operators.compute.ComputeEngineSetMachineTypeOperatorcontrib.operators.gcp_compute_operator.GceSetMachineTypeOperatorcloud.operators.compute.ComputeEngineStartInstanceOperatorcontrib.operators.gcp_compute_operator.GceInstanceStartOperatorcloud.operators.compute.ComputeEngineStopInstanceOperatorcontrib.operators.gcp_compute_operator.GceInstanceStopOperatorcloud.operators.dataflow.DataflowCreateJavaJobOperatorcontrib.operators.dataflow_operator.DataFlowJavaOperatorcloud.operators.dataflow.DataflowCreatePythonJobOperatorcontrib.operators.dataflow_operator.DataFlowPythonOperatorcloud.operators.dataflow.DataflowTemplatedJobStartOperatorcontrib.operators.dataflow_operator.DataflowTemplateOperatorcloud.operators.dataproc.DataprocCreateClusterOperatorcontrib.operators.dataproc_operator.DataprocClusterCreateOperatorcloud.operators.dataproc.DataprocDeleteClusterOperatorcontrib.operators.dataproc_operator.DataprocClusterDeleteOperatorcloud.operators.dataproc.DataprocInstantiateInlineWorkflowTemplateOperatorcontrib.operators.dataproc_operator.DataprocWorkflowTemplateInstantiateInlineOperatorcloud.operators.dataproc.DataprocInstantiateWorkflowTemplateOperatorcontrib.operators.dataproc_operator.DataprocWorkflowTemplateInstantiateOperatorcloud.operators.dataproc.DataprocJobBaseOperatorcontrib.operators.dataproc_operator.DataProcJobBaseOperatorcloud.operators.dataproc.DataprocScaleClusterOperatorcontrib.operators.dataproc_operator.DataprocClusterScaleOperatorcloud.operators.dataproc.DataprocSubmitHadoopJobOperatorcontrib.operators.dataproc_operator.DataProcHadoopOperatorcloud.operators.dataproc.DataprocSubmitHiveJobOperatorcontrib.operators.dataproc_operator.DataProcHiveOperatorcloud.operators.dataproc.DataprocSubmitPigJobOperatorcontrib.operators.dataproc_operator.DataProcPigOperatorcloud.operators.dataproc.DataprocSubmitPySparkJobOperatorcontrib.operators.dataproc_operator.DataProcPySparkOperatorcloud.operators.dataproc.DataprocSubmitSparkJobOperatorcontrib.operators.dataproc_operator.DataProcSparkOperatorcloud.operators.dataproc.DataprocSubmitSparkSqlJobOperatorcontrib.operators.dataproc_operator.DataProcSparkSqlOperatorcloud.operators.datastore.CloudDatastoreExportEntitiesOperatorcontrib.operators.datastore_export_operator.DatastoreExportOperatorcloud.operators.datastore.CloudDatastoreImportEntitiesOperatorcontrib.operators.datastore_import_operator.DatastoreImportOperatorcloud.operators.dlp.CloudDLPCancelDLPJobOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCancelDLPJobOperatorcloud.operators.dlp.CloudDLPCreateDLPJobOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCreateDLPJobOperatorcloud.operators.dlp.CloudDLPCreateDeidentifyTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCreateDeidentifyTemplateOperatorcloud.operators.dlp.CloudDLPCreateInspectTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCreateInspectTemplateOperatorcloud.operators.dlp.CloudDLPCreateJobTriggerOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCreateJobTriggerOperatorcloud.operators.dlp.CloudDLPCreateStoredInfoTypeOperatorcontrib.operators.gcp_dlp_operator.CloudDLPCreateStoredInfoTypeOperatorcloud.operators.dlp.CloudDLPDeidentifyContentOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeidentifyContentOperatorcloud.operators.dlp.CloudDLPDeleteDLPJobOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeleteDlpJobOperatorcloud.operators.dlp.CloudDLPDeleteDeidentifyTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeleteDeidentifyTemplateOperatorcloud.operators.dlp.CloudDLPDeleteInspectTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeleteInspectTemplateOperatorcloud.operators.dlp.CloudDLPDeleteJobTriggerOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeleteJobTriggerOperatorcloud.operators.dlp.CloudDLPDeleteStoredInfoTypeOperatorcontrib.operators.gcp_dlp_operator.CloudDLPDeleteStoredInfoTypeOperatorcloud.operators.dlp.CloudDLPGetDLPJobOperatorcontrib.operators.gcp_dlp_operator.CloudDLPGetDlpJobOperatorcloud.operators.dlp.CloudDLPGetDLPJobTriggerOperatorcontrib.operators.gcp_dlp_operator.CloudDLPGetJobTripperOperatorcloud.operators.dlp.CloudDLPGetDeidentifyTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPGetDeidentifyTemplateOperatorcloud.operators.dlp.CloudDLPGetInspectTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPGetInspectTemplateOperatorcloud.operators.dlp.CloudDLPGetStoredInfoTypeOperatorcontrib.operators.gcp_dlp_operator.CloudDLPGetStoredInfoTypeOperatorcloud.operators.dlp.CloudDLPInspectContentOperatorcontrib.operators.gcp_dlp_operator.CloudDLPInspectContentOperatorcloud.operators.dlp.CloudDLPListDLPJobsOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListDlpJobsOperatorcloud.operators.dlp.CloudDLPListDeidentifyTemplatesOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListDeidentifyTemplatesOperatorcloud.operators.dlp.CloudDLPListInfoTypesOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListInfoTypesOperatorcloud.operators.dlp.CloudDLPListInspectTemplatesOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListInspectTemplatesOperatorcloud.operators.dlp.CloudDLPListJobTriggersOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListJobTriggersOperatorcloud.operators.dlp.CloudDLPListStoredInfoTypesOperatorcontrib.operators.gcp_dlp_operator.CloudDLPListStoredInfoTypesOperatorcloud.operators.dlp.CloudDLPRedactImageOperatorcontrib.operators.gcp_dlp_operator.CloudDLPRedactImageOperatorcloud.operators.dlp.CloudDLPReidentifyContentOperatorcontrib.operators.gcp_dlp_operator.CloudDLPReidentifyContentOperatorcloud.operators.dlp.CloudDLPUpdateDeidentifyTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPUpdateDeidentifyTemplateOperatorcloud.operators.dlp.CloudDLPUpdateInspectTemplateOperatorcontrib.operators.gcp_dlp_operator.CloudDLPUpdateInspectTemplateOperatorcloud.operators.dlp.CloudDLPUpdateJobTriggerOperatorcontrib.operators.gcp_dlp_operator.CloudDLPUpdateJobTriggerOperatorcloud.operators.dlp.CloudDLPUpdateStoredInfoTypeOperatorcontrib.operators.gcp_dlp_operator.CloudDLPUpdateStoredInfoTypeOperatorcloud.operators.functions.CloudFunctionDeleteFunctionOperatorcontrib.operators.gcp_function_operator.GcfFunctionDeleteOperatorcloud.operators.functions.CloudFunctionDeployFunctionOperatorcontrib.operators.gcp_function_operator.GcfFunctionDeployOperatorcloud.operators.gcs.GCSBucketCreateAclEntryOperatorcontrib.operators.gcs_acl_operator.GoogleCloudStorageBucketCreateAclEntryOperatorcloud.operators.gcs.GCSCreateBucketOperatorcontrib.operators.gcs_operator.GoogleCloudStorageCreateBucketOperatorcloud.operators.gcs.GCSDeleteObjectsOperatorcontrib.operators.gcs_delete_operator.GoogleCloudStorageDeleteOperatorcloud.operators.gcs.GCSListObjectsOperatorcontrib.operators.gcs_list_operator.GoogleCloudStorageListOperatorcloud.operators.gcs.GCSObjectCreateAclEntryOperatorcontrib.operators.gcs_acl_operator.GoogleCloudStorageObjectCreateAclEntryOperatorcloud.operators.kubernetes_engine.GKECreateClusterOperatorcontrib.operators.gcp_container_operator.GKEClusterCreateOperatorcloud.operators.kubernetes_engine.GKEDeleteClusterOperatorcontrib.operators.gcp_container_operator.GKEClusterDeleteOperatorcloud.operators.kubernetes_engine.GKEStartPodOperatorcontrib.operators.gcp_container_operator.GKEPodOperatorcloud.operators.mlengine.MLEngineManageModelOperatorcontrib.operators.mlengine_operator.MLEngineModelOperatorcloud.operators.mlengine.MLEngineManageVersionOperatorcontrib.operators.mlengine_operator.MLEngineVersionOperatorcloud.operators.mlengine.MLEngineStartBatchPredictionJobOperatorcontrib.operators.mlengine_operator.MLEngineBatchPredictionOperatorcloud.operators.mlengine.MLEngineStartTrainingJobOperatorcontrib.operators.mlengine_operator.MLEngineTrainingOperatorcloud.operators.natural_language.CloudNaturalLanguageAnalyzeEntitiesOperatorcontrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeEntitiesOperatorcloud.operators.natural_language.CloudNaturalLanguageAnalyzeEntitySentimentOperatorcontrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeEntitySentimentOperatorcloud.operators.natural_language.CloudNaturalLanguageAnalyzeSentimentOperatorcontrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeSentimentOperatorcloud.operators.natural_language.CloudNaturalLanguageClassifyTextOperatorcontrib.operators.gcp_natural_language_operator.CloudLanguageClassifyTextOperatorcloud.operators.pubsub.PubSubCreateSubscriptionOperatorcontrib.operators.pubsub_operator.PubSubSubscriptionCreateOperatorcloud.operators.pubsub.PubSubCreateTopicOperatorcontrib.operators.pubsub_operator.PubSubTopicCreateOperatorcloud.operators.pubsub.PubSubDeleteSubscriptionOperatorcontrib.operators.pubsub_operator.PubSubSubscriptionDeleteOperatorcloud.operators.pubsub.PubSubDeleteTopicOperatorcontrib.operators.pubsub_operator.PubSubTopicDeleteOperatorcloud.operators.pubsub.PubSubPublishMessageOperatorcontrib.operators.pubsub_operator.PubSubPublishOperatorcloud.operators.spanner.SpannerDeleteDatabaseInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseDeleteOperatorcloud.operators.spanner.SpannerDeleteInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDeleteOperatorcloud.operators.spanner.SpannerDeployDatabaseInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseDeployOperatorcloud.operators.spanner.SpannerDeployInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDeployOperatorcloud.operators.spanner.SpannerQueryDatabaseInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseQueryOperatorcloud.operators.spanner.SpannerUpdateDatabaseInstanceOperatorcontrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseUpdateOperatorcloud.operators.speech_to_text.CloudSpeechToTextRecognizeSpeechOperatorcontrib.operators.gcp_speech_to_text_operator.GcpSpeechToTextRecognizeSpeechOperatorcloud.operators.text_to_speech.CloudTextToSpeechSynthesizeOperatorcontrib.operators.gcp_text_to_speech_operator.GcpTextToSpeechSynthesizeOperatorcloud.operators.translate.CloudTranslateTextOperatorcontrib.operators.gcp_translate_operator.CloudTranslateTextOperatorcloud.operators.translate_speech.CloudTranslateSpeechOperatorcontrib.operators.gcp_translate_speech_operator.CloudTranslateSpeechOperatorcloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoExplicitContentOperatorcontrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoExplicitContentOperatorcloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoLabelsOperatorcontrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoLabelsOperatorcloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoShotsOperatorcontrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoShotsOperatorcloud.operators.vision.CloudVisionCreateProductOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductCreateOperatorcloud.operators.vision.CloudVisionCreateProductSetOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductSetCreateOperatorcloud.operators.vision.CloudVisionCreateReferenceImageOperatorcontrib.operators.gcp_vision_operator.CloudVisionReferenceImageCreateOperatorcloud.operators.vision.CloudVisionDeleteProductOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductDeleteOperatorcloud.operators.vision.CloudVisionDeleteProductSetOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductSetDeleteOperatorcloud.operators.vision.CloudVisionDetectImageLabelsOperatorcontrib.operators.gcp_vision_operator.CloudVisionDetectImageLabelsOperatorcloud.operators.vision.CloudVisionDetectImageSafeSearchOperatorcontrib.operators.gcp_vision_operator.CloudVisionDetectImageSafeSearchOperatorcloud.operators.vision.CloudVisionDetectTextOperatorcontrib.operators.gcp_vision_operator.CloudVisionDetectTextOperatorcloud.operators.vision.CloudVisionGetProductOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductGetOperatorcloud.operators.vision.CloudVisionGetProductSetOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductSetGetOperatorcloud.operators.vision.CloudVisionImageAnnotateOperatorcontrib.operators.gcp_vision_operator.CloudVisionAnnotateImageOperatorcloud.operators.vision.CloudVisionRemoveProductFromProductSetOperatorcontrib.operators.gcp_vision_operator.CloudVisionRemoveProductFromProductSetOperatorcloud.operators.vision.CloudVisionTextDetectOperatorcontrib.operators.gcp_vision_operator.CloudVisionDetectDocumentTextOperatorcloud.operators.vision.CloudVisionUpdateProductOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductUpdateOperatorcloud.operators.vision.CloudVisionUpdateProductSetOperatorcontrib.operators.gcp_vision_operator.CloudVisionProductSetUpdateOperatorTransfer operatorsNew transfer operatorsNew Airflow 2.0 transfers:airflow.providers.googlepackageads.transfers.ads_to_gcs.GoogleAdsToGcsOperatorcloud.transfers.azure_fileshare_to_gcs.AzureFileShareToGCSOperatorcloud.transfers.facebook_ads_to_gcs.FacebookAdsReportToGcsOperatorcloud.transfers.gcs_to_local.GCSToLocalFilesystemOperatorcloud.transfers.gcs_to_sftp.GCSToSFTPOperatorcloud.transfers.gdrive_to_gcs.GoogleDriveToGCSOperatorcloud.transfers.gdrive_to_local.GoogleDriveToLocalOperatorcloud.transfers.oracle_to_gcs.OracleToGCSOperatorcloud.transfers.presto_to_gcs.PrestoToGCSOperatorcloud.transfers.salesforce_to_gcs.SalesforceToGcsOperatorcloud.transfers.sftp_to_gcs.SFTPToGCSOperatorcloud.transfers.sheets_to_gcs.GoogleSheetsToGCSOperatorsuite.transfers.gcs_to_sheets.GCSToGoogleSheetsOperatorMoved transfer operatorsAirflow 2.0 transfers:airflow.providers.googlepackageAirflow 1.10.* previous location (usuallyairflow.contrib)cloud.transfers.adls_to_gcs.ADLSToGCSOperatorcontrib.operators.adls_to_gcs.AdlsToGoogleCloudStorageOperatorcloud.transfers.bigquery_to_bigquery.BigQueryToBigQueryOperatorcontrib.operators.bigquery_to_bigquery.BigQueryToBigQueryOperatorcloud.transfers.bigquery_to_gcs.BigQueryToGCSOperatorcontrib.operators.bigquery_to_gcs.BigQueryToCloudStorageOperatorcloud.transfers.bigquery_to_mysql.BigQueryToMySqlOperatorcontrib.operators.bigquery_to_mysql_operator.BigQueryToMySqlOperatorcloud.transfers.cassandra_to_gcs.CassandraToGCSOperatorcontrib.operators.cassandra_to_gcs.CassandraToGoogleCloudStorageOperatorcloud.transfers.gcs_to_bigquery.GCSToBigQueryOperatorcontrib.operators.gcs_to_bq.GoogleCloudStorageToBigQueryOperatorcloud.transfers.gcs_to_gcs.GCSToGCSOperatorcontrib.operators.gcs_to_gcs.GoogleCloudStorageToGoogleCloudStorageOperatorcloud.transfers.local_to_gcs.LocalFilesystemToGCSOperatorcontrib.operators.file_to_gcs.FileToGoogleCloudStorageOperatorcloud.transfers.mssql_to_gcs.MSSQLToGCSOperatorcontrib.operators.mssql_to_gcs.MsSqlToGoogleCloudStorageOperatorcloud.transfers.mysql_to_gcs.MySQLToGCSOperatorcontrib.operators.mysql_to_gcs.MySqlToGoogleCloudStorageOperatorcloud.transfers.postgres_to_gcs.PostgresToGCSOperatorcontrib.operators.postgres_to_gcs_operator.PostgresToGoogleCloudStorageOperatorcloud.transfers.s3_to_gcs.S3ToGCSOperatorcontrib.operators.s3_to_gcs_operator.S3ToGCSOperatorcloud.transfers.sql_to_gcs.BaseSQLToGCSOperatorcontrib.operators.sql_to_gcs.BaseSQLToGoogleCloudStorageOperatorsuite.transfers.gcs_to_gdrive.GCSToGoogleDriveOperatorcontrib.operators.gcs_to_gdrive_operator.GCSToGoogleDriveOperatorSensorsNew sensorsNew Airflow 2.0 sensors:airflow.providers.googlepackagecloud.sensors.bigquery.BigQueryTablePartitionExistenceSensorcloud.sensors.bigquery_dts.BigQueryDataTransferServiceTransferRunSensorcloud.sensors.dataflow.DataflowJobAutoScalingEventsSensorcloud.sensors.dataflow.DataflowJobMessagesSensorcloud.sensors.dataflow.DataflowJobMetricsSensorcloud.sensors.dataflow.DataflowJobStatusSensorcloud.sensors.dataproc.DataprocJobSensorcloud.sensors.gcs.GCSObjectsWtihPrefixExistenceSensorcloud.sensors.workflows.WorkflowExecutionSensormarketing_platform.sensors.campaign_manager.GoogleCampaignManagerReportSensormarketing_platform.sensors.display_video.GoogleDisplayVideo360GetSDFDownloadOperationSensormarketing_platform.sensors.display_video.GoogleDisplayVideo360ReportSensormarketing_platform.sensors.search_ads.GoogleSearchAdsReportSensorsuite.sensors.drive.GoogleDriveFileExistenceSensorMoved sensorsAirflow 2.0 sensors:airflow.providers.googlepackageAirflow 1.10.* previous location (usuallyairflow.contrib)cloud.sensors.bigquery.BigQueryTableExistenceSensorcontrib.sensors.bigquery_sensor.BigQueryTableSensorcloud.sensors.bigtable.BigtableTableReplicationCompletedSensorcontrib.operators.gcp_bigtable_operator.BigtableTableWaitForReplicationSensorcloud.sensors.cloud_storage_transfer_service.CloudDataTransferServiceJobStatusSensorcontrib.sensors.gcp_transfer_sensor.GCPTransferServiceWaitForJobStatusSensorcloud.sensors.gcs.GCSObjectExistenceSensorcontrib.sensors.gcs_sensor.GoogleCloudStorageObjectSensorcloud.sensors.gcs.GCSObjectUpdateSensorcontrib.sensors.gcs_sensor.GoogleCloudStorageObjectUpdatedSensorcloud.sensors.gcs.GCSObjectsWithPrefixExistenceSensorcontrib.sensors.gcs_sensor.GoogleCloudStoragePrefixSensorcloud.sensors.gcs.GCSUploadSessionCompleteSensorcontrib.sensors.gcs_sensor.GoogleCloudStorageUploadSessionCompleteSensorcloud.sensors.pubsub.PubSubPullSensorcontrib.sensors.pubsub_sensor.PubSubPullSensorHooksNew hooksNew Airflow 2.0 hooks:airflow.providers.googlepackageads.hooks.ads.GoogleAdsHookcloud.hooks.automl.CloudAutoMLHookcloud.hooks.bigquery_dts.BiqQueryDataTransferServiceHookcloud.hooks.cloud_memorystore.CloudMemorystoreHookcloud.hooks.cloud_memorystore.CloudMemorystoreMemcachedHookcloud.hooks.compute_ssh.ComputeEngineSSHHookcloud.hooks.datacatalog.CloudDataCatalogHookcloud.hooks.datafusion.DataFusionHookcloud.hooks.dataprep.GoogleDataprepHookcloud.hooks.gdm.GoogleDeploymentManagerHookcloud.hooks.life_sciences.LifeSciencesHookcloud.hooks.os_login.OSLoginHookcloud.hooks.secret_manager.SecretsManagerHookcloud.hooks.stackdriver.StackdriverHookcloud.hooks.workflows.WorkflowsHookcommon.hooks.discovery_api.GoogleDiscoveryApiHookfirebase.hooks.firestore.CloudFirestoreHookmarketing_platform.hooks.analytics.GoogleAnalyticsHookmarketing_platform.hooks.campaign_manager.GoogleCampaignManagerHookmarketing_platform.hooks.display_video.GoogleDisplayVideo360Hookmarketing_platform.hooks.search_ads.GoogleSearchAdsHooksuite.hooks.sheets.GSheetsHookMoved hooksAirflow 2.0 hooks:airflow.providers.googlepackageAirflow 1.10.* previous location (usuallyairflow.contrib)cloud.hooks.bigquery.BigQueryHookcontrib.hooks.bigquery_hook.BigQueryHookcloud.hooks.bigtable.BigtableHookcontrib.hooks.gcp_bigtable_hook.BigtableHookcloud.hooks.cloud_build.CloudBuildHookcontrib.hooks.gcp_cloud_build_hook.CloudBuildHookcloud.hooks.cloud_sql.CloudSQLDatabaseHookcontrib.hooks.gcp_sql_hook.CloudSqlDatabaseHookcloud.hooks.cloud_sql.CloudSQLHookcontrib.hooks.gcp_sql_hook.CloudSqlHookcloud.hooks.cloud_storage_transfer_service.CloudDataTransferServiceHookcontrib.hooks.gcp_transfer_hook.GCPTransferServiceHookcloud.hooks.compute.ComputeEngineHookcontrib.hooks.gcp_compute_hook.GceHookcloud.hooks.dataflow.DataflowHookcontrib.hooks.gcp_dataflow_hook.DataFlowHookcloud.hooks.dataproc.DataprocHookcontrib.hooks.gcp_dataproc_hook.DataProcHookcloud.hooks.datastore.DatastoreHookcontrib.hooks.datastore_hook.DatastoreHookcloud.hooks.dlp.CloudDLPHookcontrib.hooks.gcp_dlp_hook.CloudDLPHookcloud.hooks.functions.CloudFunctionsHookcontrib.hooks.gcp_function_hook.GcfHookcloud.hooks.gcs.GCSHookcontrib.hooks.gcs_hook.GoogleCloudStorageHookcloud.hooks.kms.CloudKMSHookcontrib.hooks.gcp_kms_hook.GoogleCloudKMSHookcloud.hooks.kubernetes_engine.GKEHookcontrib.hooks.gcp_container_hook.GKEClusterHookcloud.hooks.mlengine.MLEngineHookcontrib.hooks.gcp_mlengine_hook.MLEngineHookcloud.hooks.natural_language.CloudNaturalLanguageHookcontrib.hooks.gcp_natural_language_hook.CloudNaturalLanguageHookcloud.hooks.pubsub.PubSubHookcontrib.hooks.gcp_pubsub_hook.PubSubHookcloud.hooks.spanner.SpannerHookcontrib.hooks.gcp_spanner_hook.CloudSpannerHookcloud.hooks.speech_to_text.CloudSpeechToTextHookcontrib.hooks.gcp_speech_to_text_hook.GCPSpeechToTextHookcloud.hooks.tasks.CloudTasksHookcontrib.hooks.gcp_tasks_hook.CloudTasksHookcloud.hooks.text_to_speech.CloudTextToSpeechHookcontrib.hooks.gcp_text_to_speech_hook.GCPTextToSpeechHookcloud.hooks.translate.CloudTranslateHookcontrib.hooks.gcp_translate_hook.CloudTranslateHookcloud.hooks.video_intelligence.CloudVideoIntelligenceHookcontrib.hooks.gcp_video_intelligence_hook.CloudVideoIntelligenceHookcloud.hooks.vision.CloudVisionHookcontrib.hooks.gcp_vision_hook.CloudVisionHookcommon.hooks.base_google.GoogleBaseHookcontrib.hooks.gcp_api_base_hook.GoogleBaseHooksuite.hooks.drive.GoogleDriveHookcontrib.hooks.gdrive_hook.GoogleDriveHookSecretsMoved secretsAirflow 2.0 secrets:airflow.providers.googlepackageAirflow 1.10.* previous location (usuallyairflow.contrib)cloud.secrets.secret_manager.CloudSecretManagerBackendcontrib.secrets.gcp_secrets_manager.CloudSecretsManagerBackendReleasesRelease 2021.3.3CommitCommittedSubject50a1504c52021-02-27Fix spellings (#14483)bfef559cf2021-02-27Corrects order of argument in docstring in GCSHook.download method (#14497)33214d9322021-02-26Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)c281979982021-02-23Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)ca35bd7f72021-02-21By default PIP will install all packages in .local folder (#14125)a7e4266d62021-02-21Refactor GoogleDriveToGCSOperator to use common methods (#14276)1ab4066632021-02-16Add GoogleDriveToLocalOperator (#14191)59c94c6792021-02-13Add &#39;exists_ok&#39; flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)e31b27d592021-02-13Add materialized view support for BigQuery (#14201)e3bcaa3ba2021-02-12Correct typo in GCSObjectsWtihPrefixExistenceSensor  (#14179)7faa2d9782021-02-10Add BigQueryUpdateTableOperator (#14149)1da6972162021-02-10Fixes to dataproc operators and hook (#14086)02288cf2b2021-02-10Add param to CloudDataTransferServiceOperator (#14118)7d38645472021-02-09#9803 fix bug in copy operation without wildcard  (#13919)b0c3824262021-02-07Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)5d7d46bb32021-02-05Improve GCSToSFTPOperator paths handling (#11284)10343ec292021-02-05Corrections in docs and tools after releasing provider RCs (#14082)Release 2021.2.5CommitCommittedSubject88bdcfa0d2021-02-04Prepare to release a new wave of providers. (#14013)1872d87192021-02-03Add Apache Beam operators (#12814)0e8c77b932021-02-03Support google-cloud-logging&#39; &gt;=2.0.0 (#13801)833e338322021-02-02Fix four bugs in StackdriverTaskHandler (#13784)d2efb33232021-02-02Support google-cloud-monitoring&gt;=2.0.0 (#13769)ac2f72c982021-02-01Implement provider versioning tools (#13767)823741cfe2021-01-28Improve GCS system test envs (#13946)6d6588fe22021-01-28Add Google Cloud Workflows Operators (#13366)810c15ed82021-01-27Fix and improve GCP BigTable hook and system test (#13896)6616617332021-01-27Add env variables to PubSub example dag (#13794)f473ca7132021-01-24Replace &#39;google_cloud_storage_conn_id&#39; by &#39;gcp_conn_id&#39; when using &#39;GCSHook&#39; (#13851)a9ac2b0402021-01-23Switch to f-strings using flynt. (#13732)9592be88e2021-01-22Fix Google Spanner example dag (#13842)af52fdb512021-01-22Improve environment variables in GCP Dataflow system test (#13841)e7946f1cb2021-01-22Improve environment variables in GCP Datafusion system test (#13837)61c1d6ec62021-01-22Improve environment variables in GCP Memorystore system test (#13833)202f660932021-01-22Improve environment variables in GCP Lifeciences system test (#13834)70bf307f32021-01-21Add How To Guide for Dataflow (#13461)3fd5ef3552021-01-21Add missing logos for integrations (#13717)309788e5e2021-01-18Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)7ec858c452021-01-17updated Google DV360 Hook to fix SDF issue (#13703)ef8617ec92021-01-14Support google-cloud-tasks&gt;=2.0.0 (#13347)189af54042021-01-13Add system tests for Stackdriver operators (#13644)a6f999b622021-01-11Support google-cloud-automl &gt;=2.1.0 (#13505)947dbb73b2021-01-11Support google-cloud-datacatalog&gt;=3.0.0 (#13534)2fb68342b2021-01-07Replace deprecated module and operator in example_tasks.py (#13527)003584bbf2021-01-05Fix failing backport packages test (#13497)7d1ea4cb12021-01-05Replace deprecated module and operator in example_tasks.py (#13473)c7d75ad882021-01-05Revert &#34;Support google-cloud-datacatalog 3.0.0 (#13224)&#34; (#13482)feb84057d2021-01-04Support google-cloud-datacatalog 3.0.0 (#13224)3a3e739982021-01-04Fix insert_all method of BigQueryHook to support tables without schema (#13138)c33d2c06b2021-01-02Fix another pylint c-extension-no-member (#13438)f6518dd6a2021-01-02Generalize MLEngineStartTrainingJobOperator to custom images (#13318)9de7127082020-12-31Support google-cloud-bigquery-datatransfer&gt;=3.0.0 (#13337)406181d642020-12-31Add Parquet data type to BaseSQLToGCSOperator (#13359)295d66f912020-12-30Fix Grammar in PIP warning (#13380)13a9747bf2020-12-28Revert &#34;Support google-cloud-tasks&gt;=2.0.0 (#13334)&#34; (#13341)04ec45f042020-12-28Add DataprocCreateWorkflowTemplateOperator (#13338)1f712219f2020-12-28Support google-cloud-tasks&gt;=2.0.0 (#13334)f4745c8ce2020-12-26Fix typo in example (#13321)e9d65bd452020-12-24Decode Remote Google Logs (#13115)e7aeacf332020-12-24Add OracleToGCS Transfer (#13246)323084e972020-12-24Add timeout option to gcs hook methods. (#13156)0b626c8042020-12-22Support google-cloud-redis&gt;=2.0.0 (#13117)9042a58552020-12-22Add more operators to example DAGs for Cloud Tasks (#13235)8c00ec89b2020-12-22Support google-cloud-pubsub&gt;=2.0.0 (#13127)b26b0df5b2020-12-22Update compatibility with google-cloud-kms&gt;=2.0 (#13124)9a1d3820d2020-12-22Support google-cloud-datacatalog&gt;=1.0.0 (#13097)f95b1c9c92020-12-21Add regional support to dataproc workflow template operators (#12907)6cf76d7ac2020-12-18Fix typo in pip upgrade command :( (#13148)23f27c1b12020-12-18Add system tests for CloudKMSHook (#13122)cddbf81b12020-12-17Fix Google BigQueryHook method get_schema() (#13136)1259c712a2020-12-17Update compatibility with google-cloud-os-login&gt;=2.0.0 (#13126)bcf77586e2020-12-16Fix Data Catalog operators (#13096)5090fb0c82020-12-15Add script to generate integrations.json (#13073)b4b9cf5592020-12-14Check for missing references to operator guides (#13059)1c1ef7ee62020-12-14Add project_id to client inside BigQuery hook update_table method (#13018)32971a1a22020-12-09Updates providers versions to 1.0.0 (#12955)b40dffa082020-12-08Rename remaing modules to match AIP-21 (#12917)9b39f24782020-12-08Add support for dynamic connection form fields per provider (#12558)1dcd3e13f2020-12-05Add support for extra links coming from the providers (#12472)2037303ee2020-11-29Adds support for Connection/Hook discovery from providers (#12466)02d94349b2020-11-29Don&#39;t use time.time() or timezone.utcnow() for duration calculations (#12353)76bcd08dc2020-11-28Added &#39;@apply_defaults&#39; decorator. (#12620)e1ebfa68b2020-11-27Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)3fa51f94d2020-11-24Add check for duplicates in provider.yaml files (#12578)c34ef853c2020-11-20Separate out documentation building per provider  (#12444)9e3b2c5542020-11-19GCP Secrets Optional Lookup (#12360)0080354502020-11-18Update provider READMEs for 1.0.0b2 batch release (#12449)7ca0b6f122020-11-18Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)8d09506462020-11-18Fix download method in GCSToBigQueryOperator (#12442)Release 2020.11.23CommitCommittedSubject4873d97592020-11-18Enable Markdownlint rule MD003/heading-style/header-style (#12427)8d09506462020-11-18Fix download method in GCSToBigQueryOperator (#12442)2c0920fba2020-11-17Adds mechanism for provider package discovery. (#12383)2cda2f2a02020-11-17Add missing pre-commit definition - provider-yamls (#12393)80a957f142020-11-17Add Dataflow sensors - job metrics (#12039)ae7cb4a1e2020-11-17Update wrong commit hash in backport provider changes (#12390)917e6c4422020-11-16Add provide_file_and_upload to GCSHook (#12310)cfa4ecfeb2020-11-15Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)6889a333c2020-11-15Improvements for operators and hooks ref docs (#12366)7825e8f592020-11-13Docs installation improvements (#12304)32b59f8352020-11-12Fixes the sending of an empty list to BigQuerylist_rows(#12307)250436d962020-11-10Fix spelling in Python files (#12230)502ba309e2020-11-10Enable Markdownlint rule - MD022/blanks-around-headings (#12225)dd2095f4a2020-11-10Simplify string expressions & Use f-string (#12216)f37c6e6fc2020-11-10Add Compute Engine SSH hook (#9879)85a18e13d2020-11-09Point at pypi project pages for cross-dependency of provider packages (#12212)59eb5de782020-11-09Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)61feb6ec42020-11-09Provider's readmes generated for elasticsearch and google packages (#12194)Release 2020.11.13CommitCommittedSubjectb2a28d1592020-11-09Moves provider packages scripts to dev (#12082)fcb6b00ef2020-11-08Add authentication to AWS with Google credentials (#12079)2ef3b7ef82020-11-08Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)0caec9fd32020-11-06Dataflow - add waiting for successful job cancel (#11501)cf9437d792020-11-06Simplify string expressions (#12123)91a64db502020-11-04Format all files (without excepions) by black (#12091)fd3db778e2020-11-04Add server side cursor support for postgres to GCS operator (#11793)f1f1940262020-11-04Add DataflowStartSQLQuery operator (#8553)41bf172c12020-11-04Simplify string expressions (#12093)5f5244b742020-11-04Add template fields renderers to Biguery and Dataproc operators (#12067)4e8f9cc8d2020-11-03Enable Black - Python Auto Formmatter (#9550)8c42cf1b02020-11-03Use PyUpgrade to use Python 3.6 features (#11447)45ae145c22020-11-03Log BigQuery job id in insert method of BigQueryHook (#12056)e324b37a62020-11-03Add job name and progress logs to Cloud Storage Transfer Hook (#12014)6071fdd582020-11-02Improve handling server errors in DataprocSubmitJobOperator (#11947)2f703df122020-10-30Add SalesforceToGcsOperator (#10760)e5713e00b2020-10-29Add drain option when canceling Dataflow pipelines (#11374)37eaac3c52020-10-29The PRs which are not approved run subset of tests (#11828)79cb771992020-10-28Fixing re pattern and changing to use a single character class. (#11857)5a439e84e2020-10-26Prepare providers release 0.0.2a1 (#11855)240c7d4d72020-10-26Google Memcached hooks - improve protobuf messages handling (#11743)8afdb6ac62020-10-26Fix spellings (#11825)872b1566a2020-10-25Generated backport providers readmes/setup for 2020.10.29 (#11826)b680bbc0b2020-10-24Generated backport providers readmes/setup for 2020.10.29Release 2020.10.29CommitCommittedSubjectb680bbc0b2020-10-24Generated backport providers readmes/setup for 2020.10.296ce855af12020-10-24Fix spelling (#11821)4830687452020-10-24Use Python 3 style super classes (#11806)727c739af2020-10-22Improve Cloud Memorystore for Redis example (#11735)1da8379c92020-10-22Fix static checks after merging #10121 (#11737)91503308c2020-10-22Add Google Cloud Memorystore Memcached Operators (#10121)950c16d0b2020-10-21Retry requests in case of error in Google ML Engine Hook (#11712)2bfc53b5e2020-10-21Fix doc errors in google provider files. (#11713)53e6062102020-10-21Enforce strict rules for yamllint (#11709)349b0811c2020-10-20Add D200 pydocstyle check (#11688)2d854c3502020-10-19Add service_account to Google ML Engine operator (#11619)46a121fb72020-10-18docs: Update Bigquery clustering docstrings (#11232)49c58147f2020-10-18Strict type checking for provider Google (#11609)0823d46a72020-10-16Add type annotations for AWS operators and hooks (#11434)3c10ca6502020-10-16Add DataflowStartFlexTemplateOperator (#8550)8865d14df2020-10-16Strict type checking for provider google cloud  (#11548)16e7129712020-10-13Added support for provider packages for Airflow 2.0 (#11487)06141d6d02020-10-12Google cloud operator strict type check (#11450)d305876be2020-10-12Remove redundant None provided as default to dict.get() (#11448)1845cd11b2020-10-11Strict type check for google ads and cloud hooks (#11390)bd204bb912020-10-11Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)75071831b2020-10-10Remove redundant parentheses from Python files (#10967)8baf657fc2020-10-09Fix regression in DataflowTemplatedJobStartOperator (#11167)b0fcf67552020-10-07Add AzureFileShareToGCSOperator (#10991)47b05a87f2020-10-07Improve handling of job_id in BigQuery operators (#11287)0a0e1af802020-10-03Fix Broken Markdown links in Providers README TOC (#11249)Release 2020.10.5CommitCommittedSubjectca4238eb42020-10-02Fixed month in backport packages to October (#11242)5220e4c382020-10-02Prepare Backport release 2020.09.07 (#11238)cb52fb0ae2020-09-27Add example DAG and system test for MySQLToGCSOperator (#10990)99accec292020-09-25Fix incorrect Usage of Optional[str] & Optional[int] (#11141)e3f96ce7a2020-09-24Fix incorrect Usage of Optional[bool] (#11138)daf8f31082020-09-23Add template fields renderers for better UI rendering (#11061)f3e87c5032020-09-22Add D202 pydocstyle check (#11032)cb979f9f22020-09-22Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)76545bb3d2020-09-16Add example dag and system test for S3ToGCSOperator (#10951)22c6316252020-09-16Fix more docs spellings (#10965)12a652f532020-09-13Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)41a62735e2020-09-11Add on_kill method to BigQueryInsertJobOperator (#10866)3e91da56e2020-09-11fix typo in firebase/example_filestore DAG (#10875)68cc7273b2020-09-10Add on_kill method to DataprocSubmitJobOperator (#10847)f920957212020-09-10Fix and remove some more typos from spelling_wordlist.txt (#10845)9549274d12020-09-09Upgrade black to 20.8b1 (#10818)078bfaf602020-09-08Extract missing gcs_to_local example DAG from gcs example (#10767)10ce311272020-09-08Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)f14f379712020-09-07[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)c8ee455682020-09-07Refactor DataprocCreateCluster operator to use simpler interface (#10403)ece685b5b2020-09-05Asynchronous execution of Dataproc jobs with a Sensor (#10673)6e3d7b63d2020-09-04Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)804548d582020-09-01Add Dataprep operators (#10304)11c00bc822020-08-30Fix typos: duplicated "the" (#10647)2ca615cff2020-08-29Update Google Cloud branding (#10642)1b533f6172020-08-28Fix broken master - DLP (#10635)5ae82a56d2020-08-28Fix Google DLP example and improve ops idempotency (#10608)3867f76622020-08-28Update Google Cloud branding (#10615)91ff31ad12020-08-27Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)fdd9b6f652020-08-25Enable Black on Providers Packages (#10543)d760265452020-08-25PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)d1bce91bb2020-08-25PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)866701c802020-08-25Fix typo in "Cloud" (#10534)47265e7b52020-08-24Fix typo in PostgresHook (#10529)3696c34c22020-08-24Fix typo in the word "release" (#10528)2f2d8dbfa2020-08-25Remove all "noinspection" comments native to IntelliJ (#10525)3734876d92020-08-24Implement impersonation in google operators (#10052)b0598b5352020-08-24Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)ee7ca128a2020-08-22Fix broken Markdown refernces in Providers README (#10483)515cc72c92020-08-22Fix typo in timed_out (#10459)7c206a82a2020-08-22Replace assigment with Augmented assignment (#10468)88c7d2e522020-08-21Dataflow operators don't not always create a virtualenv (#10373)083c3c1292020-08-18Simplified GCSTaskHandler configuration (#10365)1ae5bdf232020-08-17Add test for GCSTaskHandler (#9600) (#9861)e195a980b2020-08-16Add type annotations for mlengine_operator_utils (#10297)382c1011b2020-08-16Add Bigtable Update Instance Hook/Operator (#10340)bfa5a8d5f2020-08-15CI: Fix failing docs-build (#10342)be46d20fb2020-08-15Improve idempotency of BigQueryInsertJobOperator (#9590)47387a69e2020-08-14Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)2f0613b0c2020-08-13Implement Google BigQuery Table Partition Sensor (#10218)f6734b3b82020-08-12Enable Sphinx spellcheck for doc generation (#10280)8f8db89592020-08-12DbApiHook: Support kwargs in get_pandas_df (#9730)ef088314f2020-08-09Added DataprepGetJobsForJobGroupOperator (#10246)b43f90abf2020-08-09Fix various typos in the repo (#10263)c295338882020-08-08Add labels param to Google MLEngine Operators (#10222)cdec301252020-08-07Add correct signature to all operators and sensors (#10205)eff0f03212020-08-06Update guide for Google Cloud Secret Manager Backend (#10172)24c8e4c2d2020-08-06Changes to all the constructors to remove the args argument (#10163)0103226922020-08-06Improve handling Dataproc cluster creation with ERROR state (#9593)1437cb7492020-08-04Add correct signatures for operators in google provider package (#10144)6efa1b9cb2020-08-03Add additional Cloud Datastore operators (#10032)27020f8e52020-08-03Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)4e3799fec2020-08-02[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)85c56b1732020-08-02Add missing params to GCP Pub/Sub creation_subscription (#10106)b79466c122020-08-02Fix sensor not providing arguments for GCSHook (#10074)4ee35d0272020-08-02Fix hook not passing gcp_conn_id to base class (#10075)aeea712742020-08-02Removeargsparameter from provider operator constructors (#10097)4c84661ad2020-07-31Split Display Video 360 example into smaler DAGs (#10077)59cbff0872020-07-29Fix docstrings in BigQueryGetDataOperator (#10042)81b87d48e2020-07-27Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)7d24b088c2020-07-25Stop using start_date in default_args in example_dags (2) (#9985)8b10a4b352020-07-25Stop using start_date in default_args in example_dags (#9982)ef98edf4d2020-07-23Add more information about using GoogleAdsHook (#9951)33f0cd2652020-07-22apply_default keeps the function signature for mypy (#9784)39a0288a42020-07-22Add Google Authentication for experimental API (#9848)c2db0dfeb2020-07-22More strict rules in mypy (#9705) (#9906)c4244e18b2020-07-22Fix callingget_clientin BigQueryHook.table_exists (#9916)5eacc16422020-07-22Add support for impersonation in GCP hooks (#9915)1cfdebf5f2020-07-21Fix insert_job method of BigQueryHook (#9899)c8c52e69c2020-07-21Remove type hint causing DeprecationWarning in Firestore operators (#9819)eb6f1d1cf2020-07-16Fix typo in datafusion operator (#9859)b01d95ec22020-07-15Change DAG.clear to take dag_run_state (#9824)6d65c15d12020-07-15Add guide for AI Platform (previously Machine Learning Engine) Operators  (#9798)770de53eb2020-07-15BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)2d8dbacdf2020-07-15Add CloudVisionDeleteReferenceImageOperator  (#9698)9f017951b2020-07-15Add Google Deployment Manager Hook (#9159)ed5004cca2020-07-14Allowreplaceflag in gcs_to_gcs operator. (#9667)553bb7af72020-07-13Keep functions signatures in decorators (#9786)68925904e2020-07-13Add multiple file upload functionality to GCS hook (#8849)1de78e8f92020-07-12Add Google Stackdriver link (#9765)092d33f292020-07-11Fix StackdriverTaskHandler + add system tests (#9761)b2305660f2020-07-09Update example DAG for AI Platform operators (#9727)23f80f34a2020-07-08Move gcs & wasb task handlers to their respective provider packages (#9714)44d4ae8092020-07-06Upgrade to latest pre-commit checks (#9686)a79e2d4c42020-07-06Move provider's log task handlers to the provider package (#9604)cd3d9d9342020-07-02Fix using .json template extension in GMP operators (#9566)4799af30e2020-06-30Extend BigQuery example with include clause (#9572)e33f1a12d2020-06-30Add template_ext to BigQueryInsertJobOperator (#9568)40add26d42020-06-29Remove almost all references to airflow.contrib (#9559)c420dbd6e2020-06-27Bump Pylint to 2.5.3 (#9294)0051c89cb2020-06-26nitpick fix (#9527)87fdbd0702020-06-25Use literal syntax instead of function calls to create data structure (#9516)7256f4caa2020-06-22Pylint fixes and deprecation of rare used methods in Connection (#9419)e13a14c872020-06-21Enable & Fix Whitespace related PyDocStyle Checks (#9458)5b680e27e2020-06-19Don't use connection to store task handler credentials (#9381)d0e7db4022020-06-19Fixed release number for fresh release (#9408)Release 2020.6.24CommitCommittedSubject416334e2e2020-06-19Properly propagated warnings in operators (#9348)12af6a0802020-06-19Final cleanup for 2020.6.23rc1 release preparation (#9404)c7e5bce572020-06-19Prepare backport release candidate for 2020.6.23rc1 (#9370)4e09c64422020-06-18Adds GCP Secret Manager Hook (#9368)40bf8f28f2020-06-18Detect automatically the lack of reference to the guide in the operator descriptions (#9290)f6bd817a32020-06-16Introduce 'transfers' packages (#9320)639972d992020-06-16Add support for latest Apache Beam SDK in Dataflow operators (#9323)1459970b32020-06-15Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)431ea32912020-06-15Resolve upstream tasks when template field is XComArg (#8805)aee6ab94e2020-06-15Wait for pipeline state in Data Fusion operators (#8954)fb1c8b83d2020-06-10Add test for BQ operations using location (#9206)a26afbfa52020-06-10Make generated job_id more informative in BQ insert_job (#9203)c41192fa12020-06-10Upgrade pendulum to latest major version ~2.0 (#9184)b1c8c5ed52020-06-09Allows using private endpoints in GKEStartPodOperator (#9169)5918efc862020-06-05Add 3.8 to the test matrices (#8836)9bcdadaf72020-06-05Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)f56811dff2020-06-05[AIRFLOW-6290] Create guide for GKE operators (#8883)76962867b2020-06-04Fix sql_to_gcs hook gzip of schema_file (#9140)17adcea832020-06-02Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)7898525462020-06-01Add BigQueryInsertJobOperator (#8868)29eb68b902020-05-31Create guide for Dataproc Operators (#9037)886afaf622020-05-29Add example dag and system test for LocalFilesystemToGCSOperator (#9043)a779c4dfc2020-05-29add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)ada26be232020-05-29Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)81b2761b82020-05-29add example dag and system test for GoogleSheetsToGCSOperator (#9056)0b0e4f7a42020-05-26Preparing for RC3 release of backports (#9026)00642a46d2020-05-26Fixed name of 20 remaining wrongly named operators. (#8994)3994030ea2020-05-26Refactor BigQuery operators (#8858)cdb3f25452020-05-26All classes in backport providers are now importable in Airflow 1.10 (#8991)1d36b03032020-05-23Fix references in docs (#8984)cf5cf45e12020-05-23Support YAML input for CloudBuildCreateOperator (#8808)499493c5c2020-05-19[AIRFLOW-6586] Improvements to gcs sensor (#7197)375d1ca222020-05-19Release candidate 2 for backport packages 2020.05.20 (#8898)841d816642020-05-19Allow setting the pooling time in DLPHook (#8824)12c5e5d8a2020-05-17Prepare release candidate for backport packages (#8891)f3521fb0e2020-05-16Regenerate readme files for backport package release (#8886)15273f0ea2020-05-16Check for same task instead of Equality to detect Duplicate Tasks (#8828)92585ca4c2020-05-15Added automated release notes generation for backport operators (#8807)e1e833bb22020-05-13Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)8b54919712020-05-12Refactor BigQuery hook methods to use python library (#8631)6911dfe832020-05-12Fix template fields in Google operators (#8840)4b06fde0f2020-05-12Fix Flake8 errors (#8841)1d12c347c2020-05-12Refactor BigQuery check operators (#8813)493b685d72020-05-10Add separate example DAGs and system tests for google cloud speech (#8778)79ef8bed82020-05-10Added Upload Multiple Entity Read Files to specified big query dataset (#8610)280f1f0c42020-05-10Correctly restore upstream_task_ids when deserializing Operators (#8775)58aefb23b2020-05-08Added SDFtoGCSOperator (#8740)723c52c942020-05-07Add documentation for SpannerDeployInstanceOperator (#8750)25ee4211b2020-05-06Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)8d6f1aa4b2020-05-05Support num_retries field in env var for GCP connection (#8700)67caae0f22020-05-04Add system test for gcs_to_bigquery (#8556)bc45fa6752020-05-03Add system test and docs for Facebook Ads operators (#8503)a28c66f232020-04-30[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)992a24ce42020-04-28Split and improve BigQuery example DAG (#8529)c1fb282302020-04-28Refactor BigQueryHook dataset operations (#8477)e8d0f8fea2020-04-26Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)37fdfa9772020-04-26[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)14b22e6ff2020-04-25Add hook and operator for Google Cloud Life Sciences (#8481)72ddc94d12020-04-23Pass location using parmamter in Dataflow integration (#8382)912aa4b422020-04-23Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)57c8c05832020-04-22Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)5d3a7eef32020-04-20Allow multiple extra_packages in Dataflow (#8394)79c99b1b62020-04-18Added location parameter to BigQueryCheckOperator (#8273)79d3f33c12020-04-17Clean up temporary files in Dataflow operators (#8313)efcffa3232020-04-16Add Dataproc SparkR Example (#8240)b198a1fa92020-04-15Create guide for BigQuery operators (#8276)2636cc9322020-04-14Raise exception when GCP credential doesn't support account impersonation (#8213)eee4ebaee2020-04-14Added Facebook Ads Operator #7887 (#8008)8cae07ea12020-04-14fixed typo (#8294)45c8983302020-04-13Less aggressive eager upgrade of requirements (#8267)1fd9ed3842020-04-13Add mypy plugin for decorators. (#8145)327b0a9f72020-04-13Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)bb5e403a32020-04-10Honor schema type for MySQL to GCS data pre-process (#8090)87969a3502020-04-09[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)3fc89f29f2020-04-06[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)7ef75d2392020-04-03[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)ed2bc00572020-04-02Add Google Ads list accounts operator (#8007)3808a62062020-04-01Unify Google class/package names (#8033)8a02402572020-03-31Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)8e89780072020-03-31Add more refactor steps for providers.google (#8010)aae3b8fb22020-03-31Individual package READMEs (#8012)7790239682020-03-30[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)49abce5212020-03-30Improve system tests for Cloud Build (#8003)0f19a930d2020-03-29Remove GKEStartPodOperator when backporting (#7908)0e1c238b22020-03-28Get Airflow Variables from GCP Secrets Manager (#7946)eb4af4f942020-03-28Make BaseSecretsBackend.build_path generic (#7948)01f99426f2020-03-28Add download/upload operators for GCS and Google Sheets (#7866)892522f8e2020-03-26Change signature of GSheetsHook methods (#7853)bfd4251572020-03-26Improve idempotency in MLEngineHook.create_model (#7811)f9c2263432020-03-26Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)e3920f12f2020-03-26Improve setUp/tearDown in Cloud Firestore system test (#7862)8ba8a72952020-03-26Improve example DAGs for Cloud Memorystore (#7855)f7d1a437c2020-03-26Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)beef6c2302020-03-26Improve authorization in GCP system tests (#7863)5f165f3e42020-03-26[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)686d7d50b2020-03-25Standardize SecretBackend class names (#7846)1982c3fdc2020-03-24Run Dataflow for ML Engine summary in venv (#7809)eef87b9952020-03-23[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)529db07b22020-03-23Improve Google PubSub hook publish method (#7831)4bde99f132020-03-23Make airflow/providers pylint compatible (#7802)a001489b52020-03-23Improve example DAG for ML Engine (#7810)9e5a8e7f82020-03-23Add call to Super class in 'google' providers (#7823)b86bf79bf2020-03-23Fix typo in GCP credentials_provider's docstring (#7818)56c013ce92020-03-23Add missing docstring in BigQueryHook.create_empty_table (#7817)426a798472020-03-23Imrove support for laatest API in  MLEngineStartTrainingJobOperator (#7812)cdf1809fc2020-03-23[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)27dac00e12020-03-22[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)0daf5d7292020-03-22Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)c8088c2bd2020-03-20[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)5106a29312020-03-20[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)759ce2a802020-03-20[AIRFLOW-6978] Add PubSubPullOperator (#7766)6b9b214e42020-03-20[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)b118916962020-03-19[AIRFLOW-7069] Fix cloudsql system tests (#7770)ae854cae52020-03-19[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)7e1e954d22020-03-19[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)6e21c139b2020-03-19[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)ce022a3f72020-03-19[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)029c84e552020-03-18[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)63a3102ed2020-03-18[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)73305c7bd2020-03-18[AIRFLOW-7081] Remove env variables from GCP guide (#7755)60fdbf6d92020-03-18[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)de7e934ca2020-03-17[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)0de0347b22020-03-17[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)91557c6f82020-03-17[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)51161dbd92020-03-16[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)2bc020c432020-03-14[AIRFLOW-7055] Verbose logging option for google provider (#7711)c997cab422020-03-13[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)137896f322020-03-12[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)1f77f943d2020-03-10[AIRFLOW-6980] Improve system tests and building providers package (#7615)bf9b6b6d72020-03-09[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)e5130dc9f2020-03-09[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)faf0df4b92020-03-09[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)42eef38212020-03-07[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)b5b9795f02020-03-07[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)6b65038fb2020-03-06[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)755fe52242020-03-05[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)cb2f339112020-03-04[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)09fea3ce82020-03-04[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)8230ccc482020-03-04[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)0d1e3088a2020-03-04[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)ab6bb00122020-03-03[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)3db4ade3d2020-02-29[AIRFLOW-6924] Fix Google DLP operators return types (#7546)008b4bab12020-02-27[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)bb552b2d92020-02-25[AIRFLOW-6908] Lazy load AirflowException (#7528)d1a34246a2020-02-25[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)3320e432a2020-02-24[AIRFLOW-6817] Lazy-loadairflow.DAGto keep user-facing API untouched (#7517)dcf8743522020-02-24[AIRFLOW-6894] Prevent db query in example_dags (#7516)4d03e33c12020-02-22[AIRFLOW-6817] remove imports fromairflow/__init__.py, replaced implicit imports with explicit imports, added entry toUPDATING.MD- squashed/rebased (#7456)35b9616372020-02-21[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)aff3a361b2020-02-20[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)9cbd7de6d2020-02-18[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)5b199cb862020-02-17[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)2c9345a8e2020-02-17[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)946bdc23c2020-02-16[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)2381c820c2020-02-13[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)04c1fefbf2020-02-03[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)a0252748f2020-02-03[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)97a429f9d2020-02-02[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)9d8d075572020-02-03[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)cf141506a2020-02-02[AIRFLOW-6708] Set unique logger names (#7330)373c6aa4a2020-01-30[AIRFLOW-6682] Move GCP classes to providers package (#7295)83c0378732020-01-30[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)057f3ae3a2020-01-29[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)ceea293c12020-01-28[AIRFLOW-6656] Fix AIP-21 moving (#7272)c42a375e72020-01-27[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)059eda05f2020-01-21[AIRFLOW-6610] Move software classes to providers package (#7231)f4d3e5e542020-01-13[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)e7bf8ecb42020-01-13[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)5b6772cb82020-01-09[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)4f8592ae82020-01-08[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)20299473f2020-01-03[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)18e8cea4e2020-01-03[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)95087af142019-12-31[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)69629a5a92019-12-09[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)25e9047a42019-12-09[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)ed0a14f322019-12-09[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)2f2f89c142019-12-01[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)03c870a612019-11-26[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)5c4cfea8c2019-11-15[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)44a8c37a92019-11-13[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)d633d3ac42019-11-13[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)d985c02d92019-11-05[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)a296cdabd2019-11-04[AIRFLOW-5743] Move Google PubSub to providers package (#6476)470b2a7792019-10-30[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)f2caa451f2019-10-27[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)16d7accb22019-10-22[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)4e661f5352019-10-22[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)19e32b4e22019-10-18[AIRFLOW-5656] Rename provider to providers module (#6333)