Issue 1:
Description

Currently airflow doesn't provide a way to submit a DAG (an experimental api exists but not part of airflow deployment).

Similarly it provides a way to delete dag but doesn't cleanup the file.

Use case / motivation

We have a requirement where I want to generate a DAG programatically and then submit to airflow.Similarly based upon user request would like to cleanup the same.

But as there are no standard way, this can depend on how you airflow cluster is provisioned.If this can be standardised .

Issue 2:
Body

I have a kind request for all the contributors to the latest provider packages release.

Could you help us to test the RC versions of the providers and let us know in the comment,

if the issue is addressed there.

Providers that need testing

Those are providers that require testing as there were some substantial changes introduced:

Provider amazon: 2.4.0rc1

MySQLToS3Operator add support for parquet format (#18755): @guotongfei

Add RedshiftSQLHook, RedshiftSQLOperator (#18447): @Brooke-white

Remove extra postgres dependency from AWS Provider (#18844): @mariotaddeucci

Remove duplicated code on S3ToRedshiftOperator (#18671): @mariotaddeucci

Fixing ses email backend (#18042): @ignaski

Fixup string concatenations (#19099): @blag

Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807): @anaynayak

Move validation of templated input params to run after the context init (#19048): @eskarimov

Provider apache.hive: 2.0.3rc1

fix get_connections deprecation warn in hivemetastore hook (#18854): @Aakcht

Provider cncf.kubernetes: 2.1.0rc1

Add more type hints to PodLauncher (#18928): @jameslamb

add more information to PodLauncher timeout error (#17953): @jameslamb

Provider docker: 2.3.0rc1

Add support of placement in the DockerSwarmOperator (#18990): @enima2684

Fixup string concatenations (#19099): @blag

Remove the docker timeout workaround (#18872): @RyanSiu1995

Move docker decorator example dag to docker provider (#18739): @ephraimbuddy

Provider elasticsearch: 2.1.0rc1

AIP 39: Documentation (#17552): @uranusjr

Adds example showing the ES_hook (#17944): @frankcash

Provider facebook: 2.1.0rc1

Align the default version with Facebook business SDK (#18883): @RyanSiu1995

Provider google: 6.1.0rc1

Add value to "namespaceId" of query (#19163): @deedmitrij

Add pre-commit hook for common misspelling check in files (#18964): @ephraimbuddy

Support query timeout as an argument in CassandraToGCSOperator (#18927): @xuan616

Update BigQueryCreateExternalTableOperator doc and parameters (#18676): @tnyz

Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052): @josh-fell

Upgrade the dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879): @lwyszomi

Use google cloud credentials when executing beam commands in subprocesses (#18992): @SamWheating

Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal

Dataflow Operators - use project and location from job in on_kill method. (#18699): @lwyszomi

Fix hard-coded /tmp directory in CloudSQL Hook (#19229): @potiuk

Fix bug in Dataflow hook when no jobs are returned (#18981): @keze

Fix BigQueryToMsSqlOperator documentation (#18995): @potatochip

Move validation of templated input params to run after the context init (#19048): @eskarimov

Google provider catch invalid secret name (#18790): @raphaelauv

Provider jenkins: 2.0.3rc1

Remove distutils usages for Python 3.10 (#19064): @uranusjr

Provider microsoft.azure: 3.3.0rc1

update azure cosmos to latest version (#18695): @eladkal

Added sas_token var to BlobServiceClient return. Updated tests (#19234): @ReadytoRocc

Add pre-commit hook for common misspelling check in files (#18964): @ephraimbuddy

Fix changelog for Azure Provider (#18736): @potiuk

Expanding docs on client auth for AzureKeyVaultBackend (#18659): @alexbegg

Static start_date and default arg cleanup for Microsoft providers example DAGs (#19062): @josh-fell

Provider mongo: 2.2.0rc1

#19223 add mongo_db param to MongoSensor (#19276): @bhavaniravi

Provider pagerduty: 2.1.0rc1

Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763): @GuidoTournois

Make a separate hook for interacting with the Pagerduty Events API (#18784): @GuidoTournois

Provider salesforce: 3.3.0rc1

Add SalesforceApexRestOperator (#18819): @mariotaddeucci

Provider samba: 3.0.1rc1

Handle leading slash in samba path (#18847): @fredthomsen

Open src and dst in binary for samba copy (#18752): @fredthomsen

Provider sftp: 2.2.0rc1

SFTP hook to prefer the SSH paramiko key over the key file path (#18988): @30blay

Provider snowflake: 2.3.0rc1

Add test_connection method for Snowflake Hook (#19041): @msumit

Add region to Snowflake URI. (#18650): @dimberman

Provider ssh: 2.3.0rc1

Refactor SSHOperator so a subclass can run many commands (#10874) (#17378): @baolsen

update sshtunnel version (#18684): @eladkal

Correctly handle get_pty attribute if command passed as XComArg or template (#19323): @josh-fell

Provider tableau: 2.1.2rc1

Remove distutils usages for Python 3.10 (#19064): @uranusjr

Provider trino: 2.0.2rc1

Properly handle verify parameter in TrinoHook (#18791): @danarwix

Providers that do not need testing

Those are providers that were either doc-only or had changes that do not require testing.

Provider airbyte: 2.1.1rc1

Provider alibaba: 1.0.0rc1

Provider apache.drill: 1.0.1rc1

Provider apache.druid: 2.0.2rc1

Provider apache.kylin: 2.0.1rc1

Provider apache.pig: 2.0.1rc1

Provider apache.pinot: 2.0.1rc1

Provider apache.spark: 2.0.1rc1

Provider apache.sqoop: 2.0.2rc1

Provider celery: 2.1.0rc1

Provider cloudant: 2.0.1rc1

Provider datadog: 2.0.1rc1

Provider dingding: 2.0.1rc1

Provider discord: 2.0.1rc1

Provider ftp: 2.0.1rc1

Provider grpc: 2.0.1rc1

Provider http: 2.0.1rc1

Provider imap: 2.0.1rc1

Provider influxdb: 1.0.0rc1

Provider jira: 2.0.1rc1

Provider microsoft.mssql: 2.0.1rc1

Provider microsoft.winrm: 2.0.1rc1

Provider mysql: 2.1.1rc1

Provider odbc: 2.0.1rc1

Provider opsgenie: 2.0.1rc1

Provider oracle: 2.0.1rc1

Provider plexus: 2.0.1rc1

Provider presto: 2.0.1rc1

Provider qubole: 2.0.1rc1

Provider redis: 2.0.1rc1

Provider segment: 2.0.1rc1

Provider sendgrid: 2.0.1rc1

Provider singularity: 2.0.1rc1

Provider telegram: 2.0.1rc1

Provider vertica: 2.0.1rc1

Provider zendesk: 2.0.1rc1

Thanks to all who contributed to those provider's release

@sreenath-kamath @jarfgit @frankcash @deedmitrij @enima2684 @uranusjr @peter-volkov @mariotaddeucci @potatochip @malthe @msumit @dimberman @jameslamb @Brooke-white @GuidoTournois @minu7 @ashb @shadrus @ignaski @eladkal @ephraimbuddy @eskarimov @JavierLopezT @keze @josh-fell @raphaelauv @blag @Aakcht @guotongfei @SamWheating @danarwix

@subkanthi @alexbegg @bhavaniravi @tnyz @Goodkat @fredthomsen @SayTen @kaxil @lwyszomi @ReadytoRocc @baolsen @30blay @nathadfield @xuan616 @RyanSiu1995

Committer

I acknowledge that I am a maintainer/committer of the Apache Airflow project.