Package: jarvis-sdk
Jarvis SDK by Fashiondata.ioChangelogRelease 1.1.9 : 2021-02-17Bugfix : added some extra checking for one-task TTT with dependencies specified.Release 1.1.8 : 2021-02-16Added --context flag to specify which context to use.Added --no-launch flag to skip the DAG launch question asked to the user.Release 1.1.7 : 2021-02-03All configuration types : the flag direct_execution is added and to true automatically if not present.All configuration type : added context management.TTT : added enhanced SQL parameters management.TTT : added GBQ Script support.TTT : added "use_query_cache" flag for "sql" task type.TTT : added "temporary_table" flag for "sql" task type.TTT : added enhanced information context for "sql" task type.Global : bugfixRelease 1.1.6 : 2020-11-24TTT : fixed an issue linked to partitioned table creation for direct execution mode.TTT : fixed "--sql-execution-date" parameter usage.Minor fixesRelease 1.1.5 : 2020-11-04TTT : the DAG can be deployed in direct execution mode.TTT : the user is asked if he wants to execute teh DAG upon successful upload.TTT : the user is not asked for the project profile. The configuration attribute "default_gcp_project_id" is used automatically.Updated "setup.py"Added file encoding verification upon reading. Everything will be converted to UTF-8Added specific Google Drive scope to generated DAG to allow Google Sheet as GBQ sourceWhen a "workflow" type configuration is uploaded, the latest workflow status (if it exists) is deleted.The used is asked if he wants to deploy associated cloud functions upon STS and STT deployment.STT : DDL infos can be processed using different methodsRelease 1.1.4 : 2020-07-03Added Notification upon Jarvis SDK new release on PyPiTTT : added "client_type" and "client_version" to the stored configurationRelease 1.1.3 : 2020-06-18TTT : fixed another regression on function call.Release 1.1.2 : 2020-06-18TTT : fixed a regression impacting SQL type tasks.Release 1.1.1 : 2020-05-18Added support for ZSH under Max OS XTTT : Added task statusTTT : added special check for tasks declared in "task_dependencies" but not in "workflow"TTT : check if task IDs are named properlyTTT : You can run tasks locally with : jarvis configuration run YOUR-CONF.json [task1 task2 .... taskN]Project Profiles list is now sortedRelease 1.1.0 : 2020-02-19Added TTT DAG file checking upon deployment. The user must validate if he wants to overwrite TTT DAG.Removed Project selection validation.Release 1.0.1 : 2020-02-10Fixed seek() error on file readRelease 0.0.16 : 2020-01-10Removed ASCII artStorage-to-tables : check for JSON syntax for DDL files as wellRelease 0.0.15 : 2019-xx-xxTable-To-Table : GBQ table schema will be preserved upon WRITE_TRUNCATEMinor fixesRelease 0.0.14 : 2019-11-26Table-To-Table : added nested RECORD fields support for Bigquery table creation.Release 0.0.13 : 2019-11-15Storage-To-Tables : "jarvis create configuration" supportRelease 0.0.12 : 2019-11-04Added Storage-To-Tables configuration support.Table To Table (gbq to gbq) : "create_gbq_table" tasks will now use an external DDL file to describe the table schema.Release 0.0.11 : 2019-10-23Table To Table (gbq to gbq) configuration will now use "configuration_type" and "configuration_id".Table To Table (gbq to gbq) configuration DOES NOT need "dag_name" parameter anymore.Storage To Storage configuration accepts "gcp_project_id" in the "source" section if the "source_type" is "gcs".Release 0.0.10 : 2019-09-20Added auto creation of ".bash_profile" for Max OS XAdded password double check upon user creationAdded SQL file path management for "table-to-storage" deploy commandAdded : jarvis create configuration CONFIGURATION_TYPE commandAdded : jarvis check configuration CONFIG.json commandAdded : project profiles management