Package: delpha-db-manager
DelphaDBManagementManagement API for Delpha to work around Data inside the Cassandra ClusterThis repository is python based yet, to be open to other languages (Java, JavaScript, ...)
Module to handle DB Managmenet on our Cassandra Cluster.Security ObjectivesNeed a really secure way to handle data :Private Keyswill be generated by Delpha only and will be stored inside an authentication table inside Cassandra. Users will need to match a given private key to access the DBMS. This key will be bound to the dedicated organisation, and only one Private Key will be tagged as Admin and unlock all the DBMS access.InstallationRequirementsPython: >3.8cassandra-driversimple-salesforcerequestsboto3Install DependenciesCommonpipinstall-rrequirements.txtSalesforce ManagerSalesforce Data Manager using Salesforce API.Parameter : instance_name: Salesforce Instance nameParameter : client_id: Consumer ID for authorized appParameter : client_secret: Consumer Secret for authorized appParameter : username: usernam to login to Instance of SalesforceParameter : param password: password to login to Instance of SalesforceParameter : param security_token: User's security tokensf_manager=SalesforceManager(instance_name,consumer_key,consumer_secret,salesforce_username,salesforce_pwd,personnal_token)sf_manager.help()res,size=sf_manager.query("SELECT Name from Contact")Cassandra ManagerCassandra Database manager :CassandraManager.Parameter : pem_file_path: String path of the .pem file to use for 2FA connectionParameter : config_file_path: String path of the .yalk file to use to get credentialsParameter : key_space: String session keyspace to set for the Clustercass_cluster=CassandraManager(key_file_path,pem_file_path,"delpha_actions")cass_cluster.execute("SELECT * FROM actions_conv_by_user").all()Dictionnary part of Cassandra Database manager :DictionaryManager.manager=DictionaryManager(cass_cluster)manager.list_tables['keyspace1', 'keyspace2', ...]AppFlow ManagerDelpha AWS data Handler (AppFlows) :AppFlowManager.Parameter : key: String AWS keyParameter : secret: String AWS secretParameter : flow_type: String Flow type to handle ['contact', 'account']Parameter : bucket_name: String to use specific bucketParameter : region: String AWS regionhandler=AppFlowManager(aws_key_id,aws_secret,bucket_name,'contact')#Setup contact Flow (contact dataset)df=handler.get_flow_parquet_data()flow_status,flow_last_execution_record=handler.start_flow(flow_name)#Start flow on AWS sidehandler.ensure_spark_format(flow_name)#Check if data is in right format (.parquet)handler.get_last_flow_id(flow_name)#Get last folder Name in bucket for specific flow.S3 ManagerDelpha AWS data Handler (AppFlows) :S3Manager.Parameter : key: String AWS keyParameter : secret: String AWS secretParameter : region: String AWS regionS3=S3Manager(aws_key_id,aws_secret,region)#Setup contact Flow (contact dataset)df=S3.bucketsflow_status,flow_last_execution_record=handler.start_flow(flow_name)#Start flow on AWS sidehandler.ensure_spark_format(flow_name)#Check if data is in right format (.parquet)handler.get_last_flow_id(flow_name)#Get last folder Name in bucket for specific flow.How to - Pip publish packagepythonsetup.pysdistbdist_wheel
twineuploaddist/*License