Package: ztech-pythena
pythenaThis is a simple python module that will allow you to query athena the same way the AWS Athena console would. It only requires a database name and query string.Installpipinstallztech-pythenaSetupBe sure to set up your AWS authentication credentials. You can do so by using the aws cli and runningpip install awscli
aws configureMore help on configuring the aws cli herehttps://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.htmlSimple Usageimportpythenaathena_client=pythena.Athena("mydatabase")# Returns results as a pandas dataframedf=athena_client.execute("select * from mytable")print(df.sample(n=2))# Prints 2 rows from your dataframeConnect to Databaseimportpythena# Connect to a databaseathena_client=pythena.Athena(database="mydatabase")# Connect to a database and override default aws region in your aws configurationathena_client=pythena.Athena(database="mydatabase",region='us-east-1')athena_client.execute()execute(
  query = 'SQL_QUERY',                 # Required
  s3_output_url='FULL_S3_PATH',        # Optional (Format example: 's3://mybucket/mydir'
  save_results=TRUE | FALSE            # Optional. Defaults to True only when 's3_output_url' is provided. If True, the s3 results will not be deleted and an tuple is returned with the execution_id.
  run_async=TRUE | FALSE               # Optional. If True, allows you to run the query asynchronously. Returns execution_id, use get_result(execution_id) to fetch it when finished
)Full Usage Examplesimportpythena# Prints out all databases listed in the glue catalogpythena.print_databases()pythena.print_databases(region='us-east-1')# Overrides default region# Gets all databases and returns as a listpythena.get_databases()pythena.get_databases(region='us-east-1')# Overrides default region# Connect to a databaseathena_client=pythena.Athena(database="mydatabase")# Prints out all tables in a databaseathena_client.print_tables()# Gets all tables in the database you are connected to and returns as a listathena_client.get_tables()# Execute a querydataframe=athena_client.execute(query="select * from my_table")# Results are  returned as a dataframe# Execute a query and save results to s3dataframe=athena_client.execute(query="select * from my_table",s3_output_url="s3://mybucket/mydir")# Results are  returned as a dataframe# Get Execution Id and save resultsdataframe,execution_id=athena_client.execute(query="select * from my_table",save_results=True)# Execute a query asynchronouslyexecution_id=athena_client.execute(query="select * from my_table",run_async=True)# Returns just the execution iddataframe=athena_client.get_result(execution_id)# Will report errors if query failed or let you know if it is still running# With asynchronous queries, can check status, get error, or cancelpythena.get_query_status(execution_id)pythena.get_query_error(execution_id)pythena.cancel_query(execution_id)NoteBy default, when executing athena queries, via boto3 or the AWS athena console, the results are saved in an s3 bucket. This module by default, assuming a successful execution, will delete the s3 result file to keep s3 clean. If an s3_output_url is provided, then the results will be saved to that location and will not be deleted.