Package: pysura
Pysura - BETAHasura + Python = Pysura. An open source solution.Because everyone should be a code wizard.Requirements:To deploy Hasura with Pysura with baked in Auth and a templated Flutter Frontend:Python 3.9+gcloud CLIgcloud beta CLIA billing account with Google CloudDocker (Make sure it’s running in the background or your deployment will fail!)Firebase CLInpmDartFlutterpip install pysura
pysura
(pysura_cli) >>> setup_pysuraNote: The installer is doing a lot of things. Some of them take a long time, like creating databases, firewalls, and VPC
networks. Sometimes it might look frozen, but give it some time to do its thing. It’s automagically building an entire
application for you. I promise doing this by hand takes longer. ;)Useful Pysura commands:deploy_frontend- Rebuild and Deploy the web frontend to firebase hosting for releasedeploy_microservice- Regenerate routers and re-deploy the default microserviceprint_pysura- Prints important pysura details like login credentials for the projectimport_hasura_metadata- Import the hasura metadata from Hasuraexport_hasura_metadata- Export the hasura metadata to Hasuragcloud_deploy_hasura- Deploy the hasura microservice to GCloudimport_existing_hasura- Clone an existing Hasura empty Hasura instance. Full clone, from metadata and pg_dump
including pulling ENUM values and cloning those.Is this multi-platform compatible?Mac - Yes, I developed it on a Mac!Linux - It should work on Linux, it is untested. Let me know!Windows - With minor updates it should work. I think the majority of the deployer works, but it might run into issues on
the Firebase and Flutterfire CLI’s.What is Pysura?Pysura is a CLI tool that’s designed to make building and deploying multi-tenant enterprise grade applications as easy
as a freshman year algorithms class. It’s a highly opinionated way because it’s the right way.It’s kind of like running npm init, if npm was for backends and frontends, it provides your backend, auth, and database
for you in the cloud in a way that is infinitely scalable and uses zero-trust, with a type-safe GraphQL backend and a
bring-your-own front-end approach with special built-in support for Flutter which is the default setup.Why Flutter?So that it doesn’t matter what you are building, you can build it on Pysura. It’s about damn time that Python developers
have better mobile support. Let’s bring python to mobile. Let’s bring python to the web. Let’s bring python to the edge.
Let’s bring python everywhere. And let’s skin it with Flutter and feed it all the data it wants with GraphQL and Hasura.Do I have to use Flutter for the frontend? No way! Pysura places firebase in front of your Hasura instance, so if your
frontend of choice supports Firebase Auth integrations or libraries, you can use it, or even better open a PR and add a
template for your provider. Youdoneed Flutter for installationWhat does the Pysura installer do?Authenticates you with gcloudCreates a new project in Google CloudSets up a VPC network inside the projectCreates a new Cloud SQL instance running Postgres 14Stores all Env variables in secret manager to be loaded from containersCreates a new Hasura instance in Cloud Run with scaling settings always allocating memory for at least 1 instanceAttaches Firebase to the projectDeploys firebase functions triggering on user.create/delete managing Hasura user data each with min instances set to 1Adds JWT authentication via Firebase to Hasura with phone sign inCreates a new Flutter app with Firebase Auth using flutterfireConfigures Android signing keys (COMING SOON: Auto app icon configuration)Configures iOS URL schemes (COMING SOON: Auto app icon configuration)Updates the default flutter template to use the Pysura template for FlutterDeploys the flutter template to Firebase hosting for the web. (COMING SOON: Auto app icon configuration)Deploys a default microservice on Cloud Run using Pysura! Includes default event that handles JWT claim changesYou will have this exact app after running the installer, it will work on iOS, Android, Web, Mac, and as a Chrome web
app. Untested on Linux/Windows native but it should work. ;)https://pysura-demo-2.web.app/What is a Pysura Microservice?It’s a wrapper around a FastAPI app that holds a collection of actions, events, and chron-jobs related to its function.
I.e. A payment microservice might have all code related to payment processing. It bakes in Auth with an extra decorator
which gives you easy access to the calling user each time a method is called. This works by using opaque tokens that
pass through the headers into the microservice. It’s a very simple way to do auth, and it’s very secure. It gives full
RBAC at a column level, and you can design rather complex auth rules using Hasura’s permission system. Each action,
event, and chron-job is placed in a separate file with routing already handled and the calling users information passed
in the calling context. It makes it very easy to build your business logic in a clean, consistent way that is easy to
test and maintain, and also easy to hand off to other developers.Pysura uses middleware to handle the auth, and provide you access to app resources like the database, and the caller. It
wraps FastAPI, and uses a router for each action, event, or chron-job. Separating the business logic into collections of
microservices each containing folders of actions, events, and chron-jobs each delegated to their own file which makes it
easy to scale and maintain.Front-end clients should utilize the Hasura GraphQL API to access and mutate the data in the database. This is the
recommended way to access the data. It is important to make sure you set up proper roles and permissions in Hasura to
ensure that only the correct users can access the data meant for them. By default, Pysura includes a user and admin roleActions are used to allow the front-end client a way to perform custom business logic, or do a task that requires
calling third party APIs or services. Actions are called via the Hasura GraphQL API, and are executed on the
microservice instance.Events are used to trigger custom business logic when something occurs in the database. For example, when a user is
created, you might want to send them a welcome email. Events are triggered by Hasura (via the Database), and are
executed on the microservice instance.Crons are used to trigger custom business logic on a schedule. For example, you might want to send a report to the admin
every day at 8am. Crons are triggered by Hasura (via the Database), and are executed on the microservice instance.By default, the application is configured with an event secret that must be passed to all microservices in the header
from Hasura. This ensures that all traffic is coming from Hasura, and not from a malicious source. This makes things
SUPER secure, with JWT auth, and event secrets. It’s a very secure way to build an application.The default microservice directory structure looks like this:microservices/defaultmicroservices/default/Dockerfilemicroservices/default/README.mdmicroservices/default/actionsmicroservices/default/actions/init.pymicroservices/default/actions/action_mutation_pong.pymicroservices/default/actions/action_query_ping.pymicroservices/default/actions/action_upload_file.pymicroservices/default/app.pymicroservices/default/app_secrets.pymicroservices/default/cronsmicroservices/default/crons/init.pymicroservices/default/crons/cron_update_app_message.pymicroservices/default/deploy.txtmicroservices/default/eventsmicroservices/default/events/init.pymicroservices/default/events/event_update_user_cascade.pymicroservices/default/events/event_update_user_role.pymicroservices/default/generated_types.pymicroservices/default/pysura_metadata.jsonmicroservices/default/requirements.txtHere, you can see app secrets are loaded from Secret manager in the app_secrets.py file:app_secrets.pyfromgoogle.cloudimportsecretmanagerPROJECT_ID="pysura-demo-2"defget_secret_by_id(secret_id,version_id="latest"):client=secretmanager.SecretManagerServiceClient()name=f"projects/{PROJECT_ID}/secrets/{secret_id}/versions/{version_id}"response=client.access_secret_version(name=name)returnresponse.payload.data.decode("UTF-8")print("LOADING SECRETS")HASURA_GRAPHQL_ADMIN_SECRET=get_secret_by_id("HASURA_GRAPHQL_ADMIN_SECRET")HASURA_GRAPHQL_URL_ROOT=get_secret_by_id("HASURA_GRAPHQL_URL_ROOT")HASURA_EVENT_SECRET=get_secret_by_id("HASURA_EVENT_SECRET")HASURA_FIREBASE_SERVICE_ACCOUNT=get_secret_by_id("HASURA_FIREBASE_SERVICE_ACCOUNT")HASURA_STORAGE_BUCKET=get_secret_by_id("HASURA_STORAGE_BUCKET")HASURA_GRAPHQL_DATABASE_URL=get_secret_by_id("HASURA_GRAPHQL_DATABASE_URL")In the app.py file, we inject the Pysura security middleware:@app.middleware("http")asyncdefinject_security(request:Request,call_next):returnawaitsecurity_injection_middleware(request,call_next)This is going to handle injecting the identity of the caller into the function directly from the JWT token.The composition of all events, actions, and crons is as follows:The PysuraSecurity callable class is used to inject the security middleware into the FastAPI app. It makes it easy to
specify whether or not the route requires JWT authentication, what level of JWT authentication is required, and if the
caller must send the backend event secret.The PysuraProvider callable class providers the calling function with access to any resources that it might need.This is what a full action looks like:# (IMPORTS-START) - DO NOT DELETE THIS LINE!importloggingfromfastapiimportAPIRouter,Depends,Requestfrompysura.faster_api.securityimportPysuraSecurity,PysuraProvider,Providerfrompysura.faster_api.enumsimportApiResponse,ClientRolefromgenerated_typesimport*# (IMPORTS-END) - DO NOT DELETE THIS LINE!ROUTE="/action_mutation_pong/"ALLOWED_ROLES=[# The roles allowed to call this actionClientRole.admin.name,ClientRole.user.name]action_mutation_pong_router=APIRouter(tags=["action_mutation_pong"])@action_mutation_pong_router.post(ROUTE,dependencies=[Depends(PysuraSecurity(require_jwt=True,require_event_secret=True,allowed_roles=ALLOWED_ROLES))],response_model=ActionMutationPongOutput)asyncdefaction_mutation_pong(_:Request,action_mutation_pong_input:ActionMutationPongInput|None=None,provider:Provider|None=Depends(PysuraProvider(# (DEPENDENCY-INJECTION-START) - DO NOT DELETE THIS LINE!provide_identity=True,provide_firebase=True,provide_graphql=True,provide_storage=True,provide_sql=True# (DEPENDENCY-INJECTION-END) - DO NOT DELETE THIS LINE!))):# (BUSINESS-LOGIC-START) - DO NOT DELETE THIS LINE!user_id=provider.user_identity.user_idprovider.graphql.execute(query="""mutation Pong($user_id: String = "", $message: String = "", $number: Int = 10) {
  update_public_user_by_pk(pk_columns: {user_id: $user_id}, _set: {message: $message, number: $number}) {
    user_id
  }
}""",variables={"user_id":user_id,"message":action_mutation_pong_input.message,"number":action_mutation_pong_input.number})response=ActionMutationPongOutput(data=ActionMutationPongOutputData(message=action_mutation_pong_input.message,number=action_mutation_pong_input.number),nodes=None,response_name=ApiResponse.SUCCESS.name,response_value=ApiResponse.SUCCESS.value).dict()returnresponse# (BUSINESS-LOGIC-END) - DO NOT DELETE THIS LINE!The provider is very powerful:classProvider(BaseModel):user_identity:UserIdentity|None=Nonefirebase_app:App|None=Nonegraphql:PysuraGraphql|None=Nonestorage:PysuraStorage|None=Nonesql:PysuraSQLClient|None=NoneclassConfig:arbitrary_types_allowed=Truejson_encoders={App:lambdav:vifvisNoneelsev.name,PysuraGraphql:lambdav:vifvisNoneelsev.name,PysuraStorage:lambdav:vifvisNoneelsev.name,PysuraSQLClient:lambdav:vifvisNoneelsev.name,}classUserIdentity(BaseModel):token:str|None=Nonerole:str|None=Noneuser_id:str|None=Noneallowed_roles:List[str]|None=Nonephone_number:str|None=Noneemail:str|None=Noneiss:str|None=Noneaud:str|None=Noneiat:int|None=Noneexp:int|None=Noneauth_time:int|None=Nonesub:str|None=NoneclassPysuraGraphql(GraphqlClient):def__init__(self):self.name="graphql_client"super().__init__(endpoint=HASURA_GRAPHQL_URL_ROOT)defexecute(self):"""Executes a query as Admin"""passdefexecute_as_user(self):"""Executes a query as the caller passing the JWT token"""passasyncdefexecute_async(self):"""Executes a query as Admin asynchronously"""passasyncdefexecute_async_as_user(self):"""Executes a query as the caller passing the JWT token asynchronously"""passclassPysuraStorage(google_storage.Client):def__init__(self,*args,**kwargs):super().__init__(*args,**kwargs,project=cred_dict['project_id'],credentials=creds)self.name="storage_client"self.default_bucket=HASURA_STORAGE_BUCKETdefupload_file(self,file_data:bytes|str,file_name:str,file_type:str,user_id:str):passclassPysuraSQLClient:defget_conn(self):passdefget_engine(self):passdefget_db(self):passdefrefresh_engine(self):passdefset_connection_url(self,connection_url:str):passEx.frompysura.faster_api.securityimportProviderkwargs={}p=Provider(**kwargs)print(p.user_identity.user_id)response=p.graphql.execute(query="""query SomeGraphql { some_graphql }""",variables={})print(response["data"]["some_graphql"])fromfirebase_adminimportauthuser=auth.get_user(p.user_identity.user_id,app=p.firebase_app)print(user)response=p.storage.upload_file(file_data="b64_string",file_name="img2.png",file_type="image/png",user_id=p.user_identity.user_id)print(response["signed_url"])print(response["user_id"])Do I need to deploy Hasura with Pysura to use it?As of right now yes. In the future, no!Is this just a wrapper for the Hasura CLI?Pysura doesnotuse the Hasura CLI, and instead manages the metadata directly via retrieving it and overwriting it.It’s important to note that Pysura will add the local machine of its installer’s IP to the allow-list for the database.
This is to allow pysura to connect via pscopg2 for things like table management. You’ll need to de-authorize the network
if you want to remove the machine from the allow-list once setup is complete. TODO: Make a deauthorize command.Limitations:Currently, this only supports a Google-based deployment/stack. Easily fixable. Just need a fellow AWS/Azure/Etc. wizard
who can translate the gcloud commands. I think the portability is pretty high since everything is done from the CLI. The
setup wizard is just curling everything.Neat! But it doesn’t support my cloud provider, when will you be adding AWS/Azure/Etc. support?I won’t. You can. I built this because I needed it. If our stack changes providers, or potentially if someone was
willing to pay for it, I’d be willing to add support for other providers. But as of now, the best bet would be to open a
PR and add support for your provider of choice. I tried to design it to be pretty modular. The gcloud –format=json flag
is what changed the game when I found it. Maybe try ChatGPT to translate the gcloud commands to AWS/Azure/Etc. commands.FAQ:Q: I broke the installer, something wasn’t enabled properly. (I didn’t have docker running, didn’t have gcloud
installed, etc.)A: Best bet is to try to rerun the installer, it might throw some errors but it should recover for the most part. If it
doesn’t, then you should trash the project and rerun the setup. Just remember to go to billing and disable the old
project, and shut it down.Q: How do I contribute?A: Read over the current code, and see if you can make it better. If you can, open a PR. If you can’t, open an issue or
a feature request for something that would make it better.Q: Is this affiliated with Hasura, Google, or Firebase?A: No, this has no affiliation with Hasura, Google, or Firebase. In no way should this be considered an official product
of any of these companies. Although this makes heavy use of tools and API’s provided it is in no way an official product
of any company or tool used.Q: I’m not sure what to enter for one of the command line prompts, what should I do?A: If you aren’t sure what to enter, most of the time the provided example should work.Q: One of the choices in the list of options for a prompt doesn’t make sense, or there is something missing!A: Please open an issue or a feature request. I’m sure I missed some things. Stitching this together required a bit of
everything, including working outside my area of expertise.TODOS:Remove pyscopg2 dependency to drop postgres reqDONE:[x] Add support for Google Cloud[x] Add support for Firebase Auth[x] Add ios/android wizard[x] Add support for Flutter[x] Hasura Autodeployer[x] Add action wizard[x] Add event wizard[x] Add cron wizard[x] Web deployer for production by default[x] Hasura cloneHIGH PRIORITY:[ ] Add table manager @Tristen[ ] Add support for other auth providers (Auth0, etc) @Unclaimed[ ] Auth0[ ] ???[ ] Caching Wizard @Tristen[ ] Built in API Version Control @TristenLOW PRIORITY:[ ] Add support for AWS/Azure/Etc.[ ] Add support for other databases (Postgres, MySQL, BigQuery, etc)[ ] Add support for other frontends (React, Vue, etc)[ ] Rewrite the CLI tool in a more modular way, with command plug-ins.[ ] It should be possible to introspect the entirety of the gcloud CLI by parsing the output ofgcloud help. And
walking the CLI tool This would allow for a more dynamic CLI tool that could be used for other projects.