Build Your Own Cloud Management Platform 
Tags: aws, awsmanagement, cloudmanagement, cloudautomation
Published: 2019-04-22 06:42:49

---
title: Build Your Own Cloud Management Platform 
published: True
description: Ever thought of having an in-house enterprise-grade single cloud management platform that could help you manage and optimize all resources for cost, security, governance, etc. Plus, provide the flexibility to it according to your needs? Read this post.  
tags: AWS, AWS Management, Cloud Management, Cloud Automation
---

<span style="color: #000000;">The multi-cloud management has carved out a niche for itself in the ever growing</span> <a href="https://www.informationweek.com/cloud/cloud-computing-2019-the-cloud-comes-of-age/d/d-id/1333442">$200 billion</a> <span style="color: #000000;">worth cloud computing market. It is expected to grow up to </span><a href="https://www.marketsandmarkets.com/PressReleases/multi-cloud-management.asp">USD 4,492.7 Million by 2022</a>. <span style="color: #000000;">The numbers speak for themselves and shows how dependent we are on cloud management tools today.</span>
<h2><span style="color: #000000;"><b>The Cloud ROI Puzzle: </b></span></h2>
<span style="color: #000000;">As cloud users, we have been reliant on several siloed cloud management tools — one for cost optimization, another for security &amp; governance, yet another for operations and monitoring and so on &amp; so forth. </span>

<span style="color: #000000;">We use the data from these tools as building blocks on top of the cloud provider’s primary interface data to get the context of things and tackle the real-world cloud problems.</span>
<blockquote>
<h3><strong><span style="color: #000000;">So, we end up paying for several SaaS tools and analyzing data from multiple tools, in silos, bringing down the cloud ROI.</span></strong></h3>
</blockquote>
<img class="alignnone wp-image-1183" src="https://thepracticaldev.s3.amazonaws.com/i/79s2ywdzcz7dwl44hn7n.png" alt="AWS Bill Shock" width="504" height="252" />

<span style="color: #000000;">After talking to hundreds of cloud customers about their pain points, we realized that there were other factors too that brought down the ROI. </span>

<span style="color: #000000;">These cloud management tools offer a templatized set of solutions to cloud management problems. This gives businesses less leg room to maneuver and integrate their business needs. </span>
<blockquote>
<h3><strong><span style="color: #000000;">Result: You end up spending precious man hours in performing the same tasks, writing script after script, and performing repetitive organizational tasks.</span></strong></h3>
</blockquote>
<span style="color: #000000;">Take for example: periodically looking for publicly accessible S3 buckets among hundreds and thousands of them across an enterprise. This is not an easy task. With so many publicly accessible S3 buckets found everyday, like in the recent case where</span> <a href="https://www.bloomberg.com/news/articles/2019-04-03/millions-of-facebook-records-found-on-amazon-cloud-servers?utm_campaign=website&amp;utm_source=Last%20Week%20in%20AWS&amp;utm_medium=email">millions of Facebook records were found on a public bucket</a><span style="color: #000000;">, enterprises invest enormous amount of time and effort in keeping a check on each bucket’s policy while adhering to organizations business processes. This obviously contributes to bringing down the cloud ROI.</span>
<h3><span style="color: #000000;"><strong>As ardent cloud practitioners, we had to step up and join the missing pieces of this Cloud ROI puzzle. Here’s how we did it...</strong></span></h3>
<h2><span style="color: #000000;"><b>Unleashing the Power Within </b></span></h2>
<span style="color: #000000;">We started out our journey, here at TotalCloud, offering a gamified visual interface. This interface offers complete cloud visibility with layers of contextual data on a single pane.</span>

<span style="color: #000000;">One of the primary reasons why we could show the entire architecture with so many layers of contextual data, such as resource correlations and perspectives, on a single pane was because of our indigenous <b><i>Cloud Graph engine. </i></b>The engine has been running in the back end of our platform tightly integrated with a 3D visualization engine in the front end.</span>

<span style="color: #000000;">This Cloud Graph engine has been an integral part of our framework since inception of TotalCloud. It has been one of the driving forces of our mission to create an ‘Autonomous Cloud Engineer’ tool that can monitor and manage any type of cloud services and any number of cloud services on its own.</span>
<blockquote><span style="color: #000000;"><b>Today, we have opened up our powerful Cloud Graph engine to AWS cloud users in the form of a web console, where you can create smart workflows leveraging its power. You now have the flexibility to perform automation on any AWS resource aligning <span style="color: #000000;">to your business needs,</span> without depending on third-party solutions or AWS management console/CLI.  </b></span></blockquote>
<span style="color: #000000;">With this, you can AUTOMATICALLY:</span>
<ul>
 	<li><span style="color: #000000;">Define ‘ANY’ AWS cloud management requirement, be it for optimization, security, governance, reliability, etc. in a workflow</span></li>
 	<li><span style="color: #000000;">Fetch layers of contextual data from TotalCloud Cloud Graph engine specific to this requirement</span></li>
 	<li><span style="color: #000000;">Perform quick analysis with isometric visualizations topped with various perspectives</span></li>
 	<li><span style="color: #000000;">Take remediation action with right user approvals without using the AWS console or CLI</span></li>
 	<li><span style="color: #000000;">Communicate the end results to the stakeholder(s) via email or slack channel</span></li>
</ul>
<img class="alignnone size-medium wp-image-1184" src="http://blog.totalcloud.io/wp-content/uploads/2019/04/Unused-EBS-Abstract-300x169.gif" alt="TotalCloud Workflows on Deleting Unused EBS Volumes" width="300" height="169" />
<blockquote>
<h3><span style="color: #000000;"><b>Result: Access to a powerful and versatile tool that helps to execute cloud management tasks at an accelerated pace. </b></span></h3>
</blockquote>
<span style="color: #000000;">Simply put: without writing a single line of code, you can define and automate several cloud management tasks in line with your organizational needs. With this, you can save several man hours and hundreds of dollars spent on multiple cloud management tools, and eventually build your own cloud management platform.</span>
<h2><span style="color: #000000;"><b>Cloud Recipes: Building Your Own Cloud Management Platform One Workflow at a Time</b></span></h2>
<span style="color: #000000;">The all-new TotalCloud is not just a visualization interface anymore but a powerful tool that helps you create your own "Cloud Recipes." Each cloud recipe can have set logical actions acting in a workflow according to actions you would take intuitively for your cloud management tasks.</span>

<span style="color: #000000;">Take for instance, this machine learning architecture below:</span>

<img class="alignnone wp-image-1185" src="http://blog.totalcloud.io/wp-content/uploads/2019/04/machine-learning-telecom-architecture-overview-300x142.png" alt="" width="505" height="239" />

<span style="color: #000000;">Source:</span> <a href="https://docs.aws.amazon.com/solutions/latest/machine-learning-for-telecommunication/architecture.html">https://docs.aws.amazon.com/solutions/latest/machine-learning-for-telecommunication/architecture.html</a>

<span style="color: #000000;">To manage this architecture successfully for cost, security, and governance, you can create your own cloud recipes with the help of workflows, such as:</span>
<ul>
 	<li><span style="color: #000000;">Automatically perform actions to SageMaker notebook instances that are down, and inform your team without manually typing an email/slack message. For this use case, you can easily create a workflow to monitor SageMaker notebook instances when CloudWatch Alarm fires up, restart these affected notebook instances, and automatically push email notification to SysOps team to inform them.</span></li>
 	<li><span style="color: #000000;">Automatically ask for your manager’s approval and modify notebook instances to a larger profile as demand scales.  For this use case, you can easily create a workflow to trigger an SNS with CloudWatch when systems are running on full throttle, and further take user approval via email and upon approval scale up the system to a larger profile and get notified of the modifications.</span></li>
</ul>
<span style="color: #000000;">As you create each cloud recipe, you will become less dependent on other cloud management tools. Ultimately, you will have your own cloud management platform. As you set up workflows only once and let the machines do the tasks, the amount of time saved is innumerable.</span>

<span style="color: #000000;">To ensure safe access to all cloud resources and apt governance, each workflow gets its own customized policy via our Policy Management tool.</span>

<span style="color: #000000;">Further, you also get our inbuilt isometric visualizations and layers of perspective data like before in the web console itself for deep contextual analysis. This makes up for debugging and mapping tools you have been using!</span>
<h2><span style="color: #000000;"><b>Conclusion: Joining the Missing Pieces of Cloud ROI Puzzle with a Higher Order Language</b></span></h2>
<span style="color: #000000;">The higher-order language that we have brought in with our smart workflows, coupled with the ability to automate cloud management processes according to your business needs, completes the missing pieces of the cloud ROI puzzle.</span>
<blockquote><span style="color: #000000;"><a href="https://totalcloud.io/index.html#wf-form-Email-Form-Beta">Do give it a try, and sign-up to get access to our beta. </a>
</span></blockquote>
<span style="color: #000000;">To reduce the learning curve, we are offering</span> <a href="https://help.totalcloud.io/use-case-examples">workflow templates of common use cases</a> <span style="color: #000000;">to get you started quickly on TotalCloud. Do check them out.</span>

&nbsp;