The Cloud Waste Problem: How to Stop Overprovisioning Resources in 2022
Tags: cloud, devops, kubernetes, tutorial
Published: 2022-02-22 14:28:57

<!-- wp:paragraph -->
<p>With the public cloud adoption increasing year over year, companies will spend nearly $121.6 billion in IaaS (Infrastructure as a Service) in 2022 from AWS, Azure, Google, and other cloud service providers.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>To put that into context, that is the market capitalization of PayPal ($120.8 billion) or Boeing ($121.86 billion).&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>As teams lift and shift or develop new applications in the cloud, they rarely pay attention to costs. </strong>What they want is to sleep well at night - and if that takes overprovisioning, then so be it.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>But these teams are missing out on one decisive way to deliver a high level of performance and reduce costs at the same time: <strong>automated optimization</strong>.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Let’s take a closer look at how the tech industry approaches the cloud waste problem and what lessons we can all learn from that.</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="cloud-computing-growth-in-2022">Cloud computing growth in 2022</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>The more cloud resources you use, the more likely you will miss the mark when provisioning them. Things tend to get complicated once you start using multiple instance types across two or more cloud providers.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>And this issue is only going to become more critical because teams around the world are moving to the cloud or building more on it. <a href="https://www.gartner.com/en/newsroom/press-releases/2021-08-02-gartner-says-four-trends-are-shaping-the-future-of-public-cloud" target="_blank" rel="noreferrer noopener">Gartner</a> predicts that in 2022 public cloud services will grow by over <strong>23.9% as an entire market </strong>(this includes SaaS, IaaS, BPaaS, and other services).</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>SaaS makes up the most significant segment in public cloud spending</strong>, growing from $120.7 billion in 2020 to $171.9 billion in 2022 (42% growth over two years). IaaS makes up its fastest-growing segment - increasing from $64.2 billion in 2020 to $121.6 billion in 2022 (a smashing 189%!).<br></p>
<!-- /wp:paragraph -->

<!-- wp:image -->
<figure class="wp-block-image"><img src="https://lh6.googleusercontent.com/R55ynMLkjnWUfInmtQjv0jVzlmlsTon4O0CIhnyyu9y4QxfN22V8mE37T5jXvbKeLhHEDn2gbvHiJr3JGZsHcW7ngBLYCRsi0Hh_KRceo01J3jl2s1be_bf9UavfZrab9tawn49b" alt="public cloud spend"/></figure>
<!-- /wp:image -->

<!-- wp:paragraph -->
<p><strong>We estimate that two-thirds of enterprise IaaS costs derive from memory and compute. This means that in 2022, enterprises will spend roughly $81 billion on compute resources from the major cloud providers.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="the-volume-of-kubernetes-cloud-waste">The volume of Kubernetes cloud waste</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>After the donation of Kubernetes to the CNCF by Google, we saw a significant shift in the enterprise market to adopt this as the container technology of choice.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>We find that many companies rely on their cloud providers to manage their Kubernetes infrastructure, often using managed services such as Amazon EKS, Azure AKS, and Google GKE.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>The larger operators of K8s tend to host the service on their own - for instance, <a href="https://medium.com/paypal-tech/scaling-kubernetes-to-over-4k-nodes-and-200k-pods-29988fad6ed" target="_blank" rel="noreferrer noopener">PayPal</a>.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p><strong>Many customers who analyzed their utilization with our platform found that their Kubernetes infrastructure is overprovisioned by even 30%!</strong></p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>Why do so many teams leave cost optimization out of the equation before costs become too much of an issue?</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="optimizing-cloud-resources-for-kubernetes-is-no-small-feat">Optimizing cloud resources for Kubernetes is no small feat</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p><br>The top reason enterprises are late in their optimization efforts is that they have <a href="https://www.flexera.com/blog/cloud/cloud-computing-trends-2021-state-of-the-cloud-report/" target="_blank" rel="noreferrer noopener">too many manual processes</a>.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Many cost optimization challenges revolve around understanding where costs come from via accurate observability and reporting.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>For teams running Kubernetes, cloud costs often become a black box.&nbsp;</strong></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Facing so many different available OSS options to help manage their Kubernetes infrastructure, the process of bringing all the cost data together becomes tedious and time-consuming.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Another challenge arises because of how Kubernetes works. Since it’s a fair system, it provisions equally across all the clusters and the underlying virtual machines.</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p><strong>Companies that analyze their Kubernetes spend with CAST AI are overprovisioning applications by 30%.&nbsp;</strong></p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>Where does all of this overprovisioning come from?</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Here’s one good source: <a href="https://www.parkmycloud.com/blog/overprovisioning/" target="_blank" rel="noreferrer noopener">44% of cloud spend</a> covers non-production resources. Since they’re needed only during the 40-hour workweek, they’re often left idle for other 128 hrs (76%) during one week. Given that you pay for compute resources by the minute or second, a large portion of the time these resources are being paid for but not used.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>If we combine this finding with the cost of the public cloud, it means that in 2022, companies will waste $27.1 billion on idle cloud assets.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Another study showed that <a href="https://www.rightscale.com/blog/cloud-cost-analysis/where-10b-waste-public-cloud-costs" target="_blank" rel="noreferrer noopener"><strong>40% of instances</strong></a><strong> are at least one size larger than needed</strong>. You can slash the cost by 50% by reducing an instance by one size. Downsizing by two sizes saves 75%.</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p><strong>Considering the public cloud spend for 2022, we estimate that companies will waste $16.2 billion on overprovisioning.<br><br>If you add up idle resources and overprovisioning, that equals roughly $43.3 billion enterprises will throw away in IaaS cost in 2022!</strong></p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>This equates to the market capitalization of Chipotle ($42.7 billion), Sysco ($42.39 billion), or Hilton ($41.98 billion).</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="take-the-first-step-to-reducing-cloud-waste">Take the first step to reducing cloud waste</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Rightsizing cloud resources or scaling them down when not needed are two intelligent methods teams use to reduce their cloud bills.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>These approaches were historically time-consuming. They required team members to constantly watch their cloud infrastructure and analyze the massive provider offer to find virtual machines of the right size and type.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>Now teams can avoid this problem thanks to automation.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>A solution like CAST AI allows teams to focus on higher priorities, reclaim a healthy portion of the cloud bill, and return your most valuable asset: time!&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Start by finding out how much budget you could save with automated cloud capacity management.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>Give CAST AI a try by running a free savings report <a href="https://console.cast.ai/?screen_hint=SIGNUP" target="_blank" rel="noreferrer noopener">here</a>.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>Or take a look around the CAST AI platform by booking a demo.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:buttons -->
<div class="wp-block-buttons"><!-- wp:button -->
<div class="wp-block-button"><a class="wp-block-button__link" href="https://cast.ai/book-a-demo/" target="_blank" rel="noreferrer noopener">Explore CAST AI now</a></div>
<!-- /wp:button --></div>
<!-- /wp:buttons -->