Environmental Impact of the Cloud: 5 Data-Based Insights and One Good Fix
Tags: cloud, kubernetes, devops, insights
Published: 2022-02-18 14:40:19

<!-- wp:paragraph -->
<p>Does using the cloud make your business sustainable? Research suggests that it’s a greener choice.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>By moving to the cloud, the e-commerce giant Etsy slashed its energy consumption by 13% (from <a href="https://d18rn0p25nwr6d.cloudfront.net/CIK-0001370637/b623b087-72ec-433b-85e6-0c82301d1f80.pdf" target="_blank" rel="noreferrer noopener">7330 Mwh in 2018</a> to <a href="https://d18rn0p25nwr6d.cloudfront.net/CIK-0001370637/d63aa848-ac0c-474c-9350-5b18888e84bf.pdf" target="_blank" rel="noreferrer noopener">6376 MWh in 2019</a>), saving enough energy to power 450 households for a month.(1)</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>But <strong>migrating to the cloud doesn’t guarantee anything if you neglect to optimize </strong>your resource utilization over the long term.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph {"fontSize":"caption"} -->
<p class="has-caption-font-size">(1) &nbsp;A megawatt-hour (Mwh) is equal to 1000 Kilowatt-hours (Kwh) - 1,000 kilowatts of electricity used continuously for one hour. This is about equivalent to the amount of electricity used by about 330 homes during one hour (<a href="https://www.sasustainability.com/category/energy-and-buildings#:~:text=A%20megawatt%20hour%20(MWh)%20is,330%20homes%20during%20one%20hour." target="_blank" rel="noreferrer noopener">source</a>).&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="how-much-energy-does-cloud-computing-consume">How much energy does cloud computing consume?</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Back in 2012, you’d only find some 500k data centers scattered around the world to support the global internet traffic of the post-PC era. Fast forward to today and you’re looking at <a href="https://www.datacenterknowledge.com/industry-perspectives/data-center-dilemma-our-data-destroying-environment" target="_blank" rel="noreferrer noopener">8 million data centers</a> in operation.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>All of this infrastructure comes with increasing energy demand. If we fail to optimize it, data centers will end up using over <a href="https://www.datacenterknowledge.com/industry-perspectives/data-center-dilemma-our-data-destroying-environment" target="_blank" rel="noreferrer noopener">10% of the global electricity supply</a> by 2030.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>There’s no need to jump into the future to see how energy-consuming data centers are.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Just to give you an idea about how fast the data center landscape has been growing:</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Between 2010 and 2018, the amount of data passing through the internet <a href="https://datacenters.lbl.gov/sites/default/files/Masanet_et_al_Science_2020.full_.pdf" target="_blank" rel="noreferrer noopener">increased more than 10x</a>, while global data center storage capacity increased 25x and the number of compute instances running on the world’s servers increased more than 6x.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Now add to this compute-intensive AI applications or IoT devices sending and receiving real-time data and you got yourself into a (cloud waste) fix.</p>
<!-- /wp:paragraph -->

<!-- wp:heading {"level":3} -->
<h3 id="how-does-all-this-translate-into-energy-consumption">How does all this translate into energy consumption?</h3>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Let’s take a step back to 2015 (the year when Volkswagen got caught using software to trick emissions tests and Instagram became bigger than Twitter).&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>That year, global data centers consumed <a href="https://www.eceee.org/all-news/news/news-2016/2016-01-23/" target="_blank" rel="noreferrer noopener">416.2 TWh</a> of electricity - more than the energy consumption of the entire UK!</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>No matter the hardware and software innovations, this number will likely double every 4 years. This level of data center growth isn’t sustainable beyond <a href="https://datacentrereview.com/2018/08/do-we-need-to-curb-our-internet-use-in-the-name-of-sustainability/" target="_blank" rel="noreferrer noopener">the next 10-15 years</a>, according to Ian Bitterlin, a renowned data center expert.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>What exactly does he mean by “not sustainable”?&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>For instance, that Japan’s data centers will require more power than the country’s entire electricity generation capacity by <a href="https://www.versobooks.com/books/3002-new-dark-age" target="_blank" rel="noreferrer noopener">2030</a>.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><a href="https://www.bloomberg.com/news/articles/2021-09-27/china-s-electricity-shock-is-latest-supply-chain-threat-to-world">China</a> is already seeing production lines stopping periodically due to energy shortages. This is just an example of what could happen to the digital world if we fail to address this problem soon.</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="how-to-make-the-cloud-sustainable-again">How to make the cloud sustainable again</h2>
<!-- /wp:heading -->

<!-- wp:image {"id":6865,"sizeSlug":"full","linkDestination":"media"} -->
<figure class="wp-block-image size-full"><a href="https://cast.ai/wp-content/uploads/2022/02/DES-107-The-Hidden-Shortcut-to-Increased-Margins-in-Fintech-Cloud-Automation-Infographic.png"><img src="https://cast.ai/wp-content/uploads/2022/02/DES-107-The-Hidden-Shortcut-to-Increased-Margins-in-Fintech-Cloud-Automation-Infographic.png" alt="cloud waste" class="wp-image-6865"/></a></figure>
<!-- /wp:image -->

<!-- wp:paragraph -->
<p>Getting cloud resources like compute, memory or storage is easy. Making good use of them? Not so much.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Organizations struggle to fully utilize the resources they purchase, <a href="https://www.flexera.com/blog/cloud/cloud-computing-trends-2021-state-of-the-cloud-report/" target="_blank" rel="noreferrer noopener">wasting even 30%</a> of their cloud spend.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Servers tend to be only <a href="https://new.abb.com/news/detail/66580/how-data-centers-can-minimize-their-energy-use" target="_blank" rel="noreferrer noopener">5-15% utilized</a>, processors 10-20%, and storage devices 20-40%.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Now you see why optimizing utilization has so much potential here.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>But that’s not everything.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>A lot of servers around the world don’t have any jobs to run.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Even if left idle, the equipment still consumes power. A typical server consumes <a href="https://new.abb.com/news/detail/66580/how-data-centers-can-minimize-their-energy-use" target="_blank" rel="noreferrer noopener">30-40% of its maximum power</a> even when it's not doing any work.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>This applies to virtual servers as well. A team at Teads Engineering confirmed this in their <a href="https://www.computerworld.com/article/3196355/a-third-of-virtual-servers-are-zombies.html" target="_blank" rel="noreferrer noopener">study of AWS instances</a> where their c5.metal consumed 187 watts per hour when it didn’t have any workloads assigned to it.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Now let’s see how this works from the global perspective.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>At least <a href="https://www.computerworld.com/article/3196355/a-third-of-virtual-servers-are-zombies.html" target="_blank" rel="noreferrer noopener">25% of all physical servers</a> - and 30% of all virtual servers - are in a comatose state (meaning that they had no activity within the last six months). This implies that we might have some 10 million zombie servers sitting idly around the world.</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p>The average cost of running a server is $3,000. Multiply that by 10 million and you’ll see that we’re losing <a href="https://www.computerworld.com/article/3196355/a-third-of-virtual-servers-are-zombies.html" target="_blank" rel="noreferrer noopener">$30 billion</a> in data center capital (this doesn’t count in the infrastructure capital and operating costs).</p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>Optimizing the current use of existing cloud resources is how you avoid China’s fate and deliver the best performance using the resources you already have.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Optimization starts with knowing how much damage to the environment you can eliminate by utilizing servers better. That often depends on your cloud provider.</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="not-all-cloud-providers-use-renewable-energy">Not all cloud providers use renewable energy</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>If you’re on AWS, the inefficiencies in resource use might directly translate into burning coal.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>AWS is the only one among the three major public cloud companies that doesn’t publish its power consumption data. The company <a href="https://www.forbes.com/sites/robertbryce/2021/02/03/amazon-is-reporting-record-smashing-revenue-and-profits-why-wont-it-disclose-how-much-energy-it-is-using/?sh=5c12ded4fd0a" target="_blank" rel="noreferrer noopener">is reported</a> to be “on a path” to powering its operations with renewable energy by 2025 and becoming net-zero carbon by 2040.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Meanwhile, Google is carbon-neutral and <a href="https://www.google.com/about/datacenters/efficiency/" target="_blank" rel="noreferrer noopener">reports</a> on its data center efficiency in detail.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Microsofts Azure cloud has been <a href="https://www.datacenterknowledge.com/microsoft/how-microsoft-keeping-its-cloud-more-efficient-your-data-center" target="_blank" rel="noreferrer noopener">carbon-neutral since 2012</a>, using wind, solar, and hydro-electric energy sources. It also offers <a href="https://appsource.microsoft.com/en-us/product/power-bi/coi-sustainability.emissions_impact_dashboard" target="_blank" rel="noreferrer noopener">Emissions Impact Dashboard</a> that provides carbon emissions data associated with Azure services.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Most large companies now have public climate strategies, but <a href="https://newclimate.org/2022/02/07/corporate-climate-responsibility-monitor-2022/" target="_blank" rel="noreferrer noopener">identifying genuine climate leaders</a> is challenging because of the lack of regulatory oversight at a national and sectoral level.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>Still, picking the cloud provider could become the first step to making your cloud setup more sustainable.</strong></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Where do you go next in your optimization effort?&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:heading -->
<h2 id="optimizing-compute-makes-the-biggest-impact">Optimizing compute makes the biggest impact</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Which cloud service consumes the most energy? Research clearly points to compute.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>The CPU uses <a href="https://www.missioncriticalmagazine.com/ext/resources/MC/Home/Files/PDFs/WP_LinkedIN%20DataCenterEnergy.pdf" target="_blank" rel="noreferrer noopener">more than 50%</a> of the power required to run a server. Another <a href="https://hal-univ-pau.archives-ouvertes.fr/hal-02437210/document" target="_blank" rel="noreferrer noopener">study</a> pointed to CPU and memory as the two largest power consumers in modern data center servers (without GPU).&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>So, we can safely assume that compute (CPU + memory) easily makes up for over 50% of the power used by the server behind your virtual machine.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Addressing underutilized compute practically guarantees a quick win.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Companies may try these 3 typical methods for solving utilization issues:</p>
<!-- /wp:paragraph -->

<!-- wp:list -->
<ul><li><strong>Accurate virtual machine selection and rightsizing</strong> - teams first estimate their workloads’ demands and based on their capacity planning find the best instance types and sizes to accommodate these needs. The idea here is to get just enough capacity to ensure good performance without overprovisioning (this often happens when teams choose an instance type based on their assumption of peak load).</li><li><strong>Autoscaling cloud instances</strong> - workload demands might change in line with seasonal patterns. To make sure their applications have a place to run, teams use autoscaling methods that expand capacity when needed and shrink it when there’s no work to be done. There’s no reason to keep machines running at 100% capacity when all your clients are fast asleep.</li><li><strong>Removing idle instances</strong> - whether it’s a shadow IT project or a testing instance left running, leaving an unused virtual machine on is like setting an office’s AC to pleasant cool over a holiday weekend. Pure waste. Teams should do their best to remove these resources as soon as possible.&nbsp;</li></ul>
<!-- /wp:list -->

<!-- wp:paragraph -->
<p>Unfortunately, the above is easier said than done.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>To do it manually, a team of engineers needs to oversee your cloud resources 24/7 to instantly identify changes in workload demands and adjust capacity in real time. This needs to be done for every single workload running on the public cloud!</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>AWS offers <a href="https://cast.ai/blog/400-ec2-instance-types-the-good-the-bad-and-the-ugly/" target="_blank" rel="noreferrer noopener">400 different EC2 instances</a> and millions of configurations options, so picking the best virtual machine for the job is next to impossible.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>And let’s not forget about the team.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Considering skill shortages on the market, filling such roles and retaining people on board is bound to be challenging. Engineers like to do more interesting things than do mind-numbing optimization tasks.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>We are sure that teams using automation can improve their utilization significantly.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Based on the Kubernetes clusters running in our platform,<strong> at least 30% of compute resources are wasted </strong>and could be reduced to make the setup more sustainable and cost-efficient.</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p>By how much? Our latest data sample shows a drop from 256,445 CPU cores before optimization to 182,141 after optimization (29% reduction).</p><p>How does this translate into costs? The optimization resulted in $1,416,455 of savings per month.&nbsp;</p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>This increased efficiency would help us all to drastically reduce the carbon footprint of cloud infrastructures, at the same time slashing costs by eliminating resources we don’t need.</p>
<!-- /wp:paragraph -->

<!-- wp:image {"id":6866,"sizeSlug":"full","linkDestination":"media"} -->
<figure class="wp-block-image size-full"><a href="https://cast.ai/wp-content/uploads/2022/02/DES-107-The-Hidden-Shortcut-to-Increased-Margins-in-Fintech-Cloud-Automation-Image.png"><img src="https://cast.ai/wp-content/uploads/2022/02/DES-107-The-Hidden-Shortcut-to-Increased-Margins-in-Fintech-Cloud-Automation-Image.png" alt="cloud waste" class="wp-image-6866"/></a></figure>
<!-- /wp:image -->

<!-- wp:heading -->
<h2 id="what-does-this-mean-for-your-company">What does this mean for your company?</h2>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Taking a look at cloud commitments of real companies can reveal a lot:&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>As of January 31, 2020, <strong>Asana</strong> had committed <a href="https://www.sec.gov/Archives/edgar/data/1477720/000119312520228462/d855753ds1.htm#toc" target="_blank" rel="noreferrer noopener">$9.2 million</a> in a contract with AWS. Assuming that the 30% of industry standard holds true and Asana doesn’t do any optimization, it’s likely that the company will burn $2.76 million on the cloud.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>There's no easy way out once you've committed to a certain spend, but once the end of the term approaches, it's in your best interest to look for alternatives like automated optimization.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>The numbers are even more dramatic for <strong>Lyft</strong>. In January 2019, Lyft signed a commercial agreement with AWS, committing to spend at least <a href="https://www.sec.gov/Archives/edgar/data/1759509/000119312519059849/d633517ds1.htm" target="_blank" rel="noreferrer noopener">$300 million</a> until December 2021 on the cloud. Without optimization, Lyft could have lost $90 million on cloud waste over these three years.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>The same goes for <strong>Slack</strong>. Slack’s contract with AWS spans from 2018 through 2023, with a total minimum commitment of <a href="https://www.sec.gov/Archives/edgar/data/1764925/000162828019004786/slacks-1.htm" target="_blank" rel="noreferrer noopener">$250 million</a>. If Slack fails to optimize its cloud resource use, it stands to lose $75 million during this 5-year period.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:quote {"className":"is-style-plain"} -->
<blockquote class="wp-block-quote is-style-plain"><p>Are you ready to see what your cloud bill could be?</p></blockquote>
<!-- /wp:quote -->

<!-- wp:paragraph -->
<p>Run a free savings report with CAST AI to find out. You're going to be surprised.</p>
<!-- /wp:paragraph -->

<!-- wp:buttons {"layout":{"type":"flex","justifyContent":"center"}} -->
<div class="wp-block-buttons"><!-- wp:button -->
<div class="wp-block-button"><a class="wp-block-button__link" href="https://cast.ai/get-started/" target="_blank" rel="noreferrer noopener">Run my report</a></div>
<!-- /wp:button --></div>
<!-- /wp:buttons -->