Package: energyusage
energyusageA Python package that measures the environmental impact of computation. Provides a function to
evaluate the energy usage and related carbon emissions of another function.
Emissions are calculated based on the user's location via the GeoJS API and that location's
energy mix data (sources: US E.I.A and eGRID for the year 2016).InstallationTo install, simply$ pip install energyusage.UsageTo evaluate the emissions of a function, just callenergyusage.evaluatewith the function
name and the arguments it requires.importenergyusage# user function to be evaluateddefrecursive_fib(n):if(n<=2):return1else:returnrecursive_fib(n-1)+recursive_fib(n-2)energyusage.evaluate(recursive_fib,40,pdf=True)# returns 102,334,155It will return the value of your function, while also printing out the energy usage report on the command line.
Optional keyword arguments:pdf(default =False): generates a PDF report, alongside the command-line utilitypowerLoss(default =0.8): accounts for PSU loss, can be set by user if known for higher accuracy of resultsenergyOutput(default =False): prints amount of energy used by the process and time taken. The order is time, energy used, return of functionprintToScreen(default =True): controls whether there is a terminal printout of the package runningenergyOutput(default =False): determines whether the energy used and time taken are output. When set to true the order istime used,energy used,return value of function.locations(default =["Mongolia", "Iceland", "Switzerland"]): allows selecting the countries in the emissions comparison section for the terminal printout and pdf. These can be set to the name of any country or US state.year(default =2016): controls the year for the data. Default is2016as that is currently the most recent year of data from both of our sources. Note that only this year of data is included in the package installation but more can be added in a process described later.Energy ReportThe report that will be printed out will look like the one below. The second and third lines will show a real-time reading that disappears once the process has finished evaluating.Location:                                                           Pennsylvania
--------------------------------------------------------------------------------
-------------------------------  Final Readings  -------------------------------
--------------------------------------------------------------------------------
Average baseline wattage:                                             1.86 watts
Average total wattage:                                               19.42 watts
Average process wattage:                                             17.56 watts
Process duration:                                                        0:00:01
--------------------------------------------------------------------------------
-------------------------------   Energy Data    -------------------------------
--------------------------------------------------------------------------------
                           Energy mix in Pennsylvania                           
Coal:                                                                     25.42%
Oil:                                                                       0.17%
Natural Gas:                                                              31.64%
Low Carbon:                                                               42.52%
--------------------------------------------------------------------------------
-------------------------------    Emissions     -------------------------------
--------------------------------------------------------------------------------
Effective emission:                                              4.05e-06 kg CO2
Equivalent miles driven:                                          1.66e-12 miles
Equivalent minutes of 32-inch LCD TV watched:                   2.51e-03 minutes
Percentage of CO2 used in a US household/day:                          1.33e-12%
--------------------------------------------------------------------------------
------------------------- Assumed Carbon Equivalencies -------------------------
--------------------------------------------------------------------------------
Coal:                                                      995.725971 kg CO2/MWh
Petroleum:                                                816.6885263 kg CO2/MWh
Natural gas:                                              743.8415916 kg CO2/MWh
Low carbon:                                                         0 kg CO2/MWh
--------------------------------------------------------------------------------
-------------------------     Emissions Comparison     -------------------------
--------------------------------------------------------------------------------
                      Quantities below expressed in kg CO2                      
        US                      Europe                  Global minus US/Europe
Max:    Wyoming        9.59e-06 Kosovo         9.85e-06 Mongolia        9.64e-06
Median: Tennessee      4.70e-06 Ukraine        6.88e-06 Korea, South    7.87e-06
Min:    Vermont        2.69e-07 Iceland        1.77e-06 Bhutan          1.10e-06
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Process used:                                                       1.04e-05 kWhThe report is divided into several sections.Final Readings: Presents an average of:Average baseline wattage: your computer's average power usage minus the process, ran for 10 seconds before starting your processAverage total wattage: your computer's average power usage while the process runsAverage process usage: the difference between the baseline and total, highlighting the usage solely from the specific process you evaluatedProcess duration: how long your program ran forEnergy Data: The energy mix of the location.Emissions: The effective CO2emissions of running the program one time and some real-world equivalents to those emissions.Assumed Carbon Equivalencies: The formulas used to convert from kWh to CO2based on the energy mix of the location (for international locations, see below for more information).Emissions Comparison: What the emissions would be for the same energy used in a representative group of US states and countries. Note that if these locations are specified as described below these default values are not shown.Process used: The amount of energy running the program used in total.The PDF report contains the same sections, but does not include the process duration or the emissions comparison momentarily.MethodologyPower MeasurementCPUWe calculate CPU power usage via the RAPL (Running Average Power Limit) interfaces found on Intel processors. These are non-architectural model-specific registers that provide power-related information
about the CPU. They are used primarily for limiting power consumption, but the Energy Status
register (MSR_PKG_ENERGY_STATUS) allows for power measurement.The RAPL interface differentiates between several domains, based on the number of processors. For a single processor machine:PackagePower planes:CoreUncoreDRAMFor a machine with multiple processors:Package 0Package 1...Package nDRAMPresently, we use the Package domain (or a sum of all of the domains, for a multi-processor machine), which represents the complete processor package.As outlined byVince Weaver, there are multiple ways to access the RAPL interface data, namely:Using perf_event interfaceReading the underlying MSRReading the files under/sys/class/powercap/intel-rapl/We elected to use the final method because it is the only one that does not require sudo access.  We read theenergy_uj.txtfiles inside the package folder(s)intel-rapl:*. These files represent the energy used in microjoules, and they update roughly every millisecond. The value in the file increases to the point of overflow and then resets. We take 2 readings with a delay in-between, and then calculate the wattage based on the difference (energy) and the delay (time). To avoid errors due to the reset of the file, we discard negative values.For more information on the RAPL interface, consult theIntel® 64 and IA-32 Architectures Software Developer's Manual.GPUTo the package measurement we also add the power usage of the GPU for machines that have an Nvidia GPU that support the NVIDIA-smi program.The NVIDIA-smi is a command-line utility that allows for the querying of information about the GPU. If the GPU is identified as valid, we use the built-in method to query the current wattage, and then convert the output into a float.More  information on NVIDIA-smi can be found on theNvidia website.Calculating CO2EmissionsLocationIn order to accurately calculate the CO₂ emissions associated with the computational power used, we determine the geographical location of the user via their IP address with the help of theGeoJSAPI.  If the location cannot be determined, we use the United States as the default.Location is especially important as the emissions differ based on the country's (and, in the case of the United States, the state's) energy mix.Energy Mix InformationWe obtained international energy mix data from theU.S. Energy Information Administration datafor the year 2016. Specifically, we looked at the energy consumption of countries worldwide, broken down by energy source. For the data points labeled(s)(meaning that the value is too small for the number of decimal places shown), we approximated those amounts to 0. No data was available for, and thus we removed from consideration, the following: Former Czechoslovakia, Former Serbia and Montenegro, Former U.S.S.R., Former Yugoslavia, Hawaiian Trade Zone, East Germany and West Germany.Our United States energy mix and emissions data was obtained from theU.S. Environmental Protection Agency eGRID datafor the year 2016. We used theState Resource Mixsection for displaying the energy mix, and theState Output Emission Ratessection for calculating emissions in the United States. We did not use theotherFossildata as the values were predominantly 0 (and in cases in which the value was nonzero, it was below 1%).As of July 2019, the most recent eGRID data was from the year 2016. We elected to use 2016 U.S. E.I.A. data for consistency between the data sources.Conversion to CO2Since the international data only contained an energy mix, and no emission data, we reverse-engineered the formulas used in the eGRID data. This gives us additionally consistency between the separate datasets.Coal: 2195.20 lbs CO2/MWh = 995.725971 kg CO2/MWhPetroleum: lbs CO2/MWh = 816.6885263 kg CO2/MWhNatural gas: 1639.89 lbs CO2/MWh = 743.8415916 kg CO2/MWhUsing Different Years of DataIn case one wishes to compare energy usage between different years of data, we have included a script to allow for adding other years. If you navigate to the package directory and go into thedatafolder, you can useraw_to_json.py. First, you need to download the US and international data in the years of your choice from the links above and place them indata/raw/"year of the data"after creating the required year folder. Then, run the script with a flag for that year (for example,python raw_to_json.py -2016). This will allow selecting that year when using package in the future by using theyearoptional argument forevaluate.Related WorkIn their paperEnergy and Policy Considerations for Deep Learning in NLP, Strubell et. al not only analyze the computational power needed for training deep learning models in NLP, but further convert the data into carbon emissions and cost. Our tool aims to facilitate this analysis for developers in a single package. We do not consider cost, instead choosing to focus solely on the environmental impact. Further, we do not focus on a specific computational area. We also extend their analysis of carbon emissions by including international data on energy consumption and CO2emissions for localized analysis of the carbon footprint of the tested program.LimitationsDue to the methods in which the energy measurement is being done (through the Intel RAPL
interface and NVIDIA-smi), our package is only available on Linux kernels that have the
RAPL interface and/or machines with an Nvidia GPU.A country’s overall energy consumption mix is not necessarily representative of the mix of energy sources used to produce electricity (and even electricity production is not necessarily representative of electricity consumption due to imports/exports). However, the E.I.A. data is the most geographically comprehensive that we have found. We are working on obtaining even more accurate data.AcknowledgementsWe would like to thankJon Wilsonfor all his valuable insight with regards to the environmental aspect of our project.