Monitoring Green Power andDistributed Edge Computing Infrastructurewith Zabbix
2023/10/6
Hiroshi Abe, Ph. D.,Group Manager@E2E Computing Group,
Toyota Motor Corporation, Japan
1Introduction2

Self-introductionn

Who am I?
p

Hiroshi ABE
ln

Affiliationp

Toyota Motor Corporationln

Ph.D.(Information Science)Group Manager,
E2E computing group,
Information and Communication Planning Div,
Information System Group

Research area
ppp

Monitoring mechanisms in large-scale networks
Distributed processing using edge computing
Data processing efficiency
3

Research targets①Cognitive radio

Multimedia communication
Multiple radio

Load balancing②JIT edge offloading

Request routing
JIT/Optimal arrangement

Wide area data synchronization
Datahub between Data Centers③④E2E monitoring/security/resilience

E2E monitoring, security, MLOps
Distributed monitoring

Security honeypot

Passive E2E measurement⑤CarbonneutralData center4Research targets①Cognitive radio

Load balancing

Multimedia communication②JIT edge offloading

Request routing

Multiple radio

JIT/Optimal arrangement

Todayʼs Topic③④E2E monitoring/security/resilience

Wide area data synchronization
Datahub between Data Centers

E2E monitoring, security, MLOps
Distributed monitoringSecurity honeypot

Passive E2E measurement⑤CarbonneutralData center5Mobility

6What customers and society want from automobiles

Electrification

A Better
car＝Connected Intelligence

Creation of a
new mobilitysociety
7

Data collected from cars is increasing
EB

Changes in the total
Number of connected cars

Transition of data transfer
amount per unit

Connected car total datatransfer volume

If the amount of transfer
and processing increases
use a lot of electricity

Navi probe data

Vehicle condition
dataHigh definition
Map generation

Sensing data10

Green Digital Computing11

Japanese Ministry of Economy, Trade and Industry
Main challenge: Green Digital Computing(image)
Reduction of power consumption
through network load reduction

Energy efficiency of data centers(cloud data centers + edge servers)
datavoluPowermConsumption e

Data volumea

2020 Increase in data
volume by DX

2030

datavolume2030(Smart Edge)

2030(goal)

https://www.meti.go.jp/policy/mono_info_service/joho/conference/semicon_digital/0002/03.pdf

12

Priority Power Supply RulesnSurplus green energy can be discarded
Image of Electricity demand

The electricity here
can be discarded

Controlled because solar
generates more power
than demand and there isa surplus of electricity

Power Generation Output

Black line is thedemandfor electricity

Control ofthermal power
generation

Solar powergeneration
Firing up thermal
power generation

Firing up thermal
power generation

Thermal power(oil, gas, coal)
Baseload power(Nuclear, Hydropower)

Morning

Noon

Evening

https://www.enecho.meti.go.jp/category/saving_and_new/saiene/grid/08_syuturyokuseigyo.html

13Local data production/consumption by green powernnWill the use of the edge and local production andconsumption of data accelerate?
Edge advantages in local production and consumption of data
ppn

Viewpoint of green power usageppnn

Faster response time
No need to transport data to the cloud (less power consumption)
Adjusting processing with the power output of green energy sources
Distribute processing across a wide area according to the power output

Necessity of improving edge utilization efficiency
Necessity for distributed monitoring of systems and power
15

Wide area data synchronization16

Electricity and data transmissionnIt's probably easier to send data than to send electricitypSurplus of renewable energy generated in the spring and autumn
in north and south of Japanp

Enhancing the transmission grid is essential to transport
surplus electricity = transfer const is very highMove computational demand instead of electrical powerp

https://www.nic.ad.jp/sc-sapporo/program/c14.pdf

17

Experiment to synchronize data over a wide areanMirror Maker2 by Apache Kafkap

Wide-area data synchronization between Tokyo and Hokkaido

OpenShift Cluster(Tokyo)

OpenShift Cluster(Hokkaido)

Kafka Cluster(Strimzi)

Kafka Cluster(Strimzi)

Kafka Container

Kafka Container

Kafka Container

Mirror Maker2
Bidirectional
Synchronization of topics

Kafka Container

Consumer

Consumer
Consumers

Hokkaido

RTT=15-20ms

Kafka Container

820km
Tokyo

Kafka Container

Consumer

Producer

Producer
Producers

Producer
19

Consume time - Produce time = processing timenProcessing within the same Data center
Processing finishes
within 300 ms
even with large datanwide-area data synchronization (Hokkaido -> Tokyo)p

Add extra data synchronization time
more than thesynchronization time
is being added.
Especially the syncof 1MB data takes time20ConsiderationnSynchronization of data seems to be manageablepnn

Next is the timing of data production and processing
If real-time performance is requiredpnwide-area synchronization should not be used

It is acceptable if real-time response is not requiredpn

if the size of data is small

such as in asynchronous processing or batch processing

Can move processing wherever you likep

It is also possible to send processing to where there is surplus power21

Wide area distributed monitoring22

Where to process and to direct the processing?
nItems that require monitoring over a wide areapMonitoring of the entire edge system in Hokkaido, Tokyolp

Power monitoringlnprocessing volume, processing load, response time, etc.
consumption, green power generation

Distributed monitoring over a wide areappp

OSS monitoring system = Zabbix!!
Can Zabbix do distributed monitoring?
Yes!! Zabbix Proxy!!

Hokkaido

820km
Tokyo

23

About Zabbix ProxynZabbix proxy can be used topppp

Monitoring remote locations
Monitoring locations having unreliable communications
Offload the Zabbix server when monitoring thousand of devices
Simplify the maintenance of distributed monitoring

https://www.zabbix.com/documentation/current/en/manual/distributed_monitoring/proxies

24

Distributed monitoring of Edges using Zabbix
Distributedmonitoring

PoC Results

Zabbix

DC: AZabbix
ProxyZabbix
Proxy

Edge
Environment

Edge
Environment

DC:B

Producer

Consumer

Producer

Consumer

Producer

Consumer

Producer

Consumer

Producer

Consumer

Producer

Consumer25

Distributed monitoring of Edges using Zabbix
Distributed
monitoring

PoC Results

Zabbix

DC: AZabbix
ProxyZabbix
Proxy

Edge
Environment

Edge
Environment

Producer

Consumer

Producer

Consumer

Producer

Consumer

Increase or decrease
based on processing load

DC:B

Producer

Consumer

Producer

Consumer

Producer

Consumer

26

Distributed monitoring of Edges using Zabbix
Distributedmonitoring

PoC ResultsZabbix

DC: AZabbix
ProxyEdge
Environment

Producer

Consumer

Producer

Consumer

Producer

Consumer

Data sync byApache Kafka(MirrorMaker2)

Increase or decrease
based on processing loadZabbix
Proxy

DC:B

Edge
Environment

Producer

Consumer

Producer

Consumer

Producer

Consumer27

Distributed monitoring of Edges using Zabbix
Future Work

Distributedmonitoring

Power generation
monitring

Power generation
monitringZabbix

Green Power Utilization

Power generation
Dashboard
SNMP?

Zabbix
Proxy

DC: A

DC: B

Power generation
Dashboard

Zabbix
Proxy

SNMP?

Solar power
generation

Solar power
generation

Edge
Environment

Producer

Consumer

Producer

Consumer

Producer

Consumer

Edge
Environment

Move the consumer according
To the movement of the sun

Producer

Consumer

Producer

Consumer

Producer

Consumer

28

Distributed monitoring of Edges using Zabbix
Future Work

Distributed
monitoring

Power generation
monitring

Power generation
monitring

ZabbixGreen Power Utilization

Power generation
Dashboard
SNMP?

Zabbix
Proxy

DC: A

Solar power
generation

Edge
Environment

ProducerConsumer

Producer

Consumer

Producer

Consumer

DC: B

Data sync byApache Kafka(MirrorMaker2)

Move the consumer according
To the movement of the sun

Power generation
DashboardZabbix
ProxySNMP?

Solar powergeneration

Edge
Environment

Producer

Consumer

Producer

Consumer

Producer

Consumer

29

Increase/Decrease of Producer/Consumer by ZabbixnIncrease and decrease of processing linked to green energy
pppn

Where to put the wisdom?
pppn

The real-time aspect of green energy fluctuations is limited
To operate linked with weather forecast data
Remote command action from a Zabbix proxySpecialize in the Zabbix monitoring
Send monitoring triggers to the controller
Increase and decrease of Producer/Consumer processes

Flexibility of system design30Integration Solar power system with Zabbixn

I found the answer!!
p”Data Solution for Solar Energy Application” in Zabbix Summit 2020lp

https://blog.zabbix.com/data-solution-for-solar-energy-application/13005/

All concerned, let’s talk later J31

Challenge to Green Mobility

32

Wide area data sync and wide area monitoringnWide are data synchronization
pppn

Use Kafka to create a pipe of data that makes data available
anywhere in the world
Users can process data asynchronously using Producer/Consumer
Asynchronous data processing is easy to implement

Wide area monitoring
ppp

Toward the realization of worldwide distributed monitoring
Determination of demand for green electricity by monitoring powergeneration
Distributed monitoring design with scalability using Zabbix + Zabbix
Proxy33

What would make you happy if you could make it?
nFollow The SunppnFollow The Moon
ppnn

Efficient use of surplus electricity from solar power generation by following the sun
Realization of distributed systems through active use of green energy
Centralization of processing in locations with low nighttime electricity costs, asadvocated by Google
Reducing costs by using cheap electricity from nuclear and hydroelectric power
generation

Environmental issues are one of the major challenges for automotive
companies
Continue to consider what can be done in terms of IT andtelecommunications
34

Summary
For research on efficient use of edgen Realization of wide-area data synchronization using Kafka'sdata synchronization functionalityn Realization of distributed monitoring of edge infrastructuredistributed over a wide area using Zabbixn Combining these two, we are building a wide-area distributed
system that actively utilizes green powern36

Wish to ZabbixnSupport for Opentelemetry(Otel)p

Otel is becoming an abstraction layer for system integrationln

Our new office systems
pp
p
p

n

https://opentelemetry.io/docs/

log, xFlow : Splunk
SIEM : Splunk Enterprise Security
APM : New Relic
SNMP : Zabbix

My Best ispp

Zabbix SNMP data -> Otel -> Splunk DashboardorAll Otel Collector data -> Zabbix DashboardJ37