title: Ð¡Ð¾Ð·Ð´Ð°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ ÐºÐ¾Ð¼Ð¿Ð»ÐµÐºÑÐ° ÑÐ±Ð¾ÑÐ° Ð¸ Ñ ÑÐ°Ð½ÐµÐ½Ð¸Ñ ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÐ¸ ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ° Ð¿ÑÐ¾Ð¼ÑÑÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ Ð½Ð°Ð·Ð½Ð°ÑÐµÐ½Ð¸Ñ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Software Development: collection and storage of networking traffic statistics for industries
Creators: name: ÐÐ½Ð¸ÐºÐ¸Ð½, ÐÐ¸ÐºÐ¸ÑÐ°
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2021
Subjects: ÑÐµÑÐµÐ²Ð¾Ð¹ ÑÑÐ°ÑÐ¸Ðº
Ð²ÑÑÐ¾ÐºÐ¾Ð½Ð°Ð³ÑÑÐ¶ÐµÐ½Ð½ÑÐµ ÑÐ¸ÑÑÐµÐ¼Ñ
Apache Kafka
Elastic Stack
network traffic
high-loaded systems

description: Ð¦ÐµÐ»ÑÑ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ ÐºÐ¾Ð¼Ð¿Ð»ÐµÐºÑÐ° ÑÐ±Ð¾ÑÐ° Ð¸ ÑÑÐ°Ð½ÐµÐ½Ð¸Ñ ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÐ¸ ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ° Ð¿ÑÐ¾Ð¼ÑÑÐ»ÐµÐ½Ð½Ð¾Ð³Ð¾ Ð½Ð°Ð·Ð½Ð°ÑÐµÐ½Ð¸Ñ, Ð¾Ð±ÐµÑÐ¿ÐµÑÐ¸Ð²Ð°ÑÑÐµÐ³Ð¾ Ð¿ÑÐ¸ÐµÐ¼, Ð´ÐµÐºÐ¾Ð´Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð¸ Ð´Ð¾Ð¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ðµ Ð´Ð°Ð½Ð½ÑÑ, ÑÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ Ð¼Ð°ÑÑÑÑÑÐ¸Ð·Ð°ÑÐ¾ÑÐ°Ð¼Ð¸ Ð¿Ð¾ Ð¿ÑÐ¾ÑÐ¾ÐºÐ¾Ð»Ð°Ð¼ NetFlow/IPFIX, NetStream Ð¸ sFlow. Ð¡Ð¾Ð·Ð´Ð°Ð½Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÐµ ÑÑÐµÐ´ÑÑÐ²Ð° Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¿Ð°ÐºÐµÑÐ¾Ð², ÑÐ¾Ð´ÐµÑÐ¶Ð°ÑÐ¸Ñ ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÑ ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ°, ÑÑÐ¾ÑÐ¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ Ð¿Ð¾ Ð¿ÑÐ¾ÑÐ¾ÐºÐ¾Ð»Ð°Ð¼ NetFlow/IPFIX, NetStream Ð¸ sFlow. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÐµ ÑÑÐµÐ´ÑÑÐ²Ð° ÑÑÐ°Ð½ÐµÐ½Ð¸Ñ ÑÑÐ°ÑÐ¸ÑÑÐ¸ÐºÐ¸ ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ° Ñ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸ÐµÐ¼ ÑÐ°ÑÐ¿ÑÐµÐ´ÐµÐ»ÑÐ½Ð½Ð¾Ð³Ð¾ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ Ð±ÑÐ¾ÐºÐµÑÐ° ÑÐ¾Ð¾Ð±ÑÐµÐ½Ð¸Ð¹ Apache Kafka Ð¸ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ ÐºÐ¾Ð¼Ð¿Ð»ÐµÐºÑÐ° Elastic Stack, Ð¾Ð±ÐµÑÐ¿ÐµÑÐ¸Ð²Ð°ÑÑÐµÐ³Ð¾ Ð¿Ð¾Ð¸ÑÐº Ð¸ Ð¸Ð½Ð´ÐµÐºÑÐ°ÑÐ¸Ñ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¸. ÐÑÐ¿Ð¾Ð»Ð½ÐµÐ½Ð½ÑÐµ ÑÑÐ½ÐºÑÐ¸Ð¾Ð½Ð°Ð»ÑÐ½Ð¾Ðµ Ð¸ Ð½Ð°Ð³ÑÑÐ·Ð¾ÑÐ½Ð¾Ðµ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð³Ð¾ ÐºÐ¾Ð¼Ð¿Ð»ÐµÐºÑÐ° Ð¿Ð¾ÐºÐ°Ð·Ð°Ð»Ð¸, ÑÑÐ¾ Ð¿ÑÐ¾Ð¸Ð·Ð²Ð¾Ð´Ð¸ÑÐµÐ»ÑÐ½Ð¾ÑÑÑ Ð´Ð¾ÑÑÐ¸Ð³Ð°ÐµÑ Ð¾ÐºÐ¾Ð»Ð¾ 2000 Ð¿Ð°ÐºÐµÑÐ¾Ð² Ð² ÑÐµÐºÑÐ½Ð´Ñ, Ð²ÐµÑÑÐ½ÑÑ Ð³ÑÐ°Ð½Ð¸ÑÐ° ÑÑÐ°Ð±Ð¸Ð»ÑÐ½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÑ ÑÑÐµÐ´ÑÑÐ² Ð´ÐµÐºÐ¾Ð´Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ - Ð±Ð¾Ð»ÐµÐµ 1 Ð¼Ð¸Ð»Ð»Ð¸Ð¾Ð½Ð° Ð¿Ð°ÐºÐµÑÐ¾Ð² Ð² ÑÐµÐºÑÐ½Ð´Ñ Ð¿ÑÐ¸ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ð¸ Ð²Ð¸ÑÑÑÐ°Ð»ÑÐ½Ð¾Ð¹ Ð¼Ð°ÑÐ¸Ð½Ñ VMware Ð¸ ÑÐ»ÐµÐ´ÑÑÑÐµÐ¹ ÐºÐ¾Ð½ÑÐ¸Ð³ÑÑÐ°ÑÐ¸Ð¸ Ð°Ð¿Ð¿Ð°ÑÐ°ÑÐ½ÑÑ ÑÑÐµÐ´ÑÑÐ²: Ð¿ÑÐ¾ÑÐµÑÑÐ¾Ñ Ñ 4 ÑÐ´ÑÐ°Ð¼Ð¸ Ð¸ ÑÐ°ÐºÑÐ¾Ð²Ð¾Ð¹ ÑÐ°ÑÑÐ¾ÑÐ¾Ð¹ 3,6 ÐÐÑ, Ð¾Ð¿ÐµÑÐ°ÑÐ¸Ð²Ð½Ð°Ñ Ð¿Ð°Ð¼ÑÑÑ Ð¾Ð±ÑÑÐ¼Ð¾Ð¼ 4 ÐÐ. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½ÑÐµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½ÑÐµ ÑÑÐµÐ´ÑÑÐ²Ð° Ð±ÑÐ´ÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð² ÑÐ¾ÑÑÐ°Ð²Ðµ Ð¿ÑÐ¾ÐµÐºÑÐ° Efros Config Inspector, ÐºÐ¾ÑÐ¾ÑÑÐ¹ ÑÐ¾Ð·Ð´Ð°ÐµÑÑÑ ÐÐÐ Â«ÐÐ°Ð·Ð¸Ð½ÑÐ¾ÑÐ¼ÑÐµÑÐ²Ð¸ÑÂ».
description: A qualification graduation work goal is to develop a software system for collecting and storing statistics of network traffic for industrial purposes, which provides receiving, decoding, and supplementing of data generated by routers using the NetFlow/IPFIX, NetStream and sFlow protocols. Software tools for processing packets containing statistics of network traffic generated according to protocols the NetFlow/IPFIX, NetStream and sFlow protocols have been created. Software tools for storing network traffic statistics have been developed using the distributed event streaming platform Apache Kafka and the group of products Elastic Stack, which provides information search and indexing. The functional and stress tests of the software complex showed that the performance reaches about 2000 packets per second, the upper limit of the stable operating of software decoding tools is more than 1 million packets per second when using a VMware virtual machine and the following hardware configuration: processor with 4 cores and a frequency of 3.6 GHz, 4 GB RAM. The developed software will be used as part of the Efros Config Inspector project, which is being created by OOO "Gazinformservis".