title: ÐÐ±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ðµ ÑÐµÑÐµÐ²ÑÑ Ð°ÑÐ°Ðº Ð¼ÐµÑÐ¾Ð´Ð¾Ð¼ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Attack detection by reinforcement learning
Creators: name: Ð¯ÐºÐ¸Ð¼Ð¾Ð²Ð°, ÐÐ°ÑÐ°Ð»ÑÑ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2022
Subjects: cÐµÑÐµÐ²ÑÐµ Ð°ÑÐ°ÐºÐ¸
Ð¿Ð¾Ð¸ÑÐº ÑÑÐ·Ð²Ð¸Ð¼Ð¾ÑÑÐµÐ¹
Ð¸ÑÐºÑÑÑÑÐ²ÐµÐ½Ð½ÑÐ¹ Ð¸Ð½ÑÐµÐ»Ð»ÐµÐºÑ
ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð½Ð¸Ðµ ÑÑÐ°ÑÐ¸ÐºÐ°
Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼
network attacks
vulnerability scanning
artificial intelligence
network traffic recognition
reinforcement learning

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«ÐÐ±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ðµ ÑÐµÑÐµÐ²ÑÑ Ð°ÑÐ°Ðº Ð¼ÐµÑÐ¾Ð´Ð¾Ð¼ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼Â». Ð¦ÐµÐ»ÑÑ ÑÐ°Ð±Ð¾ÑÑ ÑÐ²Ð»ÑÐµÑÑÑ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ðµ Ð²ÑÐµÐ´Ð¾Ð½Ð¾ÑÐ½Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ° ÑÑÐµÐ´Ð¸ Ð¿Ð¾ÑÐ¾ÐºÐ° ÑÐµÑÐµÐ²ÑÑ Ð¿Ð°ÐºÐµÑÐ¾Ð² Ð¿ÑÐ¸ Ð¿Ð¾Ð¼Ð¾ÑÐ¸ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½Ð¾Ð¹ ÑÐµÑÐ¸, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÑÑÐµÐ¹ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼. ÐÑÐµÐ´Ð¼ÐµÑÐ¾Ð¼ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ ÑÐ²Ð»ÑÑÑÑÑ ÑÐ¾Ð²ÑÐµÐ¼ÐµÐ½Ð½ÑÐµ Ð¼ÐµÑÐ¾Ð´Ñ ÑÐ¸Ð»ÑÑÑÐ°ÑÐ¸Ð¸ ÑÐµÑÐµÐ²ÑÑ Ð¿Ð°ÐºÐµÑÐ¾Ð². ÐÐ°Ð´Ð°ÑÐ¸, ÑÐµÑÐ°ÐµÐ¼ÑÐµ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ:ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð¿ÑÐ¾Ð±Ð»ÐµÐ¼Ñ Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²ÑÑ Ð°ÑÐ°Ðº. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ Ð¾ÑÐ¾Ð±ÐµÐ½Ð½Ð¾ÑÑÐµÐ¹ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼. ÐÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð°Ñ ÑÐµÐ°Ð»Ð¸Ð·Ð°ÑÐ¸Ñ Ð¼ÐµÑÐ¾Ð´Ð° Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ñ ÑÐµÑÐµÐ²ÑÑ Ð°ÑÐ°Ðº Ð² Ð·Ð°Ð´Ð°Ð½Ð½Ð¾Ð¼ Ð´Ð°ÑÐ°ÑÐµÑÐµ Ñ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð¸ÐµÐ¼ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½Ð¾Ð¹ ÑÐµÑÐ¸, Ð¸ÑÐ¿Ð¾Ð»ÑÐ·ÑÑÑÐµÐ¹ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼. ÐÑÐµÐ½ÐºÐ° ÑÐºÐ¾ÑÐ¾ÑÑÐ¸ Ð¸ ÑÐ¾ÑÐ½Ð¾ÑÑÐ¸ ÑÐ°Ð±Ð¾ÑÑ ÑÐ¾Ð·Ð´Ð°Ð½Ð½Ð¾Ð³Ð¾ ÑÑÐµÐ´ÑÑÐ²Ð°. Ð ÑÐ¾Ð´Ðµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ» Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½ Ð¾Ð±ÑÐ¸Ð¹ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼ Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ñ Ð¿Ð¾Ð´ÐºÑÐµÐ¿Ð»ÐµÐ½Ð¸ÐµÐ¼. ÐÑÐ¾Ð¼Ðµ ÑÐ¾Ð³Ð¾, Ð±ÑÐ»Ð¸ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ ÑÐ¾Ð²ÑÐµÐ¼ÐµÐ½Ð½ÑÐµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð² Ð¾Ð±Ð»Ð°ÑÑÐ¸ Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸ Ð¿ÐµÑÐµÐ´Ð°ÑÐ¸ Ð´Ð°Ð½Ð½ÑÑ ÑÐµÑÐµÐ· ÑÐµÑÑ. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¾ ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½Ð¾ ÑÑÐµÐ´ÑÑÐ²Ð¾ Ð²ÑÑÐ²Ð»ÐµÐ½Ð¸Ñ Ð²ÑÐµÐ´Ð¾Ð½Ð¾ÑÐ½Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ°, Ð·Ð°ÑÐµÐ¼ Ð±ÑÐ»Ð° Ð¿ÑÐ¾Ð´ÐµÐ¼Ð¾Ð½ÑÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð° ÑÑÑÐµÐºÑÐ¸Ð²Ð½Ð¾ÑÑÑ ÑÑÐµÐ´ÑÑÐ²Ð°. ÐÑÐ» ÑÐ´ÐµÐ»Ð°Ð½ Ð²ÑÐ²Ð¾Ð´, ÑÑÐ¾ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÑ ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐµÐºÐ° Ð¼Ð¾Ð¶ÐµÑ Ð±ÑÑÑ ÑÑÐ¸Ð»ÐµÐ½Ð° Ð¿Ð¾ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ñ Ñ Ð¸Ð¼ÐµÑÑÐ¸Ð¼ÑÑ Ð½Ð° Ð´Ð°Ð½Ð½ÑÐ¹ Ð¼Ð¾Ð¼ÐµÐ½Ñ ÑÑÐ¾Ð²Ð½ÐµÐ¼ Ð·Ð°ÑÐ¸ÑÑ. ÐÐ¾Ð»ÑÑÐµÐ½Ð½ÑÐµ ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÑ Ð¼Ð¾Ð³ÑÑ Ð±ÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ñ Ð² ÐºÐ°ÑÐµÑÑÐ²Ðµ Ð¾ÑÐ½Ð¾Ð²Ñ Ð´Ð»Ñ Ð¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ ÑÑÐµÐ´ÑÑÐ² Ð´Ð¸Ð½Ð°Ð¼Ð¸ÑÐµÑÐºÐ¾Ð³Ð¾ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° ÑÐµÑÐµÐ²Ð¾Ð³Ð¾ ÑÑÐ°ÑÐ¸ÐºÐ°.
description: Topic of the final qualification work: "Attack detection by reinforcement learning". The purpose of the work is to detect malicious traffic among packet streams using a neural network using a reinforcement learning architecture. The subject of the research is modern methods of packet filtering. Tasks to be solved during the study:Study of the problems of identifying the network attacks. Features of the structure with reinforcement learning. Development of a method for detecting attacks at a given date using a neural network using reinforcement learning architecture. Software implementation of the developed method. Evaluation of the speed and accuracy of the created tool. In the course of the work, the general algorithm of the architecture of reinforcement learning was investigated. In addition, modern research in the field of data transmission security through the network was analyzed. The work resulted in development of a tool to detecting malicious traffic. Tool has satisfactory indicators in not only quantitative defect detection, but also in productivity. The studying point to conclusion that network stack security is poorly examined. The results could be used as a base for dynamic analysis network traffic.