title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð°ÑÑ Ð¸ÑÐµÐºÑÑÑÑ ÑÑÐµÐ¹Ð¼Ð²Ð¾ÑÐºÐ° Ð·Ð°ÑÐ¸ÑÑÐ½Ð½Ð¾Ð³Ð¾ Ð¾Ð·ÐµÑÐ° Ð±Ð¾Ð»ÑÑÐ¸Ñ Ð´Ð°Ð½Ð½ÑÑ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Developing a framework architecture of a secure big data lake
Creators: name: ÐÑÑÐ°ÑÐ¾Ð², Ð¡Ð¸Ð¼Ð°Ñ
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2022
Subjects: ÐÐ½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ñ
ÐÐ°Ð·Ñ Ð´Ð°Ð½Ð½ÑÑ
Ð±Ð¾Ð»ÑÑÐ¸Ðµ Ð´Ð°Ð½Ð½ÑÐµ
Ð¾Ð±Ð»Ð°ÑÐ½ÑÐµ Ð²ÑÑÐ¸ÑÐ»ÐµÐ½Ð¸Ñ
Ð¾Ð·ÐµÑÐ¾ Ð´Ð°Ð½Ð½ÑÑ
ÐºÐ¸Ð±ÐµÑÐ±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÑ
big data
cloud computing
data lake
cybersecurity

description: Ð Ð´Ð°Ð½Ð½Ð¾Ð¹ Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÐµ Ð¿ÑÐµÐ´ÑÑÐ°Ð²Ð»ÐµÐ½Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÑ ÑÑÐµÐ¹Ð¼Ð²Ð¾ÑÐºÐ° Ð·Ð°ÑÐ¸ÑÑÐ½Ð½Ð¾Ð³Ð¾ Ð¾Ð·ÐµÑÐ° Ð±Ð¾Ð»ÑÑÐ¸Ñ Ð´Ð°Ð½Ð½ÑÑ. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ñ Ð²Ð·ÑÑ Data Lake Architecture Framework (DLAF), ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½ÑÐ¹ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°ÑÐµÐ»ÑÐ¼Ð¸ Ð´Ð°Ð½Ð½ÑÑ Ð¨ÑÑÑÐ³Ð°ÑÐ´ÑÐºÐ¾Ð³Ð¾ Ð£Ð½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑÐ°. Ð ÑÐ°Ð±Ð¾ÑÐµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð° Ð¼ÐµÑÐ¾Ð´Ð¾Ð»Ð¾Ð³Ð¸Ñ DLAF, ÐµÐ³Ð¾ Ð°ÑÐ¿ÐµÐºÑÑ Ð¸ Ð¸Ð· Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ñ. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° ÑÑÐµÐ´ÑÑÐ²Ð° Ð¾Ð±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ñ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸ Ð¾Ð·ÐµÑÐ° Ð´Ð°Ð½Ð½ÑÑ Ð½Ð° Ð°ÑÑÐ¸ÑÐµÐºÑÑÑÐ½Ð¾Ð¼ ÑÑÐ¾Ð²Ð½Ðµ Ð¿Ð¾ÑÑÐµÐ±Ð¾Ð²Ð°Ð»Ð° ÑÑÐ°ÑÐµÐ»ÑÐ½Ð¾Ð³Ð¾ Ð¾ÑÐ±Ð¾ÑÐ° ÑÑÐµÐ½Ð°ÑÐ¸ÐµÐ² Ð°ÑÐ°Ðº Ð¸ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸. ÐÑÐ±Ð¾Ñ Ð¿ÑÐ¾Ð²Ð¾Ð´Ð¸Ð»ÑÑ Ñ ÑÑÑÑÐ¾Ð¼ ÑÐ°ÐºÐ¸Ñ Ð³Ð»Ð°Ð²Ð½ÑÑ Ð¾ÑÐ»Ð¸ÑÐ¸ÑÐµÐ»ÑÐ½ÑÑ ÑÐµÑÑ Ð¾Ð·ÐµÑÐ° Ð´Ð°Ð½Ð½ÑÑ, ÐºÐ°Ðº Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÐ¸ Ð·Ð°Ð³ÑÑÐ·ÐºÐ¸, Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¸ Ð²ÑÐ³ÑÑÐ·ÐºÐ¸ Ð´Ð°Ð½Ð½ÑÑ Ð°Ð±ÑÐ¾Ð»ÑÑÐ½Ð¾ Ð»ÑÐ±Ð¾Ð³Ð¾ ÑÐ¸Ð¿Ð°, Ð° ÑÐ°ÐºÐ¶Ðµ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ðµ Ñ Ð»ÑÐ±ÑÐ¼ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ¾Ð¼ Ð´Ð°Ð½Ð½ÑÑ. ÐÑÐ±ÑÐ°Ð½Ð½ÑÐµ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸ Ð² ÑÐ²Ð¾ÐµÐ¹ Ð¾ÑÐ½Ð¾Ð²Ðµ ÑÐ¾ÑÑÐ¾ÑÑ Ð¸Ð· ÑÐ¾Ð»ÐµÐ²ÑÑ Ð¸Ð»Ð¸ Ð°ÑÑÐ¸Ð±ÑÑÐ½ÑÑ Ð¿Ð¾Ð»Ð¸ÑÐ¸Ðº. ÐÐ°Ð½Ð½ÑÐµ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð¿ÑÐµÑÐµÑÐ¿ÐµÐ»Ð¸ Ð¼Ð¾Ð´Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð¿Ð¾Ð´ Ð½ÑÐ¶Ð´Ñ Ð¾Ð·ÐµÑÐ° Ð´Ð°Ð½Ð½ÑÑ. ÐÐ±ÐµÑÐ¿ÐµÑÐµÐ½Ð¸Ðµ Ð·Ð°ÑÐ¸ÑÑ Ð´Ð°Ð½Ð½ÑÑ Ð²Ð¾Ð·Ð»Ð¾Ð¶ÐµÐ½Ð¾ Ð½Ð° Ð´Ð²Ð° ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½ÑÐ°: Global Monitoring Tool Ð¸ Check Sum Controller. ÐÐ°Ð½Ð½ÑÐµ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½ÑÑ Ð²ÐºÐ»ÑÑÐµÐ½Ñ Ð² Ð¿Ð¾Ð»Ð¸ÑÐ¸ÐºÐ¸ Ð¼Ð¾Ð´ÐµÐ»Ð¸ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸ Ð½Ð° ÑÑÐ°Ð¿Ðµ Ð¿ÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ. ÐÐµÑÐ²ÑÐ¹ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½Ñ ÑÐµÐ°Ð»Ð¸Ð·Ð¾Ð²Ð°Ð½ Ð² Ð²Ð¸Ð´Ðµ ÐºÐ¾Ð¼Ð¿Ð¾Ð·Ð¸ÑÐ¸Ð¸ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð¸ Ð½ÑÐ¶Ð´Ð°ÐµÑÑÑ Ð² Ð¿ÑÐµÐ´Ð²Ð°ÑÐ¸ÑÐµÐ»ÑÐ½Ð¾Ð¼ Ð¾Ð±ÑÑÐµÐ½Ð¸Ð¸. ÐÐ½ Ð¾ÑÐ²ÐµÑÐ°ÐµÑ Ð·Ð° Ð¼Ð¾Ð½Ð¸ÑÐ¾ÑÐ¸Ð½Ð³ Ð²ÑÐµÑ Ð¾Ð¿ÐµÑÐ°ÑÐ¸Ð¹ Ð¾Ð·ÐµÑÐ° Ð´Ð°Ð½Ð½ÑÑ Ð¸ Ð¸Ñ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð½Ð° Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½ÑÐµ Ð¸ Ð²ÑÐµÐ´Ð¾Ð½Ð¾ÑÐ½ÑÐµ. ÐÑÐ¾ÑÐ¾Ð¹ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½Ñ Ð¾Ð±ÑÐ°Ð±Ð°ÑÑÐ²Ð°ÐµÑ Ð»ÑÐ±Ð¾Ðµ Ð²Ð·Ð°Ð¸Ð¼Ð¾Ð´ÐµÐ¹ÑÑÐ²Ð¸Ðµ Ñ ÐºÐ¾Ð½ÑÑÐ¾Ð»ÑÐ½Ð¾Ð¹ ÑÑÐ¼Ð¼Ð¾Ð¹ ÑÐ°Ð¹Ð»Ð¾Ð²Ð¾Ð³Ð¾ Ð¾Ð±ÑÐµÐºÑÐ° Ð² ÑÐµÑÐµÐ½Ð¸Ðµ Ð²ÑÐµÐ³Ð¾ Ð¿ÑÐµÐ±ÑÐ²Ð°Ð½Ð¸Ñ Ð² Ð¾Ð·ÐµÑÐµ Ð´Ð°Ð½Ð½ÑÑ. ÐÑÐ¸Ð²ÐµÐ´ÑÐ½Ð½ÑÐ¹ Ð² ÑÐ°Ð±Ð¾ÑÐµ Ð¸Ð½ÑÑÑÑÐ¼ÐµÐ½ÑÐ°Ð»ÑÐ½ÑÐ¹ Ð°ÑÐ´Ð¸Ñ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸ Ð´Ð°Ð» Ð¾Ð±ÑÐµÐºÑÐ¸Ð²Ð½ÑÐµ Ð¾ÑÐµÐ½ÐºÐ¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð³Ð¾ ÑÐµÑÐµÐ½Ð¸Ñ Ð¸ ÑÐµÐºÐ¾Ð¼ÐµÐ½Ð´Ð°ÑÐ¸Ð¸ Ð¿Ð¾ Ð²ÑÐ±Ð¾ÑÑ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð±ÐµÐ·Ð¾Ð¿Ð°ÑÐ½Ð¾ÑÑÐ¸.
description: This final qualification paper presents the development of a protected big data lake framework architecture. It is based on the Data Lake Architecture Framework (DLAF) developed by data scientists at the University of Stuttgart. The paper investigates the DLAF methodology, its aspects and from interactions. Developing a data lake information security tool at the architectural level required a careful selection of attack scenarios and security models. The selection was made taking into account the main features of the data lake, such as the ability to download, process and upload data of absolutely any type, as well as interaction with any data source. The selected security models consist fundamentally of role or attribute policies. These models have undergone modifications for the needs of the data lake. Data protection is assigned to two components: Global Monitoring Tool and Check Sum Controller. These components are included in the security model policies at the design stage. The first component is implemented as a composition of machine learning models and needs to be pre-trained. It is responsible for monitoring all data lake operations and classifying them into safe and malicious ones. The second component handles any interaction with the checksum of the file object during the entire stay in the data lake. The information security instrumental audit presented in this paper provided objective evaluations of the developed solution and recommendations for security model selection.