title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð½Ð¾Ð²ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð³Ð»ÑÐ±Ð¾ÐºÐ¾Ð³Ð¾ Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½Ð¾Ð³Ð¾ Ð±ÑÑÑÐ¸Ð½Ð³Ð° Ð´Ð»Ñ ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°Ñ Ð±Ð¾Ð»ÑÑÐ¾Ð¹ ÑÐ°Ð·Ð¼ÐµÑÐ½Ð¾ÑÑÐ¸
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¼Ð°Ð³Ð¸ÑÑÑÐ°
titleType: Subtitle
title: Research and development of new deep gradient boosting algorithms for solving high-dimensional tasks
Creators: name: ÐÐ¾Ð½ÑÑÐ°Ð½ÑÐ¸Ð½Ð¾Ð², ÐÐ½Ð´ÑÐµÐ¹
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2020
Subjects: Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ðµ Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ
Ð²Ð¾ÑÑÑÐ°Ð½Ð¾Ð²Ð»ÐµÐ½Ð¸Ðµ ÑÐµÐ³ÑÐµÑÑÐ¸Ð¸
ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ñ
Ð´ÐµÑÐµÐ²ÑÑ ÑÐµÑÐµÐ½Ð¸Ð¹
Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½ÑÐ¹ Ð±ÑÑÑÐ¸Ð½Ð³
machine learning
regression
classification
decision trees
gradient boosting machine

description: ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐµ Ð½Ð¾Ð²ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð´ÐµÑÐµÐ²ÑÐµÐ² ÑÐµÑÐµÐ½Ð¸Ð¹ Ð´Ð»Ñ ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°Ñ Ð²Ð¾ÑÑÑÐ°Ð½Ð¾Ð²Ð»ÐµÐ½Ð¸Ñ ÑÐµÐ³ÑÐµÑÑÐ¸Ð¸ Ð¸ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸. ÐÐ°Ð´Ð°ÑÐ¸, ÐºÐ¾ÑÐ¾ÑÑÐµ ÑÐµÑÐ°Ð»Ð¸ÑÑ Ð² ÑÐ¾Ð´Ðµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ñ: 1. ÐÐ·ÑÑÐµÐ½Ð¸Ðµ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð· Ð½Ð°Ð¸Ð±Ð¾Ð»ÐµÐµ Ð°ÐºÑÑÐ°Ð»ÑÐ½ÑÑ Ð¿Ð¾Ð´ÑÐ¾Ð´Ð¾Ð² ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°Ñ ÑÐµÐ³ÑÐµÑÑÐ¸Ð¸ Ð¸ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð´ÐµÑÐµÐ²ÑÐµÐ² ÑÐµÑÐµÐ½Ð¸Ð¹. 2. Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð½Ð¾Ð²ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ. 3. ÐÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ð¸Ðµ Ð¸ Ð°Ð½Ð°Ð»Ð¸Ð· Ð¿Ð¾Ð»ÑÑÐµÐ½Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð². 4. Ð¡ÑÐ°Ð²Ð½ÐµÐ½Ð¸Ðµ Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ð¼Ð¸ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð°Ð¼Ð¸, Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½ÑÐ¼Ð¸ Ð½Ð° Ð´ÐµÑÐµÐ²ÑÑÑ ÑÐµÑÐµÐ½Ð¸Ð¹. ÐÑÐ»Ð¸ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ Ð½ÐµÐ´Ð¾ÑÑÐ°ÑÐºÐ¸ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð², Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð½ÑÑ Ð½Ð° Ð´ÐµÑÐµÐ²ÑÑÑ ÑÐµÑÐµÐ½Ð¸Ð¹, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¿ÑÐ¸Ð¼ÐµÐ½Ð¸Ð¼Ð¾ÑÑÑ Ð³Ð»ÑÐ±Ð¾ÐºÐ¾Ð³Ð¾ Ð»ÐµÑÐ° Ðº Ð·Ð°Ð´Ð°ÑÐµ ÑÐµÐ³ÑÐµÑÑÐ¸Ð¸. Ð ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ñ Ð´Ð²Ð° Ð¿ÑÐ¸Ð½ÑÐ¸Ð¿Ð¸Ð°Ð»ÑÐ½Ð¾ Ð½Ð¾Ð²ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ: Ð³Ð»ÑÐ±Ð¾ÐºÐ¸Ð¹ Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½ÑÐ¹ Ð±ÑÑÑÐ¸Ð½Ð³ Ð¸ Ð°Ð´Ð°Ð¿ÑÐ¸Ð²Ð½Ð°Ñ ÐºÐ¾Ð¼Ð¿Ð¾Ð·Ð¸ÑÐ¸Ñ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½Ð¾Ð³Ð¾ Ð±ÑÑÑÐ¸Ð½Ð³Ð°; Ð° ÑÐ°ÐºÐ¶Ðµ Ð¼Ð¾Ð´Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ñ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½Ð¾Ð³Ð¾ Ð±ÑÑÑÐ¸Ð½Ð³Ð° Ð´ÐµÑÐµÐ²ÑÐµÐ² ÑÐµÑÐµÐ½Ð¸Ð¹. ÐÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¾ Ð¼Ð½Ð¾Ð¶ÐµÑÑÐ²Ð¾ ÑÐ¸ÑÐ»ÐµÐ½Ð½ÑÑ ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÐ¾Ð² Ð¸ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ðµ Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ð¼Ð¸ Ð°ÐºÑÑÐ°Ð»ÑÐ½ÑÐ¼Ð¸ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð°Ð¼Ð¸ Ð¼Ð°ÑÐ¸Ð½Ð½Ð¾Ð³Ð¾ Ð¾Ð±ÑÑÐµÐ½Ð¸Ñ, ÑÐ°ÐºÐ¸Ð¼Ð¸ ÐºÐ°Ðº: ÑÐ»ÑÑÐ°Ð¹Ð½ÑÐ¹ Ð»ÐµÑ Ð¸ Ð³ÑÐ°Ð´Ð¸ÐµÐ½ÑÐ½ÑÐ¹ Ð±ÑÑÑÐ¸Ð½Ð³ Ð´ÐµÑÐµÐ²ÑÐµÐ² ÑÐµÑÐµÐ½Ð¸Ð¹, Ð² ÑÐ¾Ð¼ ÑÐ¸ÑÐ»Ðµ XGBoost Ð¸ CatBoost. Ð ÐµÐ·ÑÐ»ÑÑÐ°ÑÑ ÑÑÐ°Ð²Ð½ÐµÐ½Ð¸Ñ ÑÐºÐ°Ð·ÑÐ²Ð°ÑÑ Ð½Ð° Ð²Ð¾Ð·Ð¼Ð¾Ð¶Ð½Ð¾ÑÑÑ Ð¿Ð¾ÑÑÑÐ¾ÐµÐ½Ð¸Ñ Ð±Ð¾Ð»ÐµÐµ ÑÐ¾ÑÐ½ÑÑ Ð¼Ð¾Ð´ÐµÐ»ÐµÐ¹ Ñ Ð¿Ð¾Ð¼Ð¾ÑÑÑ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð².
description: This paper is devoted to development of new machine learning algorithms for regression and classification tasks based on decision trees. The research set the following goals: 1. Research of decision tree-based machine learning approaches. 2. Development of new machine learning algorithms. 3. Analysis of developed algorithms. 4. Comparison with other decision tree-based machine learning algorithms. The analysis of currently available decision tree-based algorithms has been made. Also, the applicability of Deep Forest to the regression task has been revised. The study resulted in two brand new machine learning algorithms: deep gradient boosting and adaptive gradient boosting ensemble; and the modification of decision tree-based gradient boosting. The numerical experiments made during the research, and comparison with other decision tree-based algorithms, including Random Forest, XGBoost and CatBoost, show that developed methods can be used to construct more precise models.