title: ÐÑÐ¾ÐµÐºÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð¿Ð¾Ð¸ÑÐºÐ° Ð´ÑÐ±Ð»Ð¸ÐºÐ°ÑÐ¾Ð² Ð² ÑÑÑÑÐºÐ¾ÑÐ·ÑÑÐ½ÑÑ ÑÐµÐºÑÑÐ°Ñ
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Design and development software system for finding duplicates in Russian-language texts
Creators: name: Ð Ð°Ð·ÑÐ²Ð°ÐµÐ², ÐÐ°Ð½Ð¸Ð»
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2021
Subjects: Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼ ÑÐ¸Ð½Ð³Ð»Ð¾Ð²
Ð½ÐµÑÐµÑÐºÐ¸Ðµ Ð´ÑÐ±Ð»Ð¸ÐºÐ°ÑÑ
Ð¾Ð±Ð½Ð°ÑÑÐ¶ÐµÐ½Ð¸Ðµ Ð¿Ð»Ð°Ð³Ð¸Ð°ÑÐ°
shingles algorithm
near-duplicates
plagiarism detection

description: Ð Ð´Ð°Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÐµ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ñ ÑÐ¿Ð¾ÑÐ¾Ð±Ñ Ð¾Ð±ÑÑÑÐºÐ°ÑÐ¸Ð¸ ÑÐµÐºÑÑÐ¾Ð² Ð¸ Ð¼ÐµÑÐ¾Ð´Ñ Ð±Ð¾ÑÑÐ±Ñ Ñ Ð½Ð¸Ð¼Ð¸, ÑÐ°ÑÑÐ¼Ð¾ÑÑÐµÐ½Ñ Ð¾ÑÐ½Ð¾Ð²Ð½ÑÐµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ñ Ð¿Ð¾Ð¸ÑÐºÐ° Ð´ÑÐ±Ð»Ð¸ÐºÐ°ÑÐ¾Ð². ÐÐ° ÑÐ·ÑÐºÐµ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð¡ Sharp Ð±ÑÐ»Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð° ÐºÐ»Ð¸ÐµÐ½Ñ-ÑÐµÑÐ²ÐµÑÐ½Ð°Ñ Ð¿ÑÐ¾Ð³ÑÐ°Ð¼Ð¼Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð° Ð½Ð° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð° ÑÐ¸Ð½Ð³Ð»Ð¾Ð² Ð´Ð»Ñ Ð¿Ð¾Ð¸ÑÐºÐ° Ð¿Ð¾ÑÐ¾Ð¶Ð¸Ñ Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð². Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ Ð½Ð°ÑÐ¾Ð´Ð¸ÑÑ Ð·Ð°Ð¸Ð¼ÑÑÐ²Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¿ÑÐ¸ Ð½ÐµÐ·Ð½Ð°ÑÐ¸ÑÐµÐ»ÑÐ½ÑÑ Ð¼Ð¾Ð´Ð¸ÑÐ¸ÐºÐ°ÑÐ¸ÑÑ ÑÐµÐºÑÑÐ°, ÑÐ°ÐºÐ¸Ñ ÐºÐ°Ðº Ð·Ð°Ð¼ÐµÐ½Ð° ÑÐ¸Ð¼Ð²Ð¾Ð»Ð¾Ð² Ð½Ð° Ð³ÑÐ°ÑÐ¸ÑÐµÑÐºÐ¸ Ð¿Ð¾ÑÐ¾Ð¶Ð¸Ðµ, Ð·Ð°Ð¼ÐµÐ½Ð° Ð¾ÑÐ´ÐµÐ»ÑÐ½ÑÑ ÑÐ»Ð¾Ð² Ð½Ð° ÑÐ¸Ð½Ð¾Ð½Ð¸Ð¼Ñ, ÑÐ°Ð·Ð±Ð¸ÐµÐ½Ð¸Ðµ Ð¸ Ð¾Ð±ÑÐµÐ´Ð¸Ð½ÐµÐ½Ð¸Ðµ Ð¿ÑÐµÐ´Ð»Ð¾Ð¶ÐµÐ½Ð¸Ð¹ Ð¸ÑÑÐ¾ÑÐ½Ð¸ÐºÐ°, Ð¸Ð·Ð¼ÐµÐ½ÐµÐ½Ð¸Ðµ ÑÐºÐ»Ð¾Ð½ÐµÐ½Ð¸Ð¹/ÑÐ¾Ð´Ð¾Ð² Ð¾ÑÐ´ÐµÐ»ÑÐ½ÑÑ ÑÐ»Ð¾Ð². Ð¢Ð°ÐºÐ¶Ðµ Ð¾Ð½Ð° Ð¿Ð¾Ð·Ð²Ð¾Ð»ÑÐµÑ Ð²Ð¸Ð·ÑÐ°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°ÑÑ Ð½Ð°Ð¹Ð´ÐµÐ½Ð½ÑÐµ Ð·Ð°Ð¸Ð¼ÑÑÐ²Ð¾Ð²Ð°Ð½Ð¸Ñ Ð¸ Ð¼Ð¾Ð¶ÐµÑ Ð±ÑÑÑ Ð¿ÑÐ¸Ð¼ÐµÐ½ÐµÐ½Ð° Ð´Ð»Ñ Ð¿ÑÐ¾Ð²ÐµÑÐºÐ¸ Ð¾ÑÐ¸Ð³Ð¸Ð½Ð°Ð»ÑÐ½Ð¾ÑÑÐ¸ ÑÑÑÐ´ÐµÐ½ÑÐµÑÐºÐ¸Ñ ÑÐ°Ð±Ð¾Ñ (Ð¿ÑÐ¸ Ð¿ÑÐµÐ´Ð¿Ð¾Ð»Ð¾Ð¶ÐµÐ½Ð¸Ð¸, ÑÑÐ¾ ÑÑÑÐ´ÐµÐ½ÑÑ Ð·Ð°Ð¸Ð¼ÑÑÐ²ÑÑÑ ÑÐµÐºÑÑÑ Ð´ÑÑÐ³ Ñ Ð´ÑÑÐ³Ð°). ÐÐ° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ðµ Ð±ÑÐ»Ð¸ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ñ Ð²ÑÑÐ¸ÑÐ»Ð¸ÑÐµÐ»ÑÐ½ÑÐµ ÑÐºÑÐ¿ÐµÑÐ¸Ð¼ÐµÐ½ÑÑ Ð¿ÑÐ¸ ÑÐ°Ð·Ð»Ð¸ÑÐ½Ð¾Ð¹ Ð´Ð»Ð¸Ð½Ðµ ÑÐ¸Ð½Ð³Ð»Ð° Ð¸ Ð¿ÑÐ¸ Ð¾ÑÐºÐ»ÑÑÐµÐ½Ð½ÑÑ Ð¼Ð¾Ð´ÑÐ»ÑÑ Ð½Ð¾ÑÐ¼Ð°Ð»Ð¸Ð·Ð°ÑÐ¸Ð¸. ÐÑÐ»Ð¸ Ð²ÑÑÐ²Ð»ÐµÐ½Ñ Ð·Ð°Ð²Ð¸ÑÐ¸Ð¼Ð¾ÑÑÐ¸ ÑÐ¾ÑÐ½Ð¾ÑÑÐ¸ Ð¸ Ð¿Ð¾Ð»Ð½Ð¾ÑÑ Ð¾Ñ Ð´Ð»Ð¸Ð½Ñ ÑÐ¸Ð½Ð³Ð»Ð°.
description: In this work, methods of obfuscation of texts and methods of combating with them are investigated, the main algorithms for finding duplicates are considered. In the C Sharp programming language, a client-server software system was developed based on the shingle algorithm to searching for similar documents. The system allows you to find borrowings with minor text modifications, such as replacing symbols with graphically similar ones, replacing individual words with synonyms, splitting and combining source sentences, changing declensions / genders of individual words. It also allows you to visualize found borrowings and can be used to check the originality of student works (assuming that students borrow texts from each other). On the developed system, computational experiments were carried out with different shingle lengths and with disabled normalization modules. Dependences of precision and recall on the length of the shingle were revealed.