# Outlier Detection of Light Buoy Telemetry and Telecontrol Data Based on Improved Adaptiveε Neighborhood DBSCAN Clustering

Authors: Liangkun Xu; Yongxing Jin; Han Xue; Shibo Zhou
Journal: Mathematical Problems in Engineering
 (2021)

---

## Abstract

In this paper, according to the water area of light buoy, the migration rule of light buoy in main channel is counted, and the frequency of light buoy passing through a certain position point in the process of migration is calculated, and the model is verified by buoy position data. An anomaly detection algorithm based on improved adaptive DBSCAN clustering is designed. The size of theε neighborhood is adaptive according to the wind speed, wave height, and drift distance span of the water area where the light buoy is located. The experimental results show that the improved adaptive DBSCAN clustering algorithm can solve the problem that the common DBSCAN clustering algorithm takes the “hot” water area of the light buoy position or the most likely area in the light buoy migration process as the noise point.


---

## Body

## 1. Introduction

There are many reasons for the abnormal data of the light buoy, and the main reason is the offset and drift of the light buoy. After the light buoy drifts, the position data returned to the telemetry and telecontrol system is quite different from the normal data. In addition to the abnormal data caused by the drifts of the light buoy, the transmission and storage of the telemetry data may also cause the abnormal position data of the light buoy, from natural conditions (wind, current, and wave), external factors (ship traveling wave), and human factors (human throwing). The factors that affect the positioning accuracy of the buoy are analyzed from the following aspects: the equipment factor (satellite error) and the attitude of the buoy (the inclination angle of the buoy). The original lamp buoy telemetry data may have errors in manual input, information transmission, sensor data acquisition, storage, and other links. The analysis of abnormal data of light buoy position is an interference data for the analysis of light buoy offset. Therefore, in data processing, it is necessary to eliminate the abnormal data points of each light buoy. Therefore, it is necessary to preprocess the data before using the lamp buoy telemetry position data, so as to provide a high-quality data set for subsequent use. The telemetry data of the light buoy includes the position, time, voltage, and other important parameters that characterize the operation state of the light buoy. The offset trajectory of light buoy is the record sequence of the position and time of the light buoy, and it is an important type of spatiotemporal data. Through the analysis of the position data, the similarity characteristics of the displacement trajectory of each light buoy can be obtained, and the meaningful offset patterns can be found. The telemetry data processing of light buoy mainly includes two aspects: one is the deletion of abnormal position points, and the other is the selection and cleaning of data after the light buoy is displaced.Barbariol et al. discussed wave buoys on moored platforms and free floating platforms in the Southern Ocean [1]. Venkatesan et al. studied the drift of mooring buoy network in the northern Indian Ocean (Omni) at different depths below 500 meters [2]. Srinivasan et al. described a case study of indigenous drifting buoys in the Indian Ocean since 2012 [3]. Yu et al. proposed an adaptive correction mechanism of drift factor based on East China Sea shelf buoy data set [4]. Hostache et al. studied the drifting buoy with navigation system, which can measure the water surface elevation from almost any point in the world [5].In the aspect of using clustering algorithm for data preprocessing, Jin et al. proposed a method based on CFAR detection and density clustering to suppress the speckle interference and transverse stripe interference of ISAR image [6]. Wen et al. proposed hierarchical preprocessing of big data of sign in trajectory based on density clustering [7].DBSCAN (density based spatial clustering of applications with noise) is a representative density based clustering algorithm. Different from partition and hierarchical clustering method, it defines cluster as the largest set of density connected points, which can divide the area with enough high density into clusters, and can find clusters of arbitrary shape in the noisy spatial database. Lin et al.’s experiments in semiconductor optical amplifier show that DBSCAN algorithm can improve the performance of 40 Gb/S16 QAM and 30 GB/S64 QAM receivers [8]. Hou et al. proposed a nonparametric clustering algorithm based on dominating set and DBSCAN algorithm [9]. Shen et al. proposed a real-time image superpixel segmentation method based on density noise and spatial clustering algorithm [10]. Bryant and Cios proposed a new density based clustering algorithm RNN-DBSCAN, which uses the reverse nearest neighbor count as the estimation of observation density [11]. Guo et al. proposed a multitarget recognition method based on prior independent density noise application spatial clustering (PI-DBSCAN) algorithm [12]. Wang and Lin proposed an improved adaptive parameter density clustering algorithm, which uses kernel density estimation to determine the reasonable interval of EPS and minPts parameters [13]. Zhang et al. proposed an image mosaic algorithm based on DBSCAN and mutual information [14].In the area of data processing, Deng et al. proposed an improved quantum-inspired differential evolution algorithm for deep belief network [15]. Song et al. proposed a multipopulation parallel coevolutionary differential evolution for parameter optimization [16]. Deng et al. designed a differential evolution algorithm with wavelet basis function and optimal mutation strategy for complex optimization problem [17]. Song et al. designed an enhanced success history adaptive DE for parameter optimization of photovoltaic models [18]. Deng et al. proposed an enhanced MSIQDE algorithm with novel multiple strategies for global optimization problems [19].However, DBSCAN is very sensitive to user-defined parameters. Subtle differences may lead to very different results. However, the selection of parameters is irregular and can only be determined by experience. But it is difficult to set the cluster radius and parameter threshold minPts. At present, there are few researches on the detection of big data outliers in buoy telemetry and remote control, and most of them stay in the qualitative analysis stage, while the quantitative research is less, and the research is not deep enough.The novelty of this paper is summarized as follows: According to the position data of Xiamen Bay light buoy, this paper counts the length and width of the rectangle outside the light buoy offset position to analyze its offset range. According to the offset distance and the adaptive clustering parameters of the wind, current, and wave data in the water area where the light buoy is located, an anomaly detection algorithm based on improved adaptive DBSCAN clustering is designed. The size of theϵ neighborhood is adaptive according to the wind speed, wave height, and drift distance span of the water area where the light buoy is located.


## 2. DBSCAN Clustering

There are several definitions in DBSCAN:ϵ neighborhood: the area within the radius of a given object called the neighborhood of the object;input: database containingN points, radius e, and minimum number of points minPts; and output: all generated clusters meeting the density requirements.(1)
Detect objectP that has not been checked in the database. If P is not processed (classified as a cluster or marked as noise), check its neighborhood. If the number of objects contained is not less than minPts, establish a new cluster C, and add all the points in it to the candidate set N.(2)
For all the unprocessed objectsq in the candidate set n, the neighborhood is checked. If there are at least minPts objects, these objects are added to N; if q is not included in any cluster, q is added to C; if q is not included in any cluster, q is added to C.(3)
Repeat step (2), continue to check the unprocessed objects inN, and the current candidate set n is empty.(4)
Repeat steps (1)∼(3) until all objects are clustered or labeled as noise. That is, the core point and the points around it are divided into a cluster, and the boundary point is divided into the cluster of the points around it.


## 3. Statistics of the Migration Law of the Light Buoy in Xiamen Bay

According to the position data of Xiamen Bay light buoy, count the length and width of the rectangle outside the light buoy offset position to analyze its offset range. The offset values of each light buoy are shown in Table1.Table 1
Drift range of Xiamen Bay light buoy (unit: m).
BuoyLatitude distance ΔφLongitude distance Δλ3#78.968.94#65.571.125#41.1156.676#73.3707#88.987.788#77.7897.239#96.610010#75.573.3411#84.49011A#81.178.912#91.185.5613#88.996.6814#65.563.3414A#80.054.4515#71.667.716#60.067.717#68.873.218#72.274.419#62.273.320#55.083.321#47.066.622#43.167.722A73.397.723#68.898.124#44.477.728#57.799.729#63.373.3It can be seen from the statistical data that the mean value of the South-North migration range of Xiamen Bay light buoy is 69.5 m, so the mean value of South or North migration is about 35 m. The mean value of East-West migration is 78.3 m, so the mean value of East-West migration is about 39 m, which is far less than the theoretical value.According to the empirical analysis, after several large and small tides, the anchor chain near the sinking rock is gradually silted into the seabed to form the ground chain, which will make the actual anchor point of the light buoy shift, and the actual length of the revolving anchor chain is far less than the total length of the anchor chain, which reduces the offset range of the light buoy floating body. The direction of the resultant force of wind and current determines the direction and distance of the light buoy. The wind and current of Xiamen port have their own characteristics. In the waters near the channel, the flow direction is mostly along the channel, which is a reciprocating flow. The normal wind direction of Xiamen Bay is ENE, and the strong wind directions are SE and SW. The phenomenon of monsoon is obvious. From September to March of the next year (spring and winter), northeast East Monsoon prevails with high wind speed, while, from April to August, southeast wind prevails with low wind speed. These characteristics of wind and current determine that the light buoy may pass through a certain position frequently in the range of its active water area, and the frequency is higher. In this section, the frequency of Xiamen Bay light buoy at different position points is counted, and the center coordinates of geometric shapes of each light buoy position data set containing no less than 80% position data points are calculated. On this basis, the characteristics of light buoy offset are analyzed.The high-frequency position points and their geometric centers of the light buoys in Xiamen Bay are shown in Figure1. In the figure, the blue five-pointed star is the geometric center of the high-frequency position points of the light buoys, the blue triangle is the position of the sinking stone, and the blue polygon is the envelope line containing at least 80% of the position data points. The geometric center of high-frequency position points of each light buoy is shown in Table 2.Figure 1
Buoy offset high-frequency position and its geometric center. (a) 3#. (b) 4#. (c) 5#. (d) 6#. (e) 7#. (f) 8#.
(a)(b)(c)(d)(e)(f)Table 2
Geometric center coordinates of high-frequency position points of light buoys in Xiamen Bay.
BuoyLatitudeφ (°) (N)Longitudeλ (°) (E)3#24.22753118.27804#24.2238118.27305#24.25203118.25596#24.24756118.25137#24.27805118.23288#24.27425118.22749#24.30664118.207510#24.2084118.203611#24.32106118.194511A#24.33722118.175812#24.32244118.178412A#24.33614118.167913#24.35297118.157614#24.34857118.153314A#24.35335118.148615#24.3699118.138116#24.36658118.133617#24.38412118.124518#24.38336118.117319#24.40753118.101820#24.39617118.104821#24.41279118.091322#24.40678118.091622A#24.4141118.079423#24.422118.075324#24.41822118.072128#24.42986118.051129#24.43668118.0529


## 4. Anomaly Detection Based on Improved Adaptive DBSCAN Clustering

This paper adopts the parameter of adaptive clustering. The size of the neighborhood is adaptive according to the wind speed, wave height, and drift distance span of the water area where the light buoy is located. The specific values are as follows:(1)ε=1+vwindvwindm+vwavevwavemεm,εm=maxΔλλ,Δφφ,where vwind is the absolute value of wind speed in the water area, vwindm is the maximum value of wind speed in the water area, vwave is the absolute value of wave height in the water area where the light buoy is located, vwind is the maximum value of wave height in the water area where the light buoy is located, Δφ is the North-South distance span of the light buoy drift, Δλ is the East-West distance span of the light buoy drift, φ is the latitude, and λ is longitude of the light buoy drift.API is the abbreviation of application program interface. The API of Chuanxun is a set of JavaScript functions, which can avoid the professional and complex GIS technology and simply and conveniently embed the chart and shipping position service of Chuanxun into your own business system or website, display and manage the shipping position on the background of electronic chart, and integrate with business data. Use the third-party map service API to quickly build and obtain real-time marine meteorological data.DenoteT as the time needed to find the points in EPS domain. N is the number of points. The time complexity of the algorithm is O (NT). The worst case time complexity is O (N2).In low-dimensional or high-dimensional data, the spatial complexity isO (N). For each point, it only needs to maintain a small amount of data, that is, the cluster label and the identification of each point (core point or boundary point or noise point).The deviations of light buoy are not equal in all directions. Under the action of wind, current, ship traveling wave, and other external forces, the deviation direction of each light buoy may have different “preferences”; that is, it will move in a small area of water in more time. The difference of light buoy migration between the inner and outer sections of Xiamen Bay is closely related to the geographical environment and flow characteristics of the port area. The sea surface in the foreign navigation section is relatively open, and the wind force in Xiamen Bay is mostly northeast wind and southwest wind. Therefore, the influence of wind on the offset of the optical buoy is not affected by the terrain conditions. However, for the inner leg, Xiamen Island is blocked on the north side of the #12 light buoy, and Jinmen Island is blocked on the east side. Due to the shelter of these islands, the influence of wind on buoy deviation will be weakened. This makes the influence of wind on the light buoy in the outer harbour greater than that in the inner one.


## 5. Experiment and Analysis

### 5.1. Data Clustering of Light Buoy Telemetry and Telecontrol

The deviations of light buoy are not equal in all directions. Under the action of wind, current, ship traveling wave, and other external forces, the deviation direction of each light buoy may have different preferences; that is, it will move in a small area of water in more time. Figure2 shows light buoy clustering results.Figure 2
Light buoy clustering results. (a) 38#. (b) 43#. (c) 45#. (d) 34#. (e) 36#. (f) 37#. (g) JT14#. (h) JT15#. (i) JT16#. (j) JT22#.
(a)(b)(c)(d)(e)(f)(g)(h)(i)(j)According to the scatter diagram of the light buoy, the offset range of the light buoy and the offset rule of the light buoy under the influence of wind and current are analyzed.


### 5.2. Comparison of Different Algorithms

Table3 shows the reference position of the light buoy.Table 3
Reference position of Xiamen Bay light buoy.
BuoyAnchorage offset (m)Cyclotron radius (m)Total length of anchor chain/m338.39.382.5654.817.82834.420.03149.212.56094216.655.0Table4 shows the comparison of clustering results between ADBSCAN algorithm and basic DBSCAN algorithm. The abnormal point is considered to be the point where the distance from the sinking position exceeds the length of the anchor chain. It can be seen that, using the basic DBSCAN algorithm, sometimes the hot spot water area of the light buoy position and the most likely area in the light buoy migration process are also regarded as noise points.Table 4
Comparison of different algorithms.
DBSCAN (%)ADBSCAN (%)4#90969#959710#969911#909518#899324#919228#9396


## 5.1. Data Clustering of Light Buoy Telemetry and Telecontrol

The deviations of light buoy are not equal in all directions. Under the action of wind, current, ship traveling wave, and other external forces, the deviation direction of each light buoy may have different preferences; that is, it will move in a small area of water in more time. Figure2 shows light buoy clustering results.Figure 2
Light buoy clustering results. (a) 38#. (b) 43#. (c) 45#. (d) 34#. (e) 36#. (f) 37#. (g) JT14#. (h) JT15#. (i) JT16#. (j) JT22#.
(a)(b)(c)(d)(e)(f)(g)(h)(i)(j)According to the scatter diagram of the light buoy, the offset range of the light buoy and the offset rule of the light buoy under the influence of wind and current are analyzed.


## 5.2. Comparison of Different Algorithms

Table3 shows the reference position of the light buoy.Table 3
Reference position of Xiamen Bay light buoy.
BuoyAnchorage offset (m)Cyclotron radius (m)Total length of anchor chain/m338.39.382.5654.817.82834.420.03149.212.56094216.655.0Table4 shows the comparison of clustering results between ADBSCAN algorithm and basic DBSCAN algorithm. The abnormal point is considered to be the point where the distance from the sinking position exceeds the length of the anchor chain. It can be seen that, using the basic DBSCAN algorithm, sometimes the hot spot water area of the light buoy position and the most likely area in the light buoy migration process are also regarded as noise points.Table 4
Comparison of different algorithms.
DBSCAN (%)ADBSCAN (%)4#90969#959710#969911#909518#899324#919228#9396


## 6. Conclusion

In this paper, an improved adaptive DBSCAN clustering based anomaly detection method is proposed for remote sensing data of light buoy. In the future, the clustering algorithm will be further improved, and the research results will be applied to the buoy telemetry and telecontrol data outlier cleaning.



---

*Source: 5522107-2021-05-28.xml*