# Inferring visual biases in uav videos from eye movements

Anne-Flore Perrin, Lu Zhang, Olivier Le Meur

► To cite this version:

Anne-Flore Perrin, Lu Zhang, Olivier Le Meur. Inferring visual biases in uav videos from eye movements. Drones, 2020, 4 (3), pp.1-25. 10.3390/drones4030031. hal-03002080

HAL Id: hal-03002080

https://hal.science/hal-03002080

Submitted on 12 Nov 2020

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
<figure><img src="image_2.png" /></figure>

Article

# Inferring Visual Biases in UAV Videos from Eye Movements

Anne-Flore Perrin<sup>1,2,*</sup> <u>D</u>, Lu Zhang<sup>2</sup> <u>D</u> and Olivier Le Meur<sup>1</sup> <u>D</u>

Received: 3 June 2020; Accepted: 30 June 2020; Published: 4 July 2020

<figure><img src="image_3.png" /></figure>

check for
updates

**Abstract:** Unmanned Aerial Vehicle (UAV) imagery is gaining a lot of momentum lately. Indeed, gathered information from a bird-point-of-view is particularly relevant for numerous applications, from agriculture to surveillance services. We herewith study visual saliency to verify whether there are tangible differences between this imagery and more conventional contents. We first describe typical and UAV contents based on their human saliency maps in a high-dimensional space, encompassing saliency map statistics, distribution characteristics, and other specifically designed features. Thanks to a large amount of eye tracking data collected on UAV, we stress the differences between typical and UAV videos, but more importantly within UAV sequences. We then designed a process to extract new visual attention biases in the UAV imagery, leading to the definition of a new dictionary of visual biases. We then conduct a benchmark on two different datasets, whose results confirm that the 20 defined biases are relevant as a low-complexity saliency prediction system.

**Keywords:** visual salience; Unmanned Aerial Vehicles (UAV); typical videos; visual attention; eye tracking; surveillance; biases; center bias

## 1. Introduction

Visual attention is the mechanism developed by the Human Visual System (HVS) to cope with the large quantity of information it is presented with. This capacity to sort out important information and to discard others can be represented thanks to visual salience representations. Saliency maps show the statistical distribution of human eye positions when seeing visual stimuli. There are many factors influencing where we look at, such as the visual content, the task at hand, and some systematic tendencies. We investigate the latter point in this paper in the specific context of Unmanned Autonomous Vehicles (UAVs) videos.

When watching natural scenes on a screen, observers tend to look at the center irrespective of the content [1,2]. This center bias is attributed to several effects such as the photographer bias [2], the viewing strategy, the central orbital position [3], the re-centering bias, the motor bias [4,5], the screen center bias [1], and the fact that the center is the optimized location to access most visual information at once [1]. It is usually represented as a centered isotropic Gaussian stretched to the video frame aspect ratio [6,7]. Other biases are present in gaze deployment, mainly due to differences in context, i.e., observational task [8], population sample [9], psychological state [10], or content types [11–13]. Biases are studied through various modalities, such as reaction times for a task [8,9], specifically designed architecture [9] or through hand-crafted features describing salience or fixations [11]. Note that, except for the center bias, we are not aware of visual attention biases that take the form of saliency patterns.

UAV imagery is getting momentum with the multiplication of potential applications it offers, i.e., new delivery services, journalism [14], and security and surveillance systems [15–17]. This imaging

<footnote n="1"><sup>1</sup> Univ Rennes, CNRS, IRISA, 263 Avenue Général Leclerc, 35000 Rennes, France; olemeur@irisa.fr</footnote>

<footnote n="2"><sup>2</sup> Univ Rennes, INSA Rennes, CNRS, IETR—UMR 6164, 35000 Rennes, France; lu.ge@insa-rennes.fr</footnote>

<footnote>* Correspondence: anne-flore.perrin@irisa.fr; Tel.: +33-2-9984-2573</footnote>
differs from conventional contents on various aspects. For instance, the photographer bias is not the same due to the special training and visual routines required to control the aerial sensor [18,19]. Shot images and videos represent objects under a new and unfamiliar birds' perspective, with new camera and object motions, among others [20]. We thus wonder whether such variations impact visual explorations of UAV contents.

A first element of answer is proposed in previous works [21,22] that put into question the presence of center bias in UAV videos. We also claim that existing saliency models fail to predict saliency in UAV contents [21] because they are trained on unrepresentative ground truths. We thus aim to show a difference in attentional allocation between human saliency maps of typical and UAV sequences. To do so, we define a set of handcrafted features to represent UAV human saliency maps in a high-dimensional space and to discriminate them.

We then propose to dig further the question to understand and find out visual attention biases in UAV videos. Our aim is to produce a dictionary of biases possibly fed as priors to static or dynamic saliency prediction models. It is a widespread solution to improve saliency models, and it can take several forms. For instance, in [23], the dynamic two-streamed network includes a handmade dictionary of 2D centered-Gaussians which provides different versions of the center bias. To the best of our knowledge, it is the first time that one empirically extracts a dictionary of biases for UAV videos.

Our biases extraction follows a similar pipeline than a current attempt to analyze saliency patterns in movie shots to explore cinematography dynamic storytelling [24]. Their pipeline includes the definition of features (saliency maps predicted by Deep Gaze II [25]), a dimension reduction operation through a principal component analysis, and finally clustering using K-means.

Regarding the UAV ecosystem, deep learning is a mainstream tool for numerous applications, i.e., automatic navigation of UAV [19,26,27], object [27] or vehicle tracking [28–30], and (moving) object detection [31,32] under real-time constraints [33]. Some works combine both object detection and tracking [34–37] or implement the automation of aerial reconnaissance tasks [38]. However, only a minority of works take benefits from Regions of Interest (ROI) [27,39], sometimes in real time [40], which is a first step towards considering visual attention. We believe that saliency, and in particular a dictionary of biases, will enable the enhancement of current solutions, even in real-time applications.

In the remainder of the paper, we describe in Section 2 the material and followed methodology. It includes a description of conventional and UAV video datasets in Section 2.1, as well as the handcrafted features extracted from human saliency and fixation maps to represent visual salience in a high dimensional space in Section 2.2. We then verify the clear distinction between conventional and UAV videos saliency-wise using data analyses in Section 2.3. Interestingly, the used T-distributed Stochastic Neighbor Embedding (t-SNE) [41] representation presents differences within UAV saliency patterns. On this basis, biases in UAV videos are designed in Section 2.4. A benchmark is presented in Section 2.5 on two datasets—EyeTrackUAV1 and EyeTrackUAV2—to evaluate the relevance and efficiency of biases based on typical saliency metrics. Results are provided in Section 3 and discussed in Section 4. Finally, Section 5 concludes on the contributions of this work.

## 2. Materials and Methods

### 2.1. *Datasets*

Visual salience is an active field that tackles various issues such as segmentation [42], object recognition [43–45], object and person detection [46,47], salient object detection [48,49], tracking [50,51], compression [52,53], and retargeting [54]. Accordingly, numerous eye tracking datasets have been created for typical images [6,55–58]. To a lesser extent, it is possible to find datasets on videos [23,59–61]. Eventually, datasets on specific imaging (e.g., UAV videos) are getting growing attention and are being developed [20,22,62].

In this study, we consider only gaze information collected in free-viewing conditions. Observers can explore and freely appreciate the content.
### 2.1.1. Typical Videos

Among available datasets, the DHF1K [23] is the largest one for dynamic visual saliency prediction. It is a perfect fit for developing saliency models as it includes 1000 (640 × 360) video sequences covering a wide range of scene variations. A 250 Hz eye tracking system recorded the gaze of 17 observers per stimuli under free-viewing conditions. We used the videos available in the training set (i.e., 700 videos), together with their fixation annotations. We have computed the human saliency maps following the process described in [22] to have comparable maps with the UAV videos dataset.

### 2.1.2. UAV Videos

In this regard, this study investigates the 43 videos of EyeTrackUAV2 (30 fps, 1280 × 720 and 720 × 480) [22], the largest and latest public gaze dataset for UAV content. Gaze information were recorded at 1000 Hz on 30 participants visualizing content extracted from datasets DTB70 [63], UAV123 [64], and VIRAT [65]. It presents a wide range of scenes, in terms of viewing angle, distance to the scene, among others. Besides, EyeTrackUAV2 was created in view to provide both free-viewing and surveillance-based task conditions. There are indeed contents compliant with objects detection and tracking, and contents with no salient object. We used fixation and human saliency maps generated from binocular data under free-viewing conditions, as recommended in the paper.

Last, in order to prove the external validity of results, we include the EyeTrackUAV1 dataset [20] in the benchmark of biases. This dataset includes 19 sequences coming from UAV123 (1280 × 720 and 30 fps). Saliency information was recorded on 14 subjects under free-viewing conditions at 1000 Hz. Overall, the dataset comprises eye tracking information on 26,599 frames, which represents 887 s of video.

## 2.2. Definition and Extraction of Hand-Crafted Features

Extracting features from gaze information has a two-fold role. First, it enables the representation of saliency maps in a high dimensional space. Thanks to this representation, we expect to discriminate types of imaging and show the importance of developing content-wise solutions. Second, we also expect to find out specific characteristics, that would reveal discrepancies in gaze deployments occurring on conventional and UAV content. Those specific characteristics could be used to approximate content-wise biases. Note that in such case only features that can parameterize biases will be kept. We extract statistics for each frame based on the four representations, described below.

1. Human Saliency Maps (HSMs)

2. Visual fixation features

3. Marginal Distributions (MDs) of visual saliency

4. 2D K-means and Gaussian Mixture Models (GMM) of fixations

### 2.2.1. Human Saliency Maps

Saliency maps are 2D topographic representations highlighting areas in the scene that attract one's attention. HSMs result from the convolution of the observers' fixations with a Gaussian kernel representing the foveal part of our retina [66]. In the following, a human saliency map at time t is defined as $I_t: \Omega \subset \mathbb{R}^2 \to \mathbb{R}^+$, where $\Omega = [1...N] \times [1...M]$ with N and M the resolution of the input. Moreover, let $p_i$ be the discrete probability of the pixel $i = (x, y)$ to be salient. The probability $p_i$ is then defined as follows, such that $0 \le p_i \le 1$ and $\sum_{i \in \Omega} p_i = 1$:

$$p_i = \frac{I_t(i)}{\sum_{j \in \Omega} I_t(j)} \qquad (1)$$

From human saliency maps, we extract overall spatial complexity features and short-term temporal features as described below.
**Energy:** The energy of a pixel is the sum of the vertical and horizontal gradient absolute magnitudes. A Sobel filter of kernel size 5 is used as derivative operator. We define as features the average and standard deviation (std) of $E_t$ over all pixels of a frame.

$$E_t(\mathbf{i}) = \left| \frac{\partial I_t(\mathbf{i})}{\partial x} \right| + \left| \frac{\partial I_t(\mathbf{i})}{\partial y} \right| \qquad (2)$$

High energy mean would indicate several salient regions or shape-wise complex areas of interest, whereas low energy would indicate more simple-shaped or single gaze locations.

**Entropy:** Shannon entropy is then defined as follows.

$$sE = - \sum_{\mathbf{i} \in \Omega} p_{\mathbf{i}} \log(p_{\mathbf{i}}) \qquad (3)$$

A high value of entropy would mean that the saliency map contains a lot of information, i.e., it is likely that saliency is complex. A low entropy indicates a single zone of salience.

**Short-term temporal gradient:** We used a temporal gradient to characterise the difference over time in visual attention during a visualization. This gradient is computed as follows, with $G_{tmax}(\mathbf{i}) = 0$,

$$G_t(\mathbf{i}) = |I_t(\mathbf{i}) - I_{t+1}(\mathbf{i})| \qquad (4)$$

A large gradient transcribes a large movement between $I_t$ and $I_{t+1}$.

### 2.2.2. Visual Fixation Features

We retrieve fixations from eye positions performing a two-step spatial and temporal threshold, the Dispersion-Threshold Identification (I-DT) [20,67]. Spatial and temporal thresholds were selected to be equal to 0.7 degree of visual angle and 80 ms, respectively, according to [68].

The fixation number can be representative of the number of salient objects in the scene. Their position may also indicate congruence between subjects [11,69]. We thus include the **number of fixations** per frame as features as well as the **number of clusters** derived from fixation positions.

The number of clusters is computed through two off-the-shelf typical clustering techniques [70,71], namely the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) [72] and the Hierarchical extension of it (HDBSCAN) [73]. Regarding settings, we set the minimum number of points per cluster to 2. Other parameters were left to default values in python libraries (hdbscan and sklearn), such as the use of the euclidean distance.

### 2.2.3. Marginal Distributions

A marginal distribution describes a part of a multi-variable distribution. In our context, MDs represent vertical and horizontal salience, i.e., the sum of relative saliency of pixels over columns ($p_v$) and rows ($p_h$), respectively. MDs are computed as follows.

$$p_h(x) = \sum_{y \in \{1..M\}} p_i(x, y), \quad p_v(y) = \sum_{x \in \{1..N\}} p_i(x, y) \qquad (5)$$

Several illustrations of horizontal and vertical marginal distributions of UAV HSMs are provided in Figure 1 to qualitatively support the claim that the center bias does not necessarily apply to UAV contents. Accordingly, several descriptors of marginal distributions bring knowledge on horizontal and vertical saliency, which enables to study whether the center bias applies to UAV videos. Moreover, these parameters may be of capital importance when designing UAV parametric biases based on experimental data. From horizontal and vertical MDs, we extract the following features.
<figure><img src="image_4.png" /><figcaption>**Figure 1.** Human Saliency Maps and their Marginal distributions of frame 165 for four sequences of EyeTrackUAV2.</figcaption></figure>

**Moments:** empirical mean, variance, skewness, and kurtosis. Moments characterise the shape of a distribution. According to Fisher and Pearson's works [74], we express the kth moment as follows,

$$ \mu^k = \frac{1}{n} \sum_{x=0}^{n} (p_{md}(x) - \bar{p})^k \qquad (6) $$

where $p_{md} \in \{p_h, p_v\}$ is the marginal distribution, $n \in \{N, M\}$ is the number of samples in $p_{md}$, and $\bar{p}$ is the empirical mean of the distribution.

**Median and geometric mean:** A Gaussian distribution mean is equal or similar to its geometric mean and median. Thus, these two values help characterizing further marginal distributions, as well as indicate “how far” from a 1D single-Gaussian distribution marginal distributions are.

### 2.2.4. 2D K-Means and Gaussian Mixture Models

Single and multiple clusters are formed from fixation positions. We use K-means and GMMs to approximate the features of these groups. On the one hand, a single cluster brings knowledge about general behavior. On the other hand, having several batches allows for a more precise data depiction. Besides, the group expressing the largest variance is particularly interesting to express saliency when opposed to a single cluster. We thus ran both algorithms to approximate a single cluster as well as multiple classes. We characterize only the most representative batch in the latter scenario.

**K-means** [75] is the most used clustering algorithm in machine learning due to its accuracy, simplicity, and low complexity. We define as feature the center position of a cluster. Two features are thus extracted, one from a single batch, the second from the most representative group—in terms of fixations number—of a multi-clustering. Regarding implementation details, HDBSCAN algorithm gives the number of classes, and all runs follow a random initialization.

**Gaussian Mixture Models:** Similarly to K-means, we consider a single Gaussian and the Gaussian in the GMM that accounts for the highest variance. Extracted features are their means, covariance matrices, and variance (i.e., the extent of fixation points covered by the Gaussian).

### 2.2.5. Overall Characteristics

We extract 38 characteristics per frame. Table 1 summarizes the features describing human saliency maps. When considering the entire sequence, means and standard deviations of these components are extracted temporally, i.e., over the entire set of frames. This gives 76 features per video, independently of the sequences' number of frames. As a side note, all features relative to a position have been normalized to be free from datasets resolutions.
<table><caption>**Table 1.** Number of features extracted per frame and per sequence.</caption><thead><tr><th>Description Level</th><th>Source Data</th><th>Features</th><th>nb Features</th></tr></thead><tbody><tr><td rowspan="4">Frame</td><td>Saliency maps</td><td>Energy mean and std, entropy, temporal gradient mean and std</td><td>5</td></tr><tr><td>Fixations</td><td>Number of fixations, DBSCAN and HDBSCAN number of clusters</td><td>3</td></tr><tr><td>Marginal distribution</td><td>First to fourth degree moments, geometric mean and median of marginal distributions</td><td>12</td></tr><tr><td>Gaussian mixture models</td><td>Center coordinates of K-mean algorithm (with one and HDBSCAN number of clusters) together with means and covariances of the most representative 2D Gaussian of 1- and HDBSCAN-GMM, and proportion of variance explained by these Gaussians</td><td>18</td></tr><tr><td>Sequence</td><td>All</td><td>Mean and std of all precedent characteristics over time</td><td>76</td></tr></tbody></table>

## 2.3. Visualization and Classifications

In this section, we want to verify whether attention in typical and UAV content exhibits different patterns. We already know that some sequences of EyeTrackUAV2, mainly originating from the VIRAT dataset, are likely to present a center bias and thus have similar HSMs than those of conventional videos. On the contrary, we expect other sequences, originating from DTB70 and UAV123, to present HSMs with different biases, as claimed in [21,22].

Before exploring and generating biases, we visualize data in a low-dimensional space, thanks to the t-SNE technique [41]. This process maps elements in a 2D space accordingly to the distribution of distances in the high-dimension space. It is a current technique to classify and discriminate elements [76,77]. The t-SNE is advantageous for two reasons: it enables visualization, and most importantly, it comprehensively considers all dimensions in its representation. In our context, the t-SNE shows distance differences between saliency maps based on extracted features and discriminates content-based peculiarities.

If the t-SNE algorithm clusters typical HSMs separately from UAV HSMs, per sequence and frame, this attests that there are different visual attention behaviors in UAV imaging. Otherwise, there is no point in performing biases identification. This is a crucial step towards content-wise biases creation as we first verify there are distinctions between conventional and UAV HSMs and thus justify the existence of such biases. Second, we can determine clusters in which saliency characteristics are similar and learn biases based on the t-SNE 2D distance measure.

### 2.3.1. Discrimination between Salience in Typical and UAV Content

As recommended in [78], we paid close attention to hyperparameters selection of the t-SNE method. Therefore we verified several perplexity values (e.g., 2, 5, 10, 15, 20, 30, and 50) for each t-SNE run. To stay in line with previous settings, the minimum of components is 2 and distances are euclidean. Any t-SNE starts with random initialization, runs with a learning rate of 200, and stops after 1000 iterations.

The process was applied on all UAV contents of EyeTrackUAV2 and the 400 first videos of the DHF1K dataset. This represents an overall number of 275,031 frames, 232,790 for typical and 42,241 for UAV content. We considered all features when dealing with frames, while we computed the temporal average and std of feature values when dealing with sequences. In addition, we ran the t-SNE on Marginal Distribution (MD) parameters only, to verify whether they have the abilities of a separability criterion. If so, they can help to reconstruct biases.

## Results

All results follow similar tendencies over all tested parameters. They are described and illustrated in Figure 2 with perplexity 30. In Figure 2a, we added the thumbnails of the first frame of sequences for more readability. Colors were attributed to the points, or to the thumbnails, depending on the dataset that elements are originating from. In Figure 2a, we can observe the spread of HSMs in the space, per sequence and considering all features. We note that UAV videos (colored) are located moderately apart from conventional videos, especially these coming from UAV123 (red) and DTB70 (green). Furthermore, most of UAV VIRAT videos (blue) are closer to typical sequences than other UAV content. These sequences are possibly sharing saliency characteristics with certain conventional videos. This fact
supports previous claims, in that the majority of VIRAT HSMs present a center bias. It is also striking that traditional videos are separated into two large clusters. This could be further explored, though not in this paper as it would get out of the scope of our study.

<figure><img src="image_5.png" /><figcaption>**Figure 2.** t-SNE learnt on all features and marginal distribution characteristics, on sequence and frame data (perplexity values 30). We can see that most points representing UAV content are in areas of the space not covered by typical points, and that there are various clusters of UAV points.</figcaption></figure>

Figure 2b depicts how HSMs spread spatially for each frame, based on all extracted features. We can observe a huge set of close clusters toward the center of the space, containing mainly DHF1K frame representations, with a fair proportion of VIRAT points and some UAV123 maps. At the borders, we can observe a lot of small batches, formed mainly by UAV contents. These clusters are more distant to their neighbors than those in the center of the space. That is, it makes sense to study various biases in UAV videos as there are numerous batches of UAV content representations clearly distinct from other groups.

Figure 2c presents the dispersion of HSMs, per frame and based on marginal features only. As for the previous observations (see Figure 2b), we observe a distinction between representations of typical and UAV content, with UAV clusters at the borders and more distant to other batches. A difference stands in that we find more VIRAT points within centered groups.

Based on the three illustrations, and considering the generalization of these results over other values of perplexity and features sets, we can proceed with the identification of biases in UAV content. It is also reasonable to rely only on marginal distributions characteristics to generate these biases.
### 2.3.2. Clustering of UAV Sequences

In this section, the focus is set on UAV sequences only as we aim to derive the attentional biases. In other words, from t-SNE representations, we aim to identify clusters of different gaze deployment habits in UAV visualizations. Initially, biases are regarded as generic behaviors that are found consistently in visual attention responses. Here, we specifically want to extract prevailing and UAV-specific biases.

In pilot tests, we have tried generating a dictionary of biases via a systematic variation of parameters of an anisotropic 2D Gaussian distribution. We also created a dictionary with the human means of the 43 sequences of EyeTrackUAV2. Results, comprising usual similarity metrics of the saliency field applied on biases and HSMs, showed weak performances. These studies emphasized the need to derive patterns of salience from HSMs directly. Additionally, parameters on which we cluster HSMs must be used for the construction of parametric biases. That points out the exclusion of some previous handcrafted features, such as statistics on HSMs and fixation features, hardly useful to generate parametric biases. Besides, we want biases free from any constraints, which excludes 2D K-means and GMM predictions that require prior knowledge. Thus, we focus on marginal distributions features to classify UAV sequences. Moreover, the previous section has emphasized their relevance.

We thus performed a t-SNE with a low perplexity to derive our clusters based only on MDs parameters on EyeTrackUAV2 sequences. Perplexity can be seen as a loose measure of the effective number of neighbors [41]. We thus selected a perplexity of 5 to have about eight clusters. It is a compromise between being content-specific and deriving meaningful and prominent patterns. We also ran several iterations of t-SNE, with perplexity 2, 10, and 20, to ensure the robustness of the obtained classification.

In line with previously defined settings, we relied on the 2D-Euclidean distance in the t-SNE representation to compute the similarity between samples. We computed a confusion matrix based on a hierarchical clustering algorithm (dendrogram) implemented with the Ward criterion [79,80]. The Ward variance minimization algorithm relies on the similarity between clusters centroïds. Hierarchical clustering is highly beneficial in our context as it is less constrained than K-means. There is no need for prior knowledge, such as a number of classes, number of elements in groups, or even whether batches are balanced.

#### Results

Following the tree architecture, sequences showing a Ward dissimilarity under 150 are forming clusters. We ultimately determine seven classes to learn content-wise biases. Results are compiled in Figure 3 and Table 2. Figure 3a presents this distance matrix between sequences HSMs. Figure 3b shows the t-SNE spatial dispersion of sequences and outlines the seven groups. Human Means (HMs) thumbnails allow verifying the similarity between sequences HSMs in clusters.

Overall, most classes show homogeneous human means. For instance, in group II, there is a recurrent vertical and thin salient pattern. The most heterogeneous batch would be cluster IV, for which the averaging process used to generate HMs may not be an optimal temporal representation. Finally, Table 2 describes clusters, their number of sequences, and the number of frames it embodies. To make up for the hardly readable axes on Figure 3a, Table 2 follows the order of sequences used to form the confusion matrix.

<table><caption>**Table 2.** Clusters, their sequences, number of sequence, and frame.</caption><thead><tr><th>I</th><th>II</th><th>III</th><th>IV</th><th>V</th><th>VI</th><th>VII</th></tr><tr><th>6 seq., 4891 frames</th><th>7 seq., 10694 frames</th><th>2 seq., 613 frames</th><th>7 seq., 8932 frames</th><th>8 seq., 9549 frames</th><th>5 seq., 2435 frames</th><th>8 seq., 5127 frames</th></tr></thead><tbody><tr><td>Soccer1<br>09152008flight2tape1_3 crop2</td><td>ManRunning2<br>car4</td><td>Girl1<br>Walking</td><td>ManRunning1<br>car14</td><td>09152008flight2tape1_3 crop1</td><td>building1<br>car11</td><td>Girl2<br>Basketball</td></tr><tr><td>truck3<br>09152008flight2tape3_3 crop1</td><td>wakeboard8<br>car3<br>car9<br>car1<br>car2</td><td></td><td>09162008flight1tape1_1</td><td>09152008flight2tape2_1</td><td>person22<br>building3</td><td>bike2<br>building2</td></tr><tr><td>car13<br>car15</td><td></td><td></td><td>09152008flight2tape2_5</td><td>09152008flight2tape1_5</td><td>streetBasketball<br>building3</td><td>truck4<br>car12</td></tr><tr><td></td><td></td><td></td><td>09162008flight1tape1_1</td><td>09152008flight2tape2_1</td><td>bike3</td><td>Soccer2<br>09152008flight2tape2_1</td></tr></tbody></table>
<figure><img src="image_6.png" /><figcaption>(a) t-SNE 2D Euclidean Distance-confusion Matrix</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>(b) t-SNE, p=5, threshold=150

**Figure 3.** Cluster selection from t-SNE.</figcaption></figure>

## 2.4. Extrapolation of Biases

This section introduces the process designed to generate parametric saliency biases for UAV imaging. First, we need to define which properties of HSM ground truth will be exploited to parameterize and generate biases. From the set of such features, we need to derive generic and prominent patterns. The entire process is described below and is summarized in Figure 4. At this point, sequences have been clustered based on their saliency marginal distribution features.
<figure><img src="image_8.png" /><figcaption>**Figure 4.** Pipeline describing the biases generation process. First, we compute vertical and horizontal marginal distribution of a frame, from which we extract means ($\mu$) and standard deviations ($\sigma$). Variations of these four features are studied through their distributions, over all frames of sequences in a cluster. The peaks of these distributions are extracted as biases parameters. Eventually, by combining values of peaks, we create a dictionary of biases. This process is applied on each cluster individually.</figcaption></figure>

### 2.4.1. Extraction of MDs Statistics

The idea of extracting biases roots in the prevalence of a center bias in generic audiovisual stimuli salience. The center bias is often represented by a centered isotropic Gaussian stretched to the video frame aspect ratio [6,7]. Here, we get free from the isotropic and centered characteristics of the Gaussian. Moreover, the stretching may not apply to UAV contents, which, for instance, often present smaller size objects. Under these considerations, biases are to be parameterized by a set of two mean and standard deviation parameters, representing the Gaussian center and spreading, respectively. Such 1D-Gaussian parameters are derived from MDs of the ground truth human saliency maps. That is, we compute mean and std values of the marginal distributions, horizontally and vertically, for each HSM frame of each sequence, i.e., $\mu_r, \sigma_r, \mu_c, \sigma_c$, and $\sigma_r, \sigma_c$, respectively. We will refer to these values as MDs statistics, to make the difference with MDs features.

Doing so, we assume that MDs follow 1D-Gaussian distributions horizontally and vertically. As we can see in Figure 1, this claim is reasonable if there is a behavior similar to single-object tracking (i.e., Figure 1a,b). However, it is more questionable when there is no object of interest (i.e., Figure 1c). Still, we believe this choice is sound for the following reasons.

* Averaging, and to a lesser extent getting the standard deviation, over the HSM columns and rows act as filtering unrepresentative behaviors.

* It is seldom to observe several areas of interest within a single HSM. Often, the congruence between observers is pretty low when it happens. For instance, such events may occur when there is a shift of attention from one object to another. Biases do not target to capture such behaviors. Besides, if there is no object of interest, we expect some biases to present center-bias alike patterns to deal with it.

* Plans are to use biases as a dictionary, and particularly to combine these derived salience patterns. This fact should cope with some of the inaccuracies made during this process.

* Last but not least, we are dealing with video saliency, i.e., a frame visualization lasts about 0.3 s. Assuming a 1D-Gaussian marginal distribution for a HSM, we make a rather small error. However, pooling these errors could reveal to be significant. Accordingly, the significance of error depends more on the strategy for biases parameters extraction from MDs statistics. We discuss this issue in the following section.

### 2.4.2. Local Maxima of MDs Statistics Distributions

The identification of biases parameters from MDs statistics is critical as it could introduce or exacerbate errors in priors predictions. To study patterns in MDs, the stress is laid on clustering, which serves the examination of prominent patterns within saliency-wise similar content. Consequently,
the investigation of biases patterns relies on distributions of MDs statistics over each cluster. Figure 5 presents the obtained distributions, named MDS-D.

<figure><img src="image_9.png" /><figcaption>**Figure 5.** Examples of MDs statistic distributions and the extracted peak values. Statistics are means ($\mu$) and standard deviation ($\sigma$) per columns (c) or rows (r). Associated values can be found in Table 3.</figcaption></figure>

<table><caption>**Table 3.** Position (in pixel) of local maxima in distributions of statistic values. These peaks are the future parameters necessary for biases generation. Highest peaks are highlighted in bold.</caption><thead><tr><th>Cluster</th><th>I</th><th>II</th><th>III</th><th>IV</th><th>V</th><th>VI</th><th>VII</th></tr></thead><tbody><tr><td>μ<sub>r</sub></td><td>236, 291, 416</td><td>102, 231, 292</td><td>245, 340</td><td>217, 491, 523, 570</td><td>238, 335, 361, 388, 449, 510</td><td>405</td><td>259, 343</td></tr><tr><td>σ<sub>r</sub></td><td>99, 170</td><td>115, 163</td><td>103, 177</td><td>107, 175</td><td>115, 171</td><td>82, 94, 153</td><td>83, 149</td></tr><tr><td>μ<sub>c</sub></td><td>91, 332, 640</td><td>210, 284, 643, 896</td><td>519, 577, 880</td><td>131, 376, 705, 1038</td><td>409, 695</td><td>712, 772</td><td>415, 683</td></tr><tr><td>σ<sub>c</sub></td><td>176, 307</td><td>85, 241, 279</td><td>223, 346</td><td>174, 282</td><td>150, 267, 358</td><td>207, 309</td><td>158, 315</td></tr><tr><td>Number of biases</td><td>36</td><td>72</td><td>24</td><td>64</td><td>72</td><td>12</td><td>16</td></tr></tbody></table>

It is straightforward that usual statistics over MDS-Ds, such as the mean, will not make meaningful, prevailing, and accurate bias parameters. Notions of preponderance, precision, and significance directly involve the computation of local maxima in distributions. Local maxima, also referred to as peaks, embed the aspect of likelihood, can be computed precisely, and give a value that is directly useful for biases generation.

To conduct a robust computation of local maxima, we estimate the probability density function of MDS-Ds using a Gaussian kernel density estimation (kde). Extrapolating the distribution exhibits two main advantages. First, we conduct a biases parameters extraction based on likelihood. This particularly fits the aim of biases. Second, probability density functions are less prone to noise, which could have dramatic results in extrema extractions, especially direct comparison of neighboring values.

We found important to include all local maxima, even if it means including less relevant future bias parameters. Besides, there is no strong basis to rely on regarding setting a threshold of meaningfulness of a peak. For instance, $II - \sigma_c$ shows a peak at 241, and similarly $III - \mu_c$ presents a maximum at 880, which would have been rejected with a precisely set threshold despite their likely
importance. Accordingly, a post-biases-creation filtering is needed to select the most relevant biases (see Section 3.1).

In order to create a comprehensive and exhaustive bank of biases, all possible combinations of MDS-D parameters are considered in the process. It means that in cluster I, there will be $\#\mu_r \times \#\sigma_r \times \#\mu_c \times \#\sigma_c = 3 \times 2 \times 3 \times 2 = 36$ patterns. Table 3 reports the values of peaks extracted from the distributions. It also indicates how many biases were generated per cluster.

### 2.4.3. Reconstruct Parametric 2D-Anisotropic Gaussian Biases

To construct a 2D-anisotropic Gaussian pattern, we need four parameters: the coordinates of the center of the Gaussian, and horizontal and vertical standard deviations. A bias is thus defined by the 2D-Gaussian of horizontal mean $\mu_c$ and std $\sigma_c$, and vertical mean $\mu_r$ and std $\sigma_r$. It forms a 1280 × 720 image resulting from the dot product of the 1D-Gaussian distributions formed horizontally and vertically (see Equations (7) and (8)). Bicubic interpolation is used to resize biases when dealing with VIRAT sequences, which have a smaller resolution.

$$ \text{Bias}(\mathbf{x}, \mathbf{y}, \mu_r, \sigma_r, \mu_c, \sigma_c) = \mathbf{G}(\mathbf{x}, \mu_r, \sigma_r)^T * \mathbf{G}(\mathbf{y}, \mu_c, \sigma_c) \quad (7) $$

$$ \text{with } \mathbf{G}(\mathbf{x}, \mu, \sigma) = \frac{1}{\sigma\sqrt{2\pi}} \exp\left(-\frac{(\mathbf{x} - \mu)^2}{2\sigma^2}\right) \quad (8) $$

where $\mathbf{x} = (1...720)$, $\mathbf{y} = (1...1280)$, and $T$ is the transpose operator. The formed patterns are calculated for each cluster, for each comparison of biases parameters. The dictionary reaches an overall number of 296, from which a subset is presented in Figure 6.

<figure><img src="image_10.png" /><figcaption>Figure 6. Examples of a bias extracted per cluster</figcaption></figure>

### 2.5. Biases Analyses

We conduct several analyses to verify that extracted biases are meaningful and representative of human deployment of visual attention in UAV videos. First, we examine the relative similarity between biases and the EyeTrackUAV2 dataset, overall, and per cluster. Results sort out biases by efficiency and lead to the selection of a reduced and reliable dictionary. It follows a qualitative analysis of the obtained dictionary.

Then, we aim to situate the efficiency of biases when compared to baselines and hand-crafted features saliency models. Additionally, we verify the external validity of the performance of extracted biases on EyeTrackUAV1. We thus conduct the benchmark on both EyeTrackUAV1 and EyeTrackUAV2.

Finally, we explore an additional function of the dictionary: improving static handcrafted features saliency models by filtering their results with biases. The results of these analyses will precise the potential usages of the dictionary.
### 2.5.1. Benchmark Metrics

All along this analysis, we employ typical saliency metrics. We made the decision to exclude metrics involving fixations on the basis that fixation extraction processes may interfere with the results. We want to get as free as possible from a possible dataset bias. Accordingly, we included three state-of-the-art saliency metrics recommended in the MIT benchmark [66,81]: Pearson's Coefficient of Correlation (CC), Similarity (SIM), and the Kullback Leibler divergence (KL).

**CC:** The range of the correlation metric goes from -1 to 1, 1 representing a perfect fit between the data.

**SIM:** Similarity measures a perfect fit between the data histograms as 1, and no similarity as 0.

**KL:** This metric exhibits a dissimilarity score, emphasising the error made during the prediction. It thus favors patterns with large variance in order to reduce the amount of error made. The score ranges from 0 to infinity (+∞), with having the lowest score the better.

Each metric is computed on every frame. Frame scores are then averaged over sequences, cluster or entire dataset. Although not being optimal regarding temporal considerations, it is the most widely used practice to evaluate dynamic salience [23,82–86].

### 2.5.2. Benchmark Multi-Comparisons

The aim of biases is to perform better than a conventional Center Bias (CB), and would ideally challenge handcrafted features saliency models (HCs) prediction accuracy. This section introduces the CB, HMs, and HCs stimuli compared to biases in the benchmark.

**The center bias** is a centered isotropic Gaussian stretched to video frame aspect ratio [7]. CB is a popular prior used in typical imaging. It thus sets a perfect baseline to measure biases.

**Human means** are the temporally averaged saliency maps over an entire sequence. It gives 19 HMs for EyetrackUAV1, and 43 for EyetrackUAV2.

**Handcrafted features saliency models:** Based on the work in [21], the selected HCs depict the range of prediction accuracy of most typical hand-crafted features saliency models. BVS [87], GBVS [88], and RARE2012 [89] being the most predictive models, SIM [90] and SUN [91] the least.

### 2.5.3. Handcrafted Features Saliency Models Filtered with Biases

Filtering HCs with biases will provide new insights for the power of prediction of biases and the information it brings. To sustain a low-complexity constraint, we define the filtering operation as the Hadamard product between the bias and the prediction map of an HC (see Equation (9)).

$$ FilteredHC = HC \otimes Bias \qquad (9) $$

Moreover, we measure the efficiency of this process through gain which is the difference between scores of filtered HC and original HCs or biases results.

$$ Gain_{X} = score(FilteredHC) - score(X) \qquad (10) $$

with $X \in \{\text{HC}, \text{Bias}\}$, and score is the outcome of CC, SIM, or KL measures.

## 3. Results

### 3.1. A First Quantitative Analysis: Selection of Biases

In this section, we sort out biases per cluster to select the most performing ones and build a reliable dictionary. We have selected three of most predictive patterns per cluster, under the constraint that they outperform the CB, and that they are dissimilar enough. Efficiency was considered for the three metrics simultaneously, favoring biases achieving the best results for the three of them. Sorting reduces
down to 3 × 7 the number of saliency patterns in the dictionary. From now on, we name biases the 21 patterns selected to form the dictionary.

Table 4 reports the parameters of biases and their respective metric results on EyeTrackUAV2 overall and per cluster. We emphasized the results standing beyond the others, per cluster.

<table><caption>**Table 4.** Parameters of biases and saliency metric results of biases on EyeTrackUAV2. Bold numbers achieve the highest score per cluster.</caption><thead><tr><th rowspan="2"></th><th colspan="4">Biases Parameters</th><th rowspan="2">CC ↑</th><th rowspan="2">Overall SIM ↑</th><th rowspan="2">KL ↓</th><th colspan="3">Per Cluster</th></tr><tr><th>μ<sub>r</sub></th><th>σ<sub>r</sub></th><th>μ<sub>c</sub></th><th>σ<sub>c</sub></th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th></tr></thead><tbody><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.104</td><td>0.238</td><td>2.423</td></tr><tr><td>I_1</td><td>416</td><td>99</td><td>332</td><td>307</td><td>0.122</td><td>0.258</td><td>3.335</td><td><strong>0.309</strong></td><td><strong>0.325</strong></td><td>2.215</td></tr><tr><td>I_2</td><td>416</td><td>170</td><td>332</td><td>307</td><td>0.100</td><td>0.261</td><td>2.110</td><td>0.278</td><td>0.292</td><td><strong>1.727</strong></td></tr><tr><td>I_3</td><td>416</td><td>99</td><td>640</td><td>176</td><td>0.282</td><td>0.333</td><td>3.526</td><td>0.291</td><td>0.307</td><td>3.627</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.201</td><td>0.163</td><td>2.687</td></tr><tr><td>II_1</td><td>102</td><td>163</td><td>643</td><td>241</td><td>0.083</td><td>0.253</td><td>2.790</td><td>0.299</td><td>0.229</td><td><strong>2.097</strong></td></tr><tr><td>II_2</td><td>102</td><td>115</td><td>643</td><td>241</td><td>0.022</td><td>0.203</td><td>6.507</td><td>0.285</td><td>0.235</td><td>2.374</td></tr><tr><td>II_3</td><td>102</td><td>163</td><td>643</td><td>85</td><td>0.095</td><td>0.207</td><td>10.033</td><td><strong>0.306</strong></td><td><strong>0.258</strong></td><td>4.601</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.147</td><td>0.284</td><td>1.846</td></tr><tr><td>III_1</td><td>245</td><td>103</td><td>577</td><td>346</td><td>0.196</td><td>0.304</td><td>2.912</td><td>0.270</td><td>0.355</td><td><strong>1.540</strong></td></tr><tr><td>III_2</td><td>245</td><td>103</td><td>519</td><td>346</td><td>0.177</td><td>0.296</td><td>2.990</td><td>0.265</td><td><strong>0.357</strong></td><td>1.587</td></tr><tr><td>III_3</td><td>245</td><td>103</td><td>880</td><td>346</td><td>0.194</td><td>0.303</td><td>3.044</td><td><strong>0.272</strong></td><td>0.323</td><td>1.622</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>-0.004</td><td>0.132</td><td>3.676</td></tr><tr><td>IV_1</td><td>217</td><td>175</td><td>705</td><td>282</td><td>0.231</td><td>0.320</td><td>1.672</td><td>-0.020</td><td><strong>0.147</strong></td><td><strong>3.518</strong></td></tr><tr><td>IV_2</td><td>491</td><td>107</td><td>131</td><td>174</td><td>-0.075</td><td>0.095</td><td>14.913</td><td><strong>0.096</strong></td><td>0.132</td><td>14.501</td></tr><tr><td>IV_3</td><td>217</td><td>175</td><td>376</td><td>282</td><td>0.079</td><td>0.256</td><td>2.282</td><td>-0.007</td><td>0.146</td><td>4.836</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.306</td><td>0.300</td><td>1.635</td></tr><tr><td>V_1</td><td>449</td><td>171</td><td>695</td><td>150</td><td>0.260</td><td>0.325</td><td>3.310</td><td>0.469</td><td>0.387</td><td>1.613</td></tr><tr><td>V_2</td><td>388</td><td>171</td><td>695</td><td>150</td><td>0.297</td><td>0.344</td><td>3.083</td><td>0.453</td><td>0.383</td><td><strong>1.608</strong></td></tr><tr><td>V_3</td><td>449</td><td>115</td><td>695</td><td>150</td><td>0.253</td><td>0.315</td><td>4.354</td><td><strong>0.484</strong></td><td><strong>0.404</strong></td><td>2.236</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.379</td><td>0.417</td><td>1.181</td></tr><tr><td>VI_1</td><td>405</td><td>153</td><td>712</td><td>309</td><td><strong>0.314</strong></td><td>0.340</td><td><strong>1.527</strong></td><td><strong>0.474</strong></td><td>0.442</td><td><strong>1.009</strong></td></tr><tr><td>VI_2</td><td>405</td><td>94</td><td>712</td><td>207</td><td>0.299</td><td>0.344</td><td>3.024</td><td>0.470</td><td><strong>0.477</strong></td><td>1.912</td></tr><tr><td>VI_3</td><td>405</td><td>94</td><td>712</td><td>309</td><td>0.288</td><td>0.337</td><td>2.553</td><td>0.464</td><td>0.466</td><td>1.388</td></tr><tr><td>CenterBias</td><td></td><td></td><td></td><td></td><td><strong>0.305</strong></td><td><strong>0.349</strong></td><td><strong>1.553</strong></td><td>0.430</td><td>0.352</td><td>1.327</td></tr><tr><td>VII_1</td><td>343</td><td>83</td><td>683</td><td>158</td><td>0.301</td><td>0.341</td><td>4.606</td><td><strong>0.592</strong></td><td><strong>0.488</strong></td><td>2.522</td></tr><tr><td>VII_2</td><td>343</td><td>149</td><td>683</td><td>158</td><td>0.314</td><td><strong>0.355</strong></td><td>2.718</td><td>0.521</td><td>0.412</td><td>2.024</td></tr><tr><td>VII_3</td><td>343</td><td>149</td><td>683</td><td>315</td><td><strong>0.335</strong></td><td>0.351</td><td><strong>1.460</strong></td><td>0.502</td><td>0.355</td><td><strong>1.287</strong></td></tr></tbody></table>

**All biases perform the highest on their cluster** without exception. It confirms the interest to use these biases as content-based priors and is highly promising for the future regarding the use of the dictionary of biases in saliency studies.

Regarding the expectations we had for biases, **patterns of cluster IV show low prediction scores**. They are always under our previsions, though higher than the CB. We went through the content to understand this behavior. It turns out that videos of class IV present a lot of movements, and meteorologic conditions interfere with two sequences. A single image, such as bias, is not able to capture patterns related to extreme camera and object movements or other impacting conditions.

On the contrary, **biases from clusters V, VI, and VII exceed our expectations**. These classes' biases go beyond the purpose set for them. In addition to outperforming the CB per cluster, they are more reliable overall.

**Clusters I, II, and III reach the expected efficiency**, with a specific mention for III which outreaches our expectations for SIM and KL metrics.

Regarding overall results, some biases do not show a better predictive power than the CB. On the other hand, as already mentioned, all saliency patterns outperform CB
cluster-wise. This confirms that **the clustering and biases generation processes designed to derive content-specific behavior are sound**. This is also supported by the fact that content from classes II, III, and IV are hardly predicted by other biases than their respective ones.

To further discuss our clustering strategy, the results hint to pool classes V, VI, and VII. This would be reasonable because the three groups have the same parent in the hierarchical dendrogram set in Section 2.3.2. However, combining all sequences would have an impact on the diversity of the patterns in the dictionary.

## 3.2. A Qualitative Analysis

Figure 6 illustrates the selected saliency patterns. Most of the extracted biases of the last three clusters, especially for VI and VII, can be seen as **variations of a center bias more in line with UAV content peculiarities**. For instance, objects are smaller and could accordingly necessitate precise saliency areas. This is reflected in salience patterns with centered 2D Gaussian with low std in at least one direction.

More than half of biases present a 2D Gaussian with a high longitudinal std, which looks like human attitudes towards 360° contents [92]. Observers may act towards high altitude UAV contents as they would do for omnidirectional content.

In clusters II and III, and to a lesser extent in class IV, saliency is specifically seen at the top of the content. We make a connection between this fact and the UAV sequence itself. **The position of objects of interest**, in this context in the upper part of the content, **strongly influences visual attention**. An upward camera movement may strengthen this fact. However, this latter fact alone seems less significant because other videos with such camera motion show distinct patterns (such as truck3).

Note that bias II-3 is highly representative of videos peculiarities. Indeed, we can observe a vertical Gaussian accounting for the vertical road depicted in most videos of this cluster.

Finally, in classes II, V, VI, and VII, and to a lesser extent in III, **biases are centered width-wise**. Moreover, at least one bias per cluster presents this characteristic. To the best of our knowledge, it is the first overall behavior exhibited from analyses on gaze deployment in UAV imaging.

## 3.3. Biases Benchmark

In this section, we aim to situate the efficiency of biases when compared to baselines and handcrafted features saliency models. We also provide an evaluation of the true power of prediction of biases, both on their own and coupled with saliency prediction models. Additionally, we verify the external validity of the performance of extracted biases on EyeTrackUAV1. We thus conduct the benchmark on both EyeTrackUAV1 and EyeTrackUAV2.

### 3.3.1. Results on EyeTrackUAV2

#### CB, HMs, and HCs

Results obtained by biases are presented in Table 4, and those of baselines and HCS in Table 5. Biases not only compete with the CB but also surpass it, per cluster. Some of them exhibit a center-bias alike pattern suiting more to UAV peculiarities. The biases extracted from clusters V, VI, and VII present less dispersed 2D Gaussians. These patterns seem to cope with the high distance between the UAV and the scene, i.e., the relatively small size of objects of interest and a longitudinal exploration of content.
<table><caption>**Table 5.** HC models results overall and per cluster, as well as HM average results, for EyeTrackUAV2. Stressed results show the best results per metric per cluster.</caption><thead><tr><th rowspan="2"></th><th colspan="3">Overall</th><th colspan="3">I</th><th colspan="3">II</th><th colspan="3">III</th><th colspan="3">IV</th><th colspan="3">V</th><th colspan="3">VI</th><th colspan="3">VII</th></tr><tr><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th></tr></thead><tbody><tr><td>BMS</td><td>0.266</td><td>0.313</td><td>1.550</td><td>0.350</td><td>0.285</td><td>1.664</td><td><strong>0.448</strong></td><td><strong>0.226</strong></td><td><strong>2.091</strong></td><td><strong>0.462</strong></td><td>0.329</td><td>1.448</td><td><strong>0.381</strong></td><td><strong>0.267</strong></td><td>1.937</td><td>0.194</td><td>0.254</td><td>1.816</td><td>0.436</td><td>0.407</td><td>1.050</td><td><strong>0.376</strong></td><td>0.292</td><td><strong>1.647</strong></td></tr><tr><td>GBVS</td><td><strong>0.327</strong></td><td><strong>0.337</strong></td><td><strong>1.447</strong></td><td>0.236</td><td>0.265</td><td>1.827</td><td>0.360</td><td>0.187</td><td>2.222</td><td>0.439</td><td><strong>0.350</strong></td><td><strong>1.341</strong></td><td>0.274</td><td>0.228</td><td>2.140</td><td><strong>0.274</strong></td><td>0.272</td><td>1.707</td><td>0.350</td><td>0.387</td><td>1.156</td><td>0.284</td><td>0.274</td><td>1.663</td></tr><tr><td>RARE2012</td><td>0.298</td><td>0.324</td><td>1.598</td><td><strong>0.366</strong></td><td><strong>0.311</strong></td><td><strong>1.589</strong></td><td>0.376</td><td>0.213</td><td>2.158</td><td>0.377</td><td>0.345</td><td>1.466</td><td>0.347</td><td>0.267</td><td>2.026</td><td>0.256</td><td>0.266</td><td>1.881</td><td><strong>0.438</strong></td><td><strong>0.415</strong></td><td><strong>1.043</strong></td><td>0.210</td><td>0.285</td><td>1.774</td></tr><tr><td>SIM</td><td>0.124</td><td>0.270</td><td>1.760</td><td>0.261</td><td>0.249</td><td>1.798</td><td>0.198</td><td>0.125</td><td>2.703</td><td>0.312</td><td>0.270</td><td>1.697</td><td>0.191</td><td>0.179</td><td>2.352</td><td>0.119</td><td>0.219</td><td>2.014</td><td>0.344</td><td>0.344</td><td>1.295</td><td>0.037</td><td>0.216</td><td>2.050</td></tr><tr><td>SUN</td><td>0.155</td><td>0.280</td><td>1.741</td><td>0.197</td><td>0.236</td><td>1.907</td><td>0.113</td><td>0.114</td><td>2.906</td><td>0.213</td><td>0.243</td><td>1.812</td><td>0.152</td><td>0.172</td><td>2.427</td><td>0.143</td><td>0.221</td><td>2.009</td><td>0.280</td><td>0.362</td><td>1.219</td><td>0.033</td><td>0.217</td><td>2.123</td></tr><tr><td>HM</td><td>0.220</td><td>0.306</td><td>3.054</td><td>0.117</td><td>0.224</td><td>4.535</td><td>0.087</td><td>0.129</td><td>4.407</td><td>0.085</td><td>0.232</td><td>3.444</td><td>0.005</td><td>0.119</td><td>6.670</td><td>0.239</td><td><strong>0.274</strong></td><td>2.826</td><td>0.300</td><td>0.375</td><td>2.715</td><td>0.329</td><td><strong>0.329</strong></td><td>2.058</td></tr></tbody></table>

HMs are particularly unsuitable for clusters II and IV. Moreover, the struggle to predict the saliency of these two classes is a revealing recurrent issue, stressing the importance of biases. HMs predictions are low for I and III and mild for the last three classes. For obvious reasons, HMs of VIRAT, showing center-bias alike maps, achieve the highest scores. When compared to HMs, biases III-1, IV-1, V, VI, and VII show superior overall prediction efficiency. Cluster-wise, biases achieve a better score, including cluster IV. Biases, with no exception, are more relevant for salience prediction than HMs, which is a fine achievement. Besides, no behavior such as having a HM performing particularly well on its cluster has been observed. One reason to this observation could be that HMs are too specific to the content to have a power of generalization over a cluster, even more over an entire dataset.

Now that biases outrun baseline maps, we deal with static saliency models that use handcrafted features to make predictions. Such comparisons measure whether biases capture relevant behaviors that reach the efficiency of more elaborate and refined models.

Over the entire dataset, biases from clusters VI and VII, and to a lesser extent V and III, outreach the scores of HCs. On the contrary, biases extracted from classes I, II, and IV hardly compete. That makes sense since the former clusters exhibit similar patterns to center bias, which has a strong power of generalization over a dataset. Though, the latter ones extracted more content-related behaviors, which poorly express general salience. Concerning clusters, V, VI, and VII show better scores for biases. To a lesser extent, biases of I, II, and III outdo SIM and SUN. Only biases from IV have a prediction power far worse than HCs.

The takeaway message is that several priors have a high overall prediction power able to compete with more complex HCs. Biases are efficient content-wise and surpass at least SIM and SUN. It implies they go beyond envisioned baselines and carry out relevant saliency information. It is thus highly interesting to use biases as low complexity saliency predictions.

## Handcrafted Models Filtered with Biases

Table 6 gives the obtained results. Overall, filtering exacerbates the results obtained before. Predictions on clusters V, VI, and VII are improved and present the highest gains. Biases I-3, III-all, and IV-1 are slightly less impacting filters. II-all and IV-3 only make some mild improvements. Unsurprisingly, filtering with II-all and IV-3 do not perform well overall. Their performance over specific sequences though justifies their use. For instance, II-all presents the highest gains in SIM and CC for all HC on sequences DTB70 ManRunning2, UAV123 car9, and car11, among others.

This brings us to note that biases are particularly efficient on the sequences which constitute their cluster. Moreover, for at least one of these videos, the obtained gain is the highest when compared to other biases. Besides, an impressive outcome is the presence of this improvement on the other sequences.

**Improving saliency results demonstrate that biases bring new knowledge about saliency to HCs which is beneficial to bring up the efficiency of predictions.** The increase of accuracy is nevertheless rather low. Table 6 presents the overall gain per model, which is representative of the range obtained sequence-wise. Obviously, there are more benefits to use biases on less accurate models, such as SIM and SUN. Doing so achieves an improvement of about 0.1 in CC. It is less interesting to use filtering on better models, with an overall gain approaching 0.01 in CC for RARE2012 and BMS. This difference is quite more significant than expected. Finally, the filtered SUN does not reach the accuracy of unfiltered BMS. Thus, the advantage of using biases as filters is not encouraging.
This does not call into question the meaning and interest in the dictionary. But, **it discards its use as a bank of filters.**

<table><caption>**Table 6.** Saliency metric gain<sub>HC</sub> for HC models filtered with biases and CB per cluster on EyeTrackUAV2. Result showing a gain (positive for CC and SIM, negative for KL) are highlighted for more readability.</caption><thead><tr><th></th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th><th>CC ↑</th><th>SIM ↑</th><th>KL ↓</th></tr></thead><tbody><tr><td>BMS</td><td>-0.052</td><td>-0.021</td><td>1.567</td><td>-0.080</td><td>-0.018</td><td>0.989</td><td>0.008</td><td>0.022</td><td>1.200</td><td>0.059</td><td>-0.062</td><td>0.076</td><td>1.569</td><td>0.141</td><td>0.068</td><td>-0.207</td><td>0.076</td><td>0.044</td><td>2.929</td></tr><tr><td>GBVS</td><td>-0.113</td><td>-0.038</td><td>1.695</td><td>-0.130</td><td>-0.035</td><td>1.136</td><td>0.262</td><td>-0.004</td><td>1.386</td><td>-0.010</td><td>0.023</td><td>0.011</td><td>1.716</td><td>0.052</td><td>0.045</td><td>-0.024</td><td>0.000</td><td>0.013</td><td>3.133</td></tr><tr><td>RARE2012</td><td>-0.080</td><td>-0.029</td><td>1.585</td><td>-0.107</td><td>-0.030</td><td>1.052</td><td>0.253</td><td>0.002</td><td>1.282</td><td>-0.003</td><td>0.029</td><td>0.021</td><td>1.636</td><td>0.060</td><td>0.051</td><td>-0.115</td><td>0.014</td><td>0.020</td><td>3.002</td></tr><tr><td>SIM</td><td><strong>0.020</strong></td><td>-0.008</td><td>1.518</td><td><strong>0.006</strong></td><td><strong>0.001</strong></td><td>0.922</td><td>0.225</td><td>0.042</td><td>1.105</td><td>0.145</td><td>0.065</td><td>0.164</td><td>1.469</td><td>0.217</td><td>0.082</td><td>-0.295</td><td>0.191</td><td>0.075</td><td>2.778</td></tr><tr><td>SUN</td><td><strong>0.004</strong></td><td>-0.011</td><td>1.531</td><td>-0.020</td><td>-0.009</td><td>0.956</td><td>0.227</td><td>0.034</td><td>1.138</td><td>0.114</td><td>0.056</td><td>-0.116</td><td>0.132</td><td>1.515</td><td>0.185</td><td>0.074</td><td>-0.252</td><td>0.157</td><td>0.062</td><td>2.833</td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>BMS</td><td>-0.041</td><td>-0.010</td><td>0.323</td><td>-0.165</td><td>-0.076</td><td>4.705</td><td>-0.007</td><td>0.014</td><td>1.273</td><td>-0.297</td><td>-0.200</td><td>13.180</td><td>0.100</td><td>0.062</td><td>1.367</td><td>0.096</td><td>0.057</td><td>1.313</td><td>0.109</td><td>0.070</td></tr><tr><td>GBVS</td><td>-0.099</td><td>-0.023</td><td>0.433</td><td>-0.217</td><td>-0.093</td><td>4.779</td><td>0.248</td><td>-0.011</td><td>1.454</td><td>-0.348</td><td>-0.212</td><td>13.186</td><td>0.024</td><td>0.035</td><td>1.546</td><td>0.015</td><td>0.027</td><td>1.528</td><td>0.026</td><td>0.039</td></tr><tr><td>RARE2012</td><td>-0.066</td><td>-0.015</td><td>0.345</td><td>-0.187</td><td>-0.088</td><td>4.722</td><td>0.244</td><td>-0.003</td><td>1.347</td><td>-0.310</td><td>-0.205</td><td>13.109</td><td>0.033</td><td>0.039</td><td>1.454</td><td>0.034</td><td>0.034</td><td>1.402</td><td>0.037</td><td>0.044</td></tr><tr><td>SIM</td><td><strong>0.011</strong></td><td>0.000</td><td>2.93</td><td>-0.063</td><td>-0.052</td><td>4.629</td><td>0.205</td><td>0.034</td><td>1.183</td><td>-0.180</td><td>-0.172</td><td>13.106</td><td>0.197</td><td>0.083</td><td>1.252</td><td>0.196</td><td>0.081</td><td>1.185</td><td>0.210</td><td>0.093</td></tr><tr><td>SUN</td><td>-0.003</td><td>-0.004</td><td>0.305</td><td>-0.090</td><td>-0.062</td><td>4.653</td><td>0.210</td><td>0.026</td><td>1.215</td><td>-0.208</td><td>-0.178</td><td>13.099</td><td>0.162</td><td>0.072</td><td>1.299</td><td>0.162</td><td>0.070</td><td>1.242</td><td>0.175</td><td>0.081</td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>BMS</td><td>0.077</td><td>0.045</td><td>1.801</td><td>-0.114</td><td>-0.079</td><td>8.300</td><td>0.001</td><td>0.019</td><td>1.339</td><td>-0.072</td><td>-0.018</td><td>0.512</td><td>0.053</td><td>0.030</td><td>2.620</td><td>0.100</td><td>0.054</td><td>0.837</td><td>0.144</td><td>0.076</td></tr><tr><td>GBVS</td><td>-0.002</td><td>0.016</td><td>1.998</td><td>-0.168</td><td>-0.099</td><td>8.400</td><td>0.264</td><td>-0.003</td><td>1.499</td><td>-0.133</td><td>-0.036</td><td>0.652</td><td>-0.015</td><td>0.006</td><td>2.767</td><td>0.015</td><td>0.027</td><td>1.033</td><td>0.051</td><td>0.048</td></tr><tr><td>RARE2012</td><td><strong>0.019</strong></td><td>0.023</td><td>1.875</td><td>-0.138</td><td>-0.091</td><td>8.292</td><td>0.246</td><td>-0.002</td><td>1.431</td><td>-0.094</td><td>-0.026</td><td>0.548</td><td>0.002</td><td>0.011</td><td>2.674</td><td>0.034</td><td>0.034</td><td>0.916</td><td>0.057</td><td>0.055</td></tr><tr><td>SIM</td><td>0.178</td><td>0.070</td><td>1.676</td><td>-0.006</td><td>-0.056</td><td>8.201</td><td>0.214</td><td>0.039</td><td>1.251</td><td>-0.005</td><td>-0.003</td><td>0.458</td><td>0.152</td><td>0.053</td><td>2.507</td><td>0.186</td><td>0.073</td><td>0.733</td><td>0.233</td><td>0.092</td></tr><tr><td>SUN</td><td>0.145</td><td>0.058</td><td>1.733</td><td>-0.038</td><td>-0.066</td><td>8.222</td><td>0.223</td><td>0.032</td><td>1.274</td><td>-0.026</td><td>-0.009</td><td>0.481</td><td>0.120</td><td>0.042</td><td>2.555</td><td>0.156</td><td>0.064</td><td>0.778</td><td>0.199</td><td>0.083</td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>BMS</td><td>0.097</td><td>0.035</td><td>-0.162</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>GBVS</td><td>0.034</td><td>0.023</td><td>-0.069</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>RARE2012</td><td>0.024</td><td>0.028</td><td>-0.116</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>SIM</td><td>0.156</td><td>0.042</td><td>-0.208</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>SUN</td><td>0.131</td><td>0.038</td><td>-0.187</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>

To summarize, filtering with biases restrict the salience spatially. Such a constraint is often beneficial. Overall, filtering exacerbates biases effects, given several good general biases (i.e., patterns from V, VI, and VII) and several specific patterns (i.e., I-all, II-all, and VI-3). Accuracy results are directly linked to the complexity of the used models. Indeed, complex models show fewer improvements than a less elaborate predictor. Under this study conditions, using the dictionary as a bank of filters does not seem optimal. Still, results prove that biases bring new and advantageous saliency information on their own. This supports using the dictionary as a set of priors.

### 3.3.2. Results on EyeTrackUAV1

In order to verify the external validity of the bank of biases, we carry out the same study than above on another dataset, namely, EyeTrackUAV1.

#### Biases, CB, HMs and HCs

Biases on EyeTrackUAV1 match our expectations overall and sequences-wise, especially when compared to results of [21]. Results—presented in Table 7 and for CC on sequences in Table 8—confirm that biases from clusters III, V, VI, and VII are good generic predictors, while those from I, II, and IV are more content-centric. For instance, II-all are efficient for person18. II-3 is particularly efficient for car13, perhaps because it draws a typical road pattern. Biases from I are accurate predictors on car2, I-3 being particularly applicable for building5. Last, IV reaches high scores for boat6, and car8, among others. Hence, some sequences are better represented by specific biases. These outcomes confirm the previous analyses on biases and recall the importance of clustering. The last point, KL continues favoring biases with high dispersion, meaning IV-1, VI-1, and VII-3. Note that based on its very poor effect on both datasets, **IV-2 is evicted from the dictionary.**

<table><caption>**Table 7.** Overall metric results of biases, CB, HMs, and HCs on the dataset EyeTrackUAV1. Highlighted results for biases are outperforming CB, stressed HC scores outdo the best bias.</caption><thead><tr><th></th><th>I-1</th><th>I-2</th><th>I-3</th><th>II-1</th><th>II-2</th><th>II-3</th><th>III-1</th><th>III-2</th><th>III-3</th><th>IV-1</th><th>IV-2</th><th>IV-3</th><th>V-1</th><th>V-2</th><th>V-3</th><th>VI-1</th><th>VI-2</th><th>VI-3</th><th>VII-1</th><th>VII-2</th><th>VII-3</th><th>CB</th><th>HMs</th><th>BMS</th><th>GBVS</th><th>RARE2012</th><th>SIM</th><th>SUN</th></tr></thead><tbody><tr><td>CC ↑</td><td>0.103</td><td>0.104</td><td>0.221</td><td>0.127</td><td>0.070</td><td>0.154</td><td>0.215</td><td>0.204</td><td>0.157</td><td>0.221</td><td>0.058</td><td>0.130</td><td>0.201</td><td><strong>0.249</strong></td><td>0.175</td><td>0.220</td><td>0.208</td><td>0.190</td><td>0.277</td><td><strong>0.283</strong></td><td><strong>0.268</strong></td><td>0.229</td><td>0.223</td><td><strong>0.383</strong></td><td><strong>0.373</strong></td><td><strong>0.335</strong></td><td>0.216</td><td>0.197</td></tr><tr><td>SIM ↑</td><td>0.175</td><td>0.174</td><td><strong>0.235</strong></td><td><strong>0.190</strong></td><td>0.160</td><td>0.202</td><td><strong>0.218</strong></td><td><strong>0.215</strong></td><td><strong>0.201</strong></td><td><strong>0.215</strong></td><td>0.161</td><td>0.186</td><td>0.220</td><td>0.240</td><td><strong>0.212</strong></td><td>0.209</td><td><strong>0.227</strong></td><td><strong>0.210</strong></td><td>0.268</td><td><strong>0.257</strong></td><td><strong>0.225</strong></td><td>0.184</td><td>0.228</td><td>0.248</td><td>0.245</td><td>0.256</td><td>0.187</td><td>0.187</td></tr><tr><td>KL ↓</td><td>3.739</td><td>2.430</td><td>3.771</td><td>2.854</td><td>5.523</td><td>7.647</td><td>2.985</td><td>3.025</td><td>3.229</td><td><strong>2.030</strong></td><td>13.562</td><td>2.398</td><td>3.317</td><td>3.057</td><td>4.396</td><td>2.051</td><td>3.587</td><td>3.236</td><td>4.394</td><td>2.724</td><td><strong>1.914</strong></td><td>2.186</td><td>3.856</td><td><strong>1.811</strong></td><td><strong>1.803</strong></td><td><strong>1.868</strong></td><td>2.151</td><td>2.208</td></tr></tbody></table>
Even if biases show gain for at least two metrics, this gain is rather insignificant. Thus, **results confirm those obtained on EyeTrackUAV2: biases convey meaningful saliency information**, however, combining them with HCs as defined here is not optimal.

## 4. Discussion

We would like to further discuss several points we dealt with all along with this paper.

First, we justified the made assumption of 1D Gaussian interpolation for marginal distributions. In the future, it could be interesting to learn different approximations of distributions and see the variations occuring on extracted biases. Several options can be implemented, such as learning a GMM or an alpha-stable Lévy distribution [93,94]. The latter distributions learn skewed distributions, which under particular conditions can express a Gaussian. Similarly, the extraction of local maxima on MDs parameters distributions could be replaced. Parameters of GMM or a mixture of alpha-stable Lévy distributions are good alternatives. However, the difference made by such sophisticated implementations is possibly insignificant, which explains our choice to keep this study technically sound and rather simple. Further improvements can be brought about in the future.

We also could have investigated a local extrema extraction to compute MD statistics. However, statistics would have been irrelevant in the case of low congruence between subjects. Assuming a 1D-Gaussian is less of a compromise than this solution.

We would like to stress that metrics for dynamic saliency rely on the average over the sequence. Consequently, scores may not be representative of the power of prediction of every frame. We also used the averaging process prior to t-SNE to compute features for sequences. This strengthens the distinction observed between types of imagery and within UAV content. Future studies are needed to evaluate if other strategies, such as the median or a combination of means and std of the distribution of scores, are more pertinent.

Finally, regarding the study on HCs filtering, other ways to improve HCs can be envisioned. For instance, a competition on the frame level of HCs and biases may provide better prediction scores. We decided not to include such a study here not to cover up the true message of our paper: proving we designed a relevant dictionary of biases.

## 5. Conclusions

Understanding people's visual behaviors towards multimedia content has been the object of extensive research for decades. The extension of visual attention considerations to UAV videos is though underexplored because of the infancy stage of the UAV imagery and the additional complexity to deal with temporal content.

Previous studies identified that UAV videos present peculiarities that modify gaze deployment during content visualization. We wonder if we can observe the differences between this imagery and typical videos saliency-wise. If so, it appears reasonable to further study UAV salience patterns and to extract biases that are representative of it. Ultimately, a dictionary of biases forms a reliable low-complexity saliency system. Its potential spans from real-time applications embedded on UAVs to providing the dictionary as priors to saliency prediction schemes.

The distinction between conventional and UAV content is developed through the extraction of valuable features, describing human saliency maps (HSMs) in a high-dimensional space. We designed hand-crafted features based on fixations dispersion, human saliency spatial and temporal structure, vertical and horizontal marginal distributions, and last based on GMMs. They were computed over each frame of the datasets DHF1K (400 videos) for typical videos and EyeTrackUAV2 (43 videos) for the unconventional imagery. We then run a machine learning algorithm for dimension-reduction visualization, namely the t-SNE, to observe differences between visual attention in the two types of content.
Our results justify why learning saliencies over conventional imaging to predict UAV imaging is neither accurate nor relevant. The separation between both imaging based on extracted characteristics pleads for dedicated processing. In addition to finding distinctions between types of content, the t-SNE revealed within UAV content differences. We thus apply the t-SNE on EyeTrackUAV2 alone to identify classes that represent sets of similar saliency patterns in sequences. We based this study on marginal distributions, which will prove useful to generate parametric content-specific biases from these clusters. A hierarchical clustering algorithm, specifically a dendrogram with a Ward criterion, sorts out sequences and, after thresholding, exhibits seven clusters of mainly balanced classes.

For each class, we proceed by extracting parameters that are needed to generate biases. From horizontal and vertical marginal distributions, we compute means and standard deviations, assuming they follow a 1D-Gaussian distribution. We gather all resulting statistics over time and cluster and compute their distributions. Such distributions express the likelihood of the center coordinates and std of a 2D-Gaussian in saliency patterns. Accordingly, we want to extract only prevailing values and implement the extraction of local maxima to define biases parameters.

We carry out with the creation of biases. We first reconstruct two 1D-Gaussian that will stand for horizontal and vertical distributions. By multiplying both, we will obtained the bias pattern. Biases are generated for all the combinations of previous parameters, leading to a number of 296 patterns. This number is reduced by keeping only most meaningful biases on clusters in terms of CC, SIM and KL and that outdo the center bias. The ensuing dictionary contains 21 patterns dowlable on our dedicated web-page (https://www-percept.irisa.fr/uav-biases/).

A qualitative analysis hints that videos shot with high altitude may present saliency patterns with high longitudinal variability. Besides, it seems that UAV saliency is centered width-wise. Moreover, some biases show center-bias alike patterns that suit more to UAV, as they have a reduced std in at least one dimension. We think this copes with the small size of objects in UAV videos. Quantitatively, biases surpass others on their respective cluster and achieve fair scores. All of the above is in line with our expectations for single image saliency patterns.

Finally, we conduct a benchmark over EyeTrackUAV2 to compare biases efficiency against baselines and handcrafted features saliency models (HCs). The study is extended to EyeTrackUAV1 to check the external validity of the dictionary and our conclusions. Overall, the dictionary presents some patterns with a high power of generalization, that overall and per cluster or sequence surpass CB, sometimes human means (HMs) and even more interesting HCs. Content-specific patterns were proved accurate and useful in appropriate contexts.

We further explored the potential of biases by using the dictionary as a set of filters. The outcome is that biases bring knowledge that is different from HCs. Note that the achieved gain is relatively low, particularly for the most-performing HCs. We thus recommend the use of biases on their own and not as filters. A future application that seems highly relevant is to feed dynamic saliency schemes with this dictionary of priors.

Overall, this study justifies the need for specializing salience to the type of content one deals with, especially UAV videos. The main outcome of the paper is the creation of a dictionary of biases, forming a low-complexity saliency system that is sound, relevant, and effective. It lays the ground for further advancements toward dynamic saliency prediction in specific imaging.

**Author Contributions:** Conceptualization, investigation, formal analysis, and writing—original draft, A.-F.P.; Supervision, L.Z. and O.L.M.; Writing—review and editing, A.-F.P., L.Z., and O.L.M. All authors have read and agreed to the published version of the manuscript.

**Funding:** The presented work is funded by the ongoing research project ANR ASTRID DISSOCIE (Automated Detection of SaliencyS from Operators' Point of View and Intelligent Compression of DronE videos) referenced as ANR-17-ASTR-0009.

**Conflicts of Interest:** The authors declare no conflict of interest.
## References

1. Bindemann, M. Scene and screen center bias early eye movements in scene viewing. *Vis. Res.* **2010**, *50*, 2577-2587. [CrossRef] [PubMed]

2. Tseng, P.H.; Carmi, R.; Cameron, I.G.; Munoz, D.P.; Itti, L. Quantifying center bias of observers in free viewing of dynamic natural scenes. *J. Vis.* **2009**, *9*, 4. [CrossRef] [PubMed]

3. Van Opstal, A.; Hepp, K.; Suzuki, Y.; Henn, V. Influence of eye position on activity in monkey superior colliculus. *J. Neurophysiol.* **1995**, *74*, 1593-1610. [CrossRef] [PubMed]

4. Tatler, B.W. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. *J. Vis.* **2007**, *7*, 4. [CrossRef]

5. Le Meur, O.; Liu, Z. Saccadic model of eye movements for free-viewing condition. *Vis. Res.* **2015**, *116*, 152-164. [CrossRef] [PubMed]

6. Le Meur, O.; Le Callet, P.; Barba, D.; Thoreau, D. A coherent computational approach to model bottom-up visual attention. *IEEE Trans. Pattern Anal. Mach. Intell.* **2006**, *28*, 802-817. [CrossRef]

7. Bylinskii, Z.; Judd, T.; Oliva, A.; Torralba, A.; Durand, F. What Do Different Evaluation Metrics Tell Us About Saliency Models? *IEEE Trans. Pattern Anal. Mach. Intell.* **2019**, *41*, 740-757. [CrossRef]

8. Rahnev, D.; Maniscalco, B.; Graves, T.; Huang, E.; De Lange, F.P.; Lau, H. Attention induces conservative subjective biases in visual perception. *Nat. Neurosci.* **2011**, *14*, 1513. [CrossRef]

9. Zhang, A.T.; Le Meur, B.O. How Old Do You Look? Inferring Your Age From Your Gaze. In Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 7-10 October 2018; pp. 2660-2664.

10. Gotlib, I.H.; Krasnoperova, E.; Yue, D.N.; Joormann, J. Attentional biases for negative interpersonal stimuli in clinical depression. *J. Abnorm. Psychol.* **2004**, *113*, 127. [CrossRef]

11. Le Meur, O.; Fons, P.A. Predicting image influence on visual saliency distribution: The focal and ambient dichotomy. In Proceedings of the 2020 ACM Symposium on Eye Tracking Research & Applications, Stuttgart, Germany, 2-5 June 2020

12. Bannier, K.; Jain, E.; Le Meur, O. Deepcomics: Saliency estimation for comics. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications, Warsaw, Poland, 14-17 June 2018; pp. 1-5.

13. Li, J.; Su, L.; Wu, B.; Pang, J.; Wang, C.; Wu, Z.; Huang, Q. Webpage saliency prediction with multi-features fusion. In Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, 25-29 September 2016; pp. 674-678.

14. Postema, S. *News Drones: An Auxiliary Perspective*; Edinburgh Napier University: Edinburgh, UK, 2015.

15. Agbeyangi, A.O.; Odiete, J.O.; Olorunlomerue, A.B. Review on UAVs used for aerial surveillance. *J. Multidiscip. Eng. Sci. Technol. (JMEST)* **2016**, *3*, 5713-5719.

16. Zhu, P.; Du, D.; Wen, L.; Bian, X.; Ling, H.; Hu, Q.; Peng, T.; Zheng, J.; Wang, X.; Zhang, Y.; et al. VisDrone-VID2019: The Vision Meets Drone Object Detection in Video Challenge Results. In Proceedings of the IEEE International Conference on Computer Vision Workshops, Seoul, Korea, 27 October-2 November 2019.

17. Dang, T.; Khattak, S.; Papachristos, C.; Alexis, K. Anomaly Detection and Cognizant Path Planning for Surveillance Operations using Aerial Robots. In Proceedings of the 2019 International Conference on Unmanned Aircraft Systems (ICUAS), Atlanta, GR, USA, 11-14 June 2019; pp. 667-673.

18. Huang, C. Towards a Smart Drone Cinematographer for Filming Human Motion. Ph.D. Thesis, UC Santa Barbara, Santa Barbara, CA, USA, 2020.

19. Benbihi, A.; Geist, M.; Pradalier, C. Learning Sensor Placement from Demonstration for UAV networks. *arXiv* **2019**, arXiv:1909.01636.

20. Krassanakis, V.; Perreira Da Silva, M.; Ricordel, V. Monitoring Human Visual Behavior during the Observation of Unmanned Aerial Vehicles (UAVs) Videos. *Drones* **2018**, *2*, 36. [CrossRef]

21. Perrin, A.F.; Zhang, L.; Le Meur, O. How well current saliency prediction models perform on UAVs videos? In Proceedings of the International Conference on Computer Analysis of Images and Patterns, Salerno, Italy, 3-5 September 2019; pp. 311-323.

22. Perrin, A.F.; Krassanakis, V.; Zhang, L.; Ricordel, V.; Perreira Da Silva, M.; Le Meur, O. EyeTrackUAV2: A Large-Scale Binocular Eye-Tracking Dataset for UAV Videos. *Drones* **2020**, *4*, 2. [CrossRef]
23. Zhang, K.; Chen, Z. Video saliency prediction based on spatial-temporal two-stream network. *IEEE Trans. Circuits Syst. Video Technol.* **2018**, *29*, 3544–3557. [CrossRef]

24. Finlayson, M.; Phillipson, G. Towards a New Empirically Driven Language of Cinematography. Eurographics & Eurovis 2020 (EGEV2020). 2020. Available online: https://www.youtube.com/watch?v=sogQCMhNb1I&t=4114s (accessed on 15 June 2020).

25. Kümmerer, M.; Wallis, T.S.A.; Bethge, M. DeepGaze II: Reading fixations from deep features trained on object recognition. *arXiv* **2016**, arXiv:1610.01563.

26. Yan, C.; Xiang, X.; Wang, C. Towards Real-Time Path Planning through Deep Reinforcement Learning for a UAV in Dynamic Environments. *J. Intell. Robot. Syst.* **2019**, *98*, 297–309. [CrossRef]

27. Zhou, Y.; Tang, D.; Zhou, H.; Xiang, X.; Hu, T. Vision-Based Online Localization and Trajectory Smoothing for Fixed-Wing UAV Tracking a Moving Target. In Proceedings of the IEEE International Conference on Computer Vision Workshops, Seoul, Korea, 27 October–2 November 2019.

28. Zhang, W.; Liu, C.; Chang, F.; Song, Y. Multi-Scale and Occlusion Aware Network for Vehicle Detection and Segmentation on UAV Aerial Images. *Remote Sens.* **2020**, *12*, 1760. [CrossRef]

29. Maiti, S.; Gidde, P.; Saurav, S.; Singh, S.; Chaudhury, S.; Sangwan, D. Real-Time Vehicle Detection in Aerial Images Using Skip-Connected Convolution Network with Region Proposal Networks. In Proceedings of the International Conference on Pattern Recognition and Machine Intelligence, Tezpur, India, 17–20 December 2019, pp. 200–208.

30. Bozcan, I.; Kayacan, E. AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance. *arXiv* **2020**, arXiv:2001.11737.

31. Mahayuddin, Z.R.; Saif, A.S. A Comprehensive Review Towards Appropriate Feature Selection for Moving Object Detection Using Aerial Images. In Proceedings of the International Visual Informatics Conference, Bangi, Malaysia, 19–21 November 2019; pp. 227–236.

32. Tang, Z.; Liu, X.; Chen, H.; Hupy, J.; Yang, B. Deep Learning Based Wildfire Event Object Detection from 4K Aerial Images Acquired by UAS. *AI 2020*, *1*, 166–179. [CrossRef]

33. Wu, Q.; Zhou, Y. Real-Time Object Detection Based on Unmanned Aerial Vehicle. In Proceedings of the 2019 IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS), Dali, China, 24–27 May 2019; pp. 574–579.

34. Du, D.; Qi, Y.; Yu, H.; Yang, Y.; Duan, K.; Li, G.; Zhang, W.; Huang, Q.; Tian, Q. The unmanned aerial vehicle benchmark: Object detection and tracking. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 370–386.

35. Yu, H.; Li, G.; Zhang, W.; Huang, Q.; Du, D.; Tian, Q.; Sebe, N. The Unmanned Aerial Vehicle Benchmark: Object Detection, Tracking and Baseline. *Int. J. Comput. Vis.* **2019**, *128*, 1141–1159. [CrossRef]

36. Zhu, P.; Wen, L.; Du, D.; Bian, X.; Hu, Q.; Ling, H. Vision Meets Drones: Past, Present and Future. *arXiv* **2020**, arXiv:2001.06303.

37. Qi, Y.; Wang, D.; Xie, J.; Lu, K.; Wan, Y.; Fu, S. BirdsEyeView: Aerial View Dataset for Object Classification and Detection. In Proceedings of the 2019 IEEE Globecom Workshops (GC Wkshps), Waikoloa, HI, USA, 9–13 December 2019; pp. 1–6.

38. Prystavka, P.; Sorokopud, V.; Chyrkov, A.; Kovtun, V. Automated Complex for Aerial Reconnaissance Tasks in Modern Armed Conflicts. In Proceedings of the International Workshop on Conflict Management in Global Information Networks (CMiGIN 2019), Lviv, Ukraine, 29 November 2019.

39. Xie, B. *Target Detection Algorithm for Aerial Rice Planting Area Combined with Deep Learning and Visual Attention*; Revista de la Facultad de Agronomía de la Universidad del Zulia: Zulia, Venezuela, 2019; Volume 36.

40. Boehrer, N.; Gabriel, A.; Brandt, A.; Uijens, W.; Kampmeijer, L.; van der Stap, N.; Schutte, K. Onboard ROI selection for aerial surveillance using a high resolution, high framerate camera. In *Mobile Multimedia/Image Processing, Security, and Applications 2020*; International Society for Optics and Photonics: San Diego, CA, USA, 2020; Volume 11399, p. 113990E.

41. Maaten, L.v.d.; Hinton, G. Visualizing data using t-SNE. *J. Mach. Learn. Res.* **2008**, *9*, 2579–2605.

42. Dutt Jain, S.; Xiong, B.; Grauman, K. FusionSeg: Learning to combine motion and appearance for fully automatic segmentation of generic objects in videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 3664–3673.

43. Zhao, Y.; Ma, J.; Li, X.; Zhang, J. Saliency detection and deep learning-based wildfire identification in UAV imagery. *Sensors* **2018**, *18*, 712. [CrossRef] [PubMed]
44. Gajjar, V.; Khandhediya, Y.; Gurnani, A.; Mavani, V.; Raval, M.S.; Nakada, M.; Chen, H.; Terzopoulos, D.; Hosseini, H.; Xiao, B.; et al. ViS-HuD: Using Visual Saliency to Improve Human Detection with Convolutional Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA, 18–22 June 2018; pp. 1908–1916.

45. Van Gemert, J.C.; Verschoor, C.R.; Mettes, P.; Epema, K.; Koh, L.P.; Wich, S. Nature conservation drones for automatic localization and counting of animals. In Proceedings of the Workshop at the European Conference on Computer Vision, Zurich, Switzerland, 6–12 September 2014; pp. 255–270.

46. Aguilar, W.G.; Luna, M.A.; Moya, J.F.; Abad, V.; Ruiz, H.; Parra, H.; Angulo, C. Pedestrian detection for UAVs using cascade classifiers and saliency maps. In Proceedings of the International Work-Conference on Artificial Neural Networks, Cadiz, Spain, 14–16 June 2017; pp. 563–574.

47. Zhang, J.; Liang, X.; Wang, M.; Yang, L.; Zhuo, L. Coarse-to-fine object detection in unmanned aerial vehicle imagery using lightweight convolutional neural network and deep motion saliency. *Neurocomputing* **2019**, *398*, 555–565. [CrossRef]

48. Sokalski, J.; Breckon, T.P.; Cowling, I. Automatic salient object detection in UAV imagery. In Proceedings of the 25th International Unmanned Air Vehicle Systems, Chichester, UK, 31 May–2 June 2010; pp. 1–12.

49. Wang, W.; Shen, J. Deep visual attention prediction. *IEEE Trans. Image Process.* **2017**, *27*, 2368–2378. [CrossRef]

50. Bi, F.; Lei, M.; Wang, Y.; Huang, D. Remote sensing target tracking in UAV aerial video based on saliency enhanced mdnet. *IEEE Access* **2019**, *7*, 76731–76740. [CrossRef]

51. Li, J.; Ye, D.H.; Chung, T.; Kolsch, M.; Wachs, J.; Bouman, C. Multi-target detection and tracking from a single camera in Unmanned Aerial Vehicles (UAVs). In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 9–14 October 2016; pp. 4992–4997.

52. Guo, C.; Zhang, L. A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. *IEEE Trans. Image Process.* **2009**, *19*, 185–198.

53. Ma, Z.; Wu, J.; Zhong, S.h.; Jiang, J.; Heinen, S.J. Human eye movements reveal video frame importance. *Computer* **2019**, *52*, 48–57. [CrossRef]

54. Trinh, H.; Li, J.; Miyazawa, S.; Moreno, J.; Pankanti, S. Efficient UAV video event summarization. In Proceedings of the Pattern Recognition (ICPR), Conference on 2012 21st International, Tsukuba, Japan, 11–15 November 2012; pp. 2226–2229.

55. Liu, H.; Heynderickx, I. Studying the added value of visual attention in objective image quality metrics based on eye movement data. In Proceedings of the 2009 16th IEEE international conference on image processing (ICIP), Cairo, Egypt, 7–10 November 2009; pp. 3097–3100.

56. Judd, T.; Durand, F.; Torralba, A. *A Benchmark of Computational Models of Saliency to Predict Human Fixations*; MIT Libraries: Cambridge, MA, USA, 2012.

57. Bylinskii, Z.; Isola, P.; Bainbridge, C.; Torralba, A.; Oliva, A. Intrinsic and extrinsic effects on image memorability. *Vis. Res.* **2015**, *116*, 165–178. [CrossRef]

58. Fan, S.; Shen, Z.; Jiang, M.; Koenig, B.L.; Xu, J.; Kankanhalli, M.S.; Zhao, Q. Emotional attention: A study of image sentiment and visual attention. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 8–22 June 2018; pp. 7521–7531.

59. Gitman, Y.; Erofeev, M.; Vatolin, D.; Andrey, B.; Alexey, F. Semiautomatic visual-attention modeling and its application to video compression. In Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, 31 January 2014; pp. 1105–1109.

60. Coutrot, A.; Guyader, N. How saliency, faces, and sound influence gaze in dynamic social scenes. *J. Vis. 2014*, *14*, 5. [CrossRef]

61. Coutrot, A.; Guyader, N. An efficient audiovisual saliency model to predict eye positions when looking at conversations. In Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO), Nice, France, 31 August–4 September 2015; pp. 1531–1535.

62. Fu, K.; Li, J.; Shen, H.; Tian, Y. How drones look: Crowdsourced knowledge transfer for aerial video saliency prediction. *arXiv* **2018**, arXiv:1811.05625.

63. Li, S.; Yeung, D.Y. Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA, 4–9 February 2017.
64. Mueller, M.; Smith, N.; Ghanem, B. A benchmark and simulator for uav tracking. In Proceedings of the 14th European Conference on Computer Vision, ECCV 2016, Amsterdam, The Netherlands, 8–16 October 2016; pp. 445–461.

65. Oh, S.; Hoogs, A.; Perera, A.; Cuntoor, N.; Chen, C.C.; Lee, J.T.; Mukherjee, S.; Aggarwal, J.; Lee, H.; Davis, L.; et al. A large-scale benchmark dataset for event recognition in surveillance video. In Proceedings of the CVPR, Salt Lake City, UT, USA, 20–25 June 2011; pp. 3153–3160.

66. Le Meur, O.; Baccino, T. Methods for comparing scanpaths and saliency maps: Strengths and weaknesses. *Behav. Res. Methods* **2013**, *45*, 251–266. [CrossRef] [PubMed]

67. Salvucci, D.D.; Goldberg, J.H. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, Palm Beach Gardens, FL, USA, 6–8 November 2000; pp. 71–78.

68. Ooms, K.; Krassanakis, V. Measuring the Spatial Noise of a Low-Cost Eye Tracker to Enhance Fixation Detection. *J. Imaging* **2018**, *4*, 96. [CrossRef]

69. Bruckert, A.; Lam, Y.H.; Christie, M.; Olivier, L. Deep Learning For Inter-Observer Congruency Prediction. In Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 22–25 September 2019; pp. 3766–3770.

70. McInnes, L.; Healy, J. Accelerated Hierarchical Density Based Clustering. In Proceedings of the 2017 IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA, 18–21 November 2017; pp. 33–42. [CrossRef]

71. McInnes, L.; Healy, J.; Astels, S. Comparing Python Clustering Algorithms. In Hdbscan Docs. 2016. Available online: https://hdbscan.readthedocs.io/en/latest/comparing_clustering_algorithms.html (accessed on 15 June 2020).

72. Ester, M.; Kriegel, H.P.; Sander, J.; Xu, X. A density-based algorithm for discovering clusters in large spatial databases with noise. *KDD Proc.* **1996**, *96*, 226–231.

73. Campello, R.J.; Moulavi, D.; Sander, J. Density-based clustering based on hierarchical density estimates. In Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, Gold Coast, Australia, 14–17 April 2013; pp. 160–172.

74. Zwillinger, D.; Kokoska, S. CRC Standard Probability and Statistics Tables and Formulae; Chapman&Hall, CRC Press: Boca Raton, FL, USA, 1999.

75. Lloyd, S. Least squares quantization in PCM. *IEEE Trans. Inf. Theory* **1982**, *28*, 129–137. [CrossRef]

76. Hast, A.; Lind, M.; Vats, E. Embedded Prototype Subspace Classification: A Subspace Learning Framework. In Proceedings of the International Conference on Computer Analysis of Images and Patterns, Salerno, Italy, 3–5 September 2019; pp. 581–592.

77. Miao, A.; Zhuang, J.; Tang, Y.; He, Y.; Chu, X.; Luo, S. Hyperspectral image-based variety classification of waxy maize seeds by the t-SNE model and procrustes analysis. *Sensors* **2018**, *18*, 4391. [CrossRef]

78. Wattenberg, M.; Viégas, F.; Johnson, I. How to Use t-SNE Effectively. *Distill* **2016**. [CrossRef]

79. Müllner, D. Modern hierarchical, agglomerative clustering algorithms. *arXiv* **2011**, arXiv:1109.2378.

80. Bar-Joseph, Z.; Gifford, D.K.; Jaakkola, T.S. Fast optimal leaf ordering for hierarchical clustering. *Bioinformatics* **2001**, *17*, S22–S29. [CrossRef]

81. Bylinskii, Z.; Judd, T.; Borji, A.; Itti, L.; Durand, F.; Oliva, A.; Torralba, A. Mit Saliency Benchmark. 2015. Available online: http://saliency.mit.edu/results_mit300.html (accessed on 30 June 2020).

82. Liang, H.; Liang, R.; Sun, G. Looking into saliency model via space-time visualization. *IEEE Trans. Multimed.* **2016**, *18*, 2271–2281. [CrossRef]

83. Bazzani, L.; Larochelle, H.; Torresani, L. Recurrent mixture density network for spatiotemporal visual attention. *arXiv* **2016**, arXiv:1603.08199.

84. Xu, M.; Jiang, L.; Sun, X.; Ye, Z.; Wang, Z. Learning to detect video saliency with HEVC features. *IEEE Trans. Image Process.* **2016**, *26*, 369–385. [CrossRef]

85. Bak, C.; Kocak, A.; Erdem, E.; Erdem, A. Spatio-temporal saliency networks for dynamic saliency prediction. *IEEE Trans. Multimed.* **2017**, *20*, 1688–1698. [CrossRef]

86. Cornia, M.; Baraldi, L.; Serra, G.; Cucchiara, R. Predicting human eye fixations via an lstm-based saliency attentive model. *IEEE Trans. Image Process.* **2018**, *27*, 5142–5154. [CrossRef] [PubMed]

87. Zhang, J.; Sclaroff, S. Exploiting surroundedness for saliency detection: A boolean map approach. *IEEE Trans. Pattern Anal. Mach. Intell.* **2016**, *38*, 889–902. [CrossRef] [PubMed]
88. Harel, J.; Koch, C.; Perona, P. Graph-based visual saliency. In *Advances in Neural Information Processing Systems*; MIT Press: Vancouver, BC, Canada, 2007; pp. 545–552.

89. Riche, N.; Mancas, M.; Duvinage, M.; Mibulumukini, M.; Gosselin, B.; Dutoit, T. Rare2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis. *Signal Process. Image Commun.* **2013**, *28*, 642–658. [CrossRef]

90. Murray, N.; Vanrell, M.; Otazu, X.; Parraga, C.A. Saliency estimation using a non-parametric low-level vision model. In *Proceedings of the 24th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2011*, Colorado Springs, CO, USA, 20–25 June 2011; pp. 433–440.

91. Zhang, L.; Tong, M.H.; Marks, T.K.; Shan, H.; Cottrell, G.W. SUN: A Bayesian framework for saliency using natural statistics. *J. Vis. 2008*, *8*, 32. [CrossRef]

92. David, E.J.; Gutiérrez, J.; Coutrot, A.; Da Silva, M.P.; Callet, P.L. A Dataset of Head and Eye Movements for 360° Videos. In *Proceedings of the 9th ACM Multimedia Systems Conference, New York, NY, USA*, 18–21 June 2018; pp. 432–437. [CrossRef]

93. Mandelbrot, B. The Pareto-Levy law and the distribution of income. *Int. Econ. Rev.* **1960**, *1*, 79–106. [CrossRef]

94. Lévy, P. *Calcul des Probabilités*; Springer: Berlin/Heidelberg, Germany, 1925.

<figure><img src="image_11.png" /></figure>

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).