# Strategies of Applying Visual Element Combination to Improve Visual Cognitive Efficiency in the Era of Big Data Network

Authors: Qiaohe Zhang; Huijuan Lai
Journal: Mobile Information Systems
 (2022)

---

## Abstract

Fundamentally, visual cognition refers to a way of thinking in which the objective information of the external world is transmitted to the brain through the visual nerve and then processed by the brain. In the evolutionary history of human beings, the pressure brought by the environment has led to the rapid development of the visual system and visual cognition. As with language ability and logical ability, the understanding of visual cognition is the key to the analysis of human intelligence. Therefore, research on improving the efficiency of visual cognition is urgently needed. The purpose of this paper is to find methods and strategies to improve the efficiency of visual cognition based on the application of visual element combination. This article first gives a general introduction to visual elements and design methods. Then, the eye movement behavior and visual saliency calculation model are established. Using Gaussian analysis and channel saliency test method based on “where” and “what” principles, the cognitive effect of pictures in visual elements is specifically analyzed. Then, the questionnaire survey method was used to conduct experiments on the problem that visual elements affect the efficiency of visual cognition, and finally the results were obtained. At the macro level, dynamic pictures with color and auxiliary text can effectively improve the cognitive efficiency of vision. It enables people to grasp cognitive objects quickly and form stronger cognitive ability. However, at the micro level, due to the intuitiveness and meaning of words, the visual cognitive efficiency of the recognition effect is high. In terms of image scale, the two scale parameters [4 × 4] and [6 × 6] perform better. The human eye is relatively optimal at 4/90∼6/90 on the attention scale of the image. At the same time, under the [4 × 4] scale parameter, even if the image loses some features, it can save about 95% of the cognitive time overhead.


---

## Body

## 1. Introduction

With the rapid development of Internet big data, cognitive theory has gradually formed. The current situation that the fusion and collision of various visual elements affects the efficiency of visual cognition. Humans acquire and process information from the outside world through the sensory and nervous systems. Of these acquired information, more than 80% come from the visual system [1, 2]. When the human eye processes this visual information, it automatically selects the parts of the brain of interest based on its limited capabilities. This is because human vision has an attention mechanism. In the process of visual cognition, the cognitive subject is stimulated by different external visual elements. After processing by the brain, it is stored in the brain in the form of memory, thereby forming visual cognition. When different visual elements are presented to the eyes, the brain processes these elements differently. That is, cognitive efficiency is different. Therefore, analyzing and researching the combination of visual elements can not only effectively improve the efficiency of visual cognition and human cognitive ability, but also provide certain ideas and theoretical foundations for research in teaching, design, film and television, and other fields.The visual system undertakes most of the human information acquisition tasks. The human visual system has efficient data filtering capabilities. It allows humans to quickly extract important information from complex and changeable scenes and process them cognitively. Visual cognition is a relatively complex process. As the basic unit of cognitive objects, visual elements have a direct impact on visual cognition. Therefore, optimizing the combination of visual elements can effectively improve the visual cognitive efficiency and improve human cognitive ability. On this basis, the improvement of visual cognitive efficiency can also promote the long-term and stable development of related sciences and other fields, such as big data networks, computer vision, bionic technology, visual design, instructional design, and film and television art. And in the process of cognitive practice, it has effectively promoted the solution of many practical problems.The innovation of this paper is that (1) it focuses on visual elements, analyzes the characteristics and applicability of specific visual elements, and then specifically studies the combination method of visual elements to find methods and strategies to improve visual cognitive efficiency. (2) It integrates eye movement behavior and visual saliency calculation into the analysis and learns the human visual cognitive process and its characteristics. In this way, the analysis of visual elements is promoted and the efficiency of element combination is improved. (3) It uses the Gaussian analysis and channel saliency test methods to accurately simulate the dynamic saccade behavior in the process of human visual cognition to increase the reliability of the data.


## 2. Related Work

At present, research on visual cognition is becoming more and more common. Among them, Akhmetshin et al. analyzed the application of visual teaching aids in modern educational settings and evaluated its improvement in students’ cognitive efficiency in secondary vocational education institutions. The authors used a questionnaire to collect teaching data and students’ learning data to find out which errors in audiovisual teaching aids reduced cognitive efficiency. And as these errors were eliminated, students’ grades and cognitive efficiency improved by 15–20%. However, due to the limited sample, the obtained results are slightly inaccurate [3]. Pereira et al. investigated the association between eye movement indicators and visual cognitive efficiency in MCI and AD. They believed that visual cognition is critical to activities of daily living and that it is affected in Alzheimer’s disease (AD). They tested 127 participants and had them complete an eye-tracking visual cognitive task. They studied its cognitive efficiency. However, due to large individual differences, the results are inevitably imprecise [4]. Wong conducted an exploratory study of a new analytical method to examine visual elements in relation to the underlying visual cognitive processes involved. He believed that the analysis of visual elements proposed by the social semiotics method perfectly complements the internal cognition of image viewers and improves the efficiency of cognition. However, because the method is relatively new and the experimental model is not perfect, the data obtained are slightly lacking [5]. Li et al. analyzed the cognitive efficiency and evaluation index of CNC interface layout design. Based on the eye-tracking data and the traffic network accessibility model, the calculation equations for the return time rate, refixation rate, saccade duration rate, and accessibility are derived. Finally, the proposed layout evaluation index is tested by correlation analysis, and the cognitive efficiency of visual element design is analyzed by ANOVA. But this operation is more complicated and needs to be carried out in a stable environment [6].Inspired by the Müller–Lyer illusion in the biological visual system, Zhang et al. proposed an improved LineMod (CT-LineMod) model for visual cognitive template clustering. The model uses 7D cognitive feature vectors in place of standard 3D spatial points in the clustering process of Patch-LineMod. Among them, the cognitive distance of different 3D space points will be further affected by additional 4D information related to feature orientation and size. However, this method is difficult to operate and requires higher requirements on the machine [7]. Xi et al. believed that neural oscillatory responses in different frequency bands are associated with different cognitive functions and cognitive efficiency. Therefore, they investigated the topological characteristics of time-varying networks across multiple frequency bands. This helps to elucidate the mechanism of multisensory multielement integration. They designed an event-related experiment and constructed delta-, theta-, alpha-, and beta-band networks at eight time points after stimulation. Graph theory is then used to compute global properties, node out-degrees, and their correlation to cognitive behavior. This method requires a large amount of data to support. Therefore, there are higher requirements for the accuracy of the algorithm model [8]. Huestegge and Tzsch compared 2 visualization methods: a traditional circular representation (pie chart) and a rectangular representation (constant column width dendrogram). They hypothesized that they differ in cognitive ease and cognitive efficiency in the visual comparison process. Complemented by eye movement analysis, it was concluded that facilitating the comparison process by representing key variables in a less complex visual dimension (i.e., straight line length with constant orientation rather than surface area or curved length) ultimately increases the cognitive efficiency of the graph. However, there are certain errors in this method, resulting in insufficient accuracy [9].


## 3. Methods of Improving Visual Cognitive Efficiency by Using a Combination of Visual Elements

### 3.1. Introduction and Design Methods of Visual Elements and Visual Cognition

#### 3.1.1. Text Elements

Text is not only a carrier of information, but obvious visual recognition is also a major feature of text. Therefore, visualizing the text of the design object can make the information more vivid and make the information dissemination more appealing [10].When designing, text needs to have prominent visual communication elements. By combining arrangement and image processing, the text in the interface can express different levels of meaning. The text design in the combination of visual elements is the most basic expression method in today’s information dissemination. Text can directly convey information to the audience and make the audience understand the composition framework of the interface at a glance [11]. For example, in the design of web pages, it uses text instead of icons as link buttons in the navigation bar. This is because when the audience clicks on the web page, they can intuitively find the content they want to choose without having to process and transform information in their minds, as shown in Figure 1.Figure 1
Navigation bar links in web pages.Secondly, special fonts are used in the design of thematic advertisement titles, and the effect conveyed is in line with the artistic conception of the photo background, such as the theme advertisements of Halloween and Christmas in Hong Kong Disneyland, as shown in Figure2.Figure 2
Hong Kong Disneyland’s Halloween and Christmas themed advertisements.Text design focuses on the handling of fonts and tones. The visual expression of text styling elements is the foundation of text design. At present, this design has become a basic and important form of artistic expression.


#### 3.1.2. Image Elements

In interface design, designers can transform ideas into striking forms through image design and use these images to convey information. Excellent designers can show high-level image combinations and the characteristics of design objects and make the disseminated information more vivid and three-dimensional through image design [12–14]. Most designers are good at using graphic design. They argue that images have much better propagation characteristics than text. There is also a view that the visual impact of images is 85% higher than that of text. From the above point of view, it can be seen that image design can quickly express the designer’s ideas. Using images to display information can bring more sensory stimulation and better emotional resonance.


#### 3.1.3. Color Elements

When visual information is communicated, color is the main driver of emotion [15]. Excellent color matching can attract the attention of the audience and bring vitality to the design object. The sensible use of color can not only make the content more visually beautiful, but also convey emotion. This plays a very important role in the whole design process. The color configuration of the design object will directly affect the final design effect. The colors of each part need to be blended with each other and presented harmoniously. How to match colors to highlight the design theme is a problem that designers need to focus on. Excellent color matching needs to first figure out what the main idea of the design is and then make color matching around this subject, which can resonate with the audience.If it is going to work well, it needs vibrant colors first. In the design, it is necessary to use color to highlight the subject and make the subject vivid so as to attract the audience’s attention at the first time. Furthermore, it also requires unique colors. Innovation is the vitality of design. Blind imitation will make the design lose its vitality [16]. Only innovation in color configuration can impress the audience. As shown in Figure 3, the designer used a magnificent triangular element. In the work, the designer added very interesting colorful triangles. This seemingly simple and bland element makes this work full of strong individualism. These rich colors form a sharp contrast with the deer head in the background, giving the audience a greater impact. It deepens the audience’s visual cognition and leaves a deep impression on the audience. The colorful triangular color elements are matched with animal and portrait photography to create magnificent avant-garde and fashionable works.Figure 3
Colorful triangular color elements and animals.


#### 3.1.4. Visual Element Combination Presented by Interactive Element Design

Visual element composition is an organic and systematic design arrangement for each element present in the interface [17]. That is, at the beginning of the design, the designer is required to comprehensively consider the layout of images, text, and colors according to the design requirements and goals and design with the overall coordination as the goal [18, 19]. In this way, the interactive design that conforms to the audience’s cognitive model can improve the audience’s cognitive ability and increase the amount of cognition and cognition accuracy per unit time. Thereby, it improves the visual cognition efficiency of the audience. The following methods of systematic integration of visual elements can help improve visual cognitive efficiency:(1)Unification of the Spacing between Elements. The concept of “spacing” is also a very important element in the system integration design. The spacing between elements includes the spacing between images, between images and text, and between text and text [20]. Unifying the spacing of each element helps to form an orderly layout effect, improving the reading efficiency of content information and the overall sense of layout.(2)Unification of Image Forms. Among the visual composition elements, images are the most visually expressive design elements [21]. Therefore, it is extremely important to choose the most appropriate image based on the message you want to convey and what you want to express. How to make the overall layout of the image harmonious and ornamental can start with the expression style of the image. It selects images of the same or similar styles to integrate the layout faster, removes images with different styles that destroy the overall harmony, or unifies the styles of images through image processing software to reduce the impact of differences on the layout. It creates a messy feel. Secondly, the arrangement position of the images is also a key factor. The overall arrangement of the image should be arranged in advance to form a certain design order so that the overall image is harmonious and orderly.(3)Unification of Text Style. In the combination of elements, the type and arrangement of text can also have an impact on the visual perception of the audience. Therefore, when designing, designers need to choose the appropriate font style according to the content they want to convey. Black body gives a sense of fashion and eye-catching, while Arial gives a sense of elegance, classic and high-end. Different fonts bring different feelings to people. Showing the personality of the font can not only reflect the obvious difference between different types of information, but also make the layout effect overall beautiful.(4)Harmony of Color Planning. Color has the power to move people’s hearts in the combination of elements, which is beneficial to convey the designer’s emotion and make the audience resonate with it [22]. Through color planning, all elements in the layout can also be coordinated to form an overall, beautiful and eye-catching picture. In the specific design, it can choose a color as the keynote to connect all the elements together, or it can form a strong color contrast, leaving the audience with an intuitive sense of visual impact. The flexible use of color helps to enhance the overall visual effect of viewing, visual impact and memory, and enhance the cognitive ability of the audience.(5)Visual Cognitive Structure. Visual cognition is divided into three stages of visual processing: early, middle, and late stages, as shown in Figure 4. Appearance information is obtained in the early stage, including the confirmation of the contained elements and the acquisition of general characteristics. It then performs shallow cognitive analysis. In the middle stage, a series of operations are performed on the initial impression to obtain an image that can reflect the specific characteristics of the cognitive object, which is called a two-dimensional (2.5D) sketch, including depth information and element clarity extracted by stereo vision operations. Based on this information, cognitive objects can be segmented into regions with clear meanings. From this, a higher-level description can be obtained than lines, shapes, and ranges. The later stage builds a three-dimensional model of the process of cognitive object recovery and relies on self-cognition to identify the object.Figure 4
Visual cognitive structure.According to the visual cognitive model in Figure5, when the information comes into the eyes and stimulates the retina, the optic nerve will transmit the received visual information to the brain, and the brain will process it to generate cognitive behavior [23]. That is to say, visual cognition is a series of analysis and understanding processes carried out by the brain after collecting and sorting out external information. The common template theory and visual feature recognition are theories about visual cognition. It shows that after human beings acquire information, they produce a reaction process through cognitive judgment. These pieces of information composed of words, images, and symbols stimulate the brain through the optic nerve to generate cognition. These pieces of information will be stored in the brain in the form of memory to form a corresponding cognitive judgment mechanism.Figure 5
Visual cognitive model.


### 3.2. Eye Movement Behavior and Visual Saliency Calculation Model

In the perceptual field of cognitive psychology, visual cognition is the main channel to obtain the vast majority of information in the external world [24]. However, human attention and energy are limited, and only certain resources are allocated to the visual system. At this time, visual selective attention will play an important role in this process. The response of visual selective attention at the human physiological level is mainly eye movement. In the research of visual cognitive efficiency, eye-tracking technology is an effective and direct research method. It can learn the human visual cognitive process and its characteristics by observing eye movements and the distribution of viewpoints [25]. This is applied to the combination of visual elements to improve the efficiency of the combination of elements and improve the efficiency of visual cognition.


#### 3.2.1. Gaussian Analysis

As a very classic data analysis technique in statistics, projection tracking is highly similar to the dynamic saccade behavior in human visual cognition process [26]. It was originally proposed to exploit low-dimensional projection search to mine potentially meaningful data patterns or structures in high-dimensional data. This is in line with the human cognitive goal of searching and discovering important visual content in complex scenes. A linear projection from Yd to Yk can be defined as any linear mapping M (usually a k × d matrix of rank k):(1)WQ=MW,W∈Yd,WQ∈Yk.Among them,W is a dimension w, a random variable obeying the distribution Q. WQ is a random variable of dimension w that obeys distribution QM. Each column of WQ can be considered an independent statistical component. The process of projection tracking is to determine the projection M of interest by maximizing or minimizing an objective function FQM with respect to the distribution QM.


#### 3.2.2. Extraction of Gaussian Components Based on Kurtosis Maximization

In statistics, the super-Gaussianity of a random variable is usually measured by the kurtosis function:(2)kurtx=Ex4−3Ex22.Among them,x is a given random variable and E{.} is the expectation function. If x is a random variable strictly obeying a Gaussian distribution, then kurt (x) = 0. If the kurtosis is positive, then the random variable has a super-Gaussian property. If the kurtosis is negative, it has a sub-Gaussian shape. In order to obtain the most Gaussian projection, an initial projection M can be randomly selected. It utilizes a fixed-point iteration method such that the final converged projection has the strongest kurtosis on a given image matrix J. The objective function FQ of Gaussian component projection tracking is(3)FQM=kurtMTJ.The gradient ofFQ is as follows:(4)∂FQ∂M=4EMTJ3JT−3MTMT2.When the projection direction is the same as the gradient direction or the deviation of the two is small enough, the search process converges. Then, the following can be derived:(5)MT∝EMTJ3JT−3MTMT2.Formula (5) can be solved using a fixed-point iterative algorithm:(6)M←EJJTM3,M=MM.From the above, a projection direction can be obtained so that the given data has the strongest super-Gaussianity in this direction.


#### 3.2.3. Multi-Gaussian Component Extraction Based on Schmidt Orthogonalization

In order to ensure that the optimization process will not converge to the extracted Gaussian components, an orthogonalization constraint needs to be introduced in the process of multicomponent extraction. That is, the new Gaussian component should be strictly orthogonal to the previously extracted component. It is given a set of extracted orthogonal projection vectorsM1,M2,…,MQ, and the orthogonalization constraint of multiple solving processes can be guaranteed by the processing of the following formula:(7)MQ+1←MQ+1−∑s=1QMQ+1TMSMSMS.To sum up the above, the Gaussian components in the image data can be extracted one by one.


### 3.3. Channel Saliency Test Method Based on “Where” and “What” Principles

#### 3.3.1. “Where” Saliency Map Generation Based on Pure Background

In the human visual cognitive system, when the vision is stimulated, the cognitive process of the nerve to the outside world mainly depends on the sparse response state received by the neurons [27]. The segmented image is sparsely represented (SR) using the pure background after low-rank matrix factorization as a dictionary, and the sparse encoding of the entire image region is(8)αj=argminXj−Dαj22+γαj1.Among them, the parameterγ is used to balance the sparse constraint term αj1 and the error reconstruction term Xj−Dαj22. Then, the saliency value based on the pure background can be regarded as the reconstruction error after sparse coding (SC), which is expressed as(9)Sjbg=Xj−Dαj22.The “where” feature saliency map can be binarized by the adaptive thresholdTg, and the superpixel area corresponding to the “where” salient area part will be separated. To sum up, the results of time Tg=0.8∗t are the best.


#### 3.3.2. Target-Centered “What” Saliency Map Generation

In biology, each neuron in a neural network is interconnected with surrounding neurons to form a crisscrossed neural network. These neurons can work in parallel and can quickly find the information that needs to be processed [28]. On the basis of the modified mechanism, a fully connected graph S=C,G is established. Among them, C is the set of all superpixel nodes X=X1,…,X1,Xj+1,…,Xn∈Rm×n; there are j marked points and u unmarked points, and the marked points are denoted as X1,Y1,…,Xj,Yj. So, N=j+u is the number of superpixels after image segmentation. S represents the degree of correlation between two superpixel nodes, which is defined as(10)ωj,k=s−cj−ck/2υ2,j,k∈V.Among them,υ is a constant that controls the size of the weight. cj and ck represent the color features of the CIELAB color space corresponding to different superpixel nodes, respectively.The salient values of each node are computed using graph-based Gaussian fields and harmonic functions. Given a graph-based functionf:V⟶R and some fixed labels, it is agreed that in the label data j=1,…,l, the function f takes the value fj=flj=yj. Therefore, to mark the significant values of nodes,(11)SF=∞∑j∈Lfj−yj2+12∑j,kωj,kfj−fk2,fj∈R.It converts to a graph-based Laplacian matrix:(12)SF=∞∑j∈Lfj−yj2+FTLF=FTLF.Among them,(13)L=D−A,A=ωj,kn×n,D=diagdj,dj=∑kωj,k.With a slight variation, it gets(14)fj=1dk∑j−kωjkfj,k=l+1,l+2,…,l+u.For the convenience of calculation, take thelth row of the weight matrix A as the benchmark, divide it into four parts, and get(15)A=AllAulAluAuu.In the same way, it will be divided into two parts to get(16)F=FlFu.Among them,Fu represents the value of the unlabeled node; then, the solution of the optimization problem is(17)Fu=Duu−Auuz−1AulFl.Therefore, the object-centric saliency based on the “what” feature is(18)Ygoalj=Fj,j=1,2,…n.


## 3.1. Introduction and Design Methods of Visual Elements and Visual Cognition

### 3.1.1. Text Elements

Text is not only a carrier of information, but obvious visual recognition is also a major feature of text. Therefore, visualizing the text of the design object can make the information more vivid and make the information dissemination more appealing [10].When designing, text needs to have prominent visual communication elements. By combining arrangement and image processing, the text in the interface can express different levels of meaning. The text design in the combination of visual elements is the most basic expression method in today’s information dissemination. Text can directly convey information to the audience and make the audience understand the composition framework of the interface at a glance [11]. For example, in the design of web pages, it uses text instead of icons as link buttons in the navigation bar. This is because when the audience clicks on the web page, they can intuitively find the content they want to choose without having to process and transform information in their minds, as shown in Figure 1.Figure 1
Navigation bar links in web pages.Secondly, special fonts are used in the design of thematic advertisement titles, and the effect conveyed is in line with the artistic conception of the photo background, such as the theme advertisements of Halloween and Christmas in Hong Kong Disneyland, as shown in Figure2.Figure 2
Hong Kong Disneyland’s Halloween and Christmas themed advertisements.Text design focuses on the handling of fonts and tones. The visual expression of text styling elements is the foundation of text design. At present, this design has become a basic and important form of artistic expression.


### 3.1.2. Image Elements

In interface design, designers can transform ideas into striking forms through image design and use these images to convey information. Excellent designers can show high-level image combinations and the characteristics of design objects and make the disseminated information more vivid and three-dimensional through image design [12–14]. Most designers are good at using graphic design. They argue that images have much better propagation characteristics than text. There is also a view that the visual impact of images is 85% higher than that of text. From the above point of view, it can be seen that image design can quickly express the designer’s ideas. Using images to display information can bring more sensory stimulation and better emotional resonance.


### 3.1.3. Color Elements

When visual information is communicated, color is the main driver of emotion [15]. Excellent color matching can attract the attention of the audience and bring vitality to the design object. The sensible use of color can not only make the content more visually beautiful, but also convey emotion. This plays a very important role in the whole design process. The color configuration of the design object will directly affect the final design effect. The colors of each part need to be blended with each other and presented harmoniously. How to match colors to highlight the design theme is a problem that designers need to focus on. Excellent color matching needs to first figure out what the main idea of the design is and then make color matching around this subject, which can resonate with the audience.If it is going to work well, it needs vibrant colors first. In the design, it is necessary to use color to highlight the subject and make the subject vivid so as to attract the audience’s attention at the first time. Furthermore, it also requires unique colors. Innovation is the vitality of design. Blind imitation will make the design lose its vitality [16]. Only innovation in color configuration can impress the audience. As shown in Figure 3, the designer used a magnificent triangular element. In the work, the designer added very interesting colorful triangles. This seemingly simple and bland element makes this work full of strong individualism. These rich colors form a sharp contrast with the deer head in the background, giving the audience a greater impact. It deepens the audience’s visual cognition and leaves a deep impression on the audience. The colorful triangular color elements are matched with animal and portrait photography to create magnificent avant-garde and fashionable works.Figure 3
Colorful triangular color elements and animals.


### 3.1.4. Visual Element Combination Presented by Interactive Element Design

Visual element composition is an organic and systematic design arrangement for each element present in the interface [17]. That is, at the beginning of the design, the designer is required to comprehensively consider the layout of images, text, and colors according to the design requirements and goals and design with the overall coordination as the goal [18, 19]. In this way, the interactive design that conforms to the audience’s cognitive model can improve the audience’s cognitive ability and increase the amount of cognition and cognition accuracy per unit time. Thereby, it improves the visual cognition efficiency of the audience. The following methods of systematic integration of visual elements can help improve visual cognitive efficiency:(1)Unification of the Spacing between Elements. The concept of “spacing” is also a very important element in the system integration design. The spacing between elements includes the spacing between images, between images and text, and between text and text [20]. Unifying the spacing of each element helps to form an orderly layout effect, improving the reading efficiency of content information and the overall sense of layout.(2)Unification of Image Forms. Among the visual composition elements, images are the most visually expressive design elements [21]. Therefore, it is extremely important to choose the most appropriate image based on the message you want to convey and what you want to express. How to make the overall layout of the image harmonious and ornamental can start with the expression style of the image. It selects images of the same or similar styles to integrate the layout faster, removes images with different styles that destroy the overall harmony, or unifies the styles of images through image processing software to reduce the impact of differences on the layout. It creates a messy feel. Secondly, the arrangement position of the images is also a key factor. The overall arrangement of the image should be arranged in advance to form a certain design order so that the overall image is harmonious and orderly.(3)Unification of Text Style. In the combination of elements, the type and arrangement of text can also have an impact on the visual perception of the audience. Therefore, when designing, designers need to choose the appropriate font style according to the content they want to convey. Black body gives a sense of fashion and eye-catching, while Arial gives a sense of elegance, classic and high-end. Different fonts bring different feelings to people. Showing the personality of the font can not only reflect the obvious difference between different types of information, but also make the layout effect overall beautiful.(4)Harmony of Color Planning. Color has the power to move people’s hearts in the combination of elements, which is beneficial to convey the designer’s emotion and make the audience resonate with it [22]. Through color planning, all elements in the layout can also be coordinated to form an overall, beautiful and eye-catching picture. In the specific design, it can choose a color as the keynote to connect all the elements together, or it can form a strong color contrast, leaving the audience with an intuitive sense of visual impact. The flexible use of color helps to enhance the overall visual effect of viewing, visual impact and memory, and enhance the cognitive ability of the audience.(5)Visual Cognitive Structure. Visual cognition is divided into three stages of visual processing: early, middle, and late stages, as shown in Figure 4. Appearance information is obtained in the early stage, including the confirmation of the contained elements and the acquisition of general characteristics. It then performs shallow cognitive analysis. In the middle stage, a series of operations are performed on the initial impression to obtain an image that can reflect the specific characteristics of the cognitive object, which is called a two-dimensional (2.5D) sketch, including depth information and element clarity extracted by stereo vision operations. Based on this information, cognitive objects can be segmented into regions with clear meanings. From this, a higher-level description can be obtained than lines, shapes, and ranges. The later stage builds a three-dimensional model of the process of cognitive object recovery and relies on self-cognition to identify the object.Figure 4
Visual cognitive structure.According to the visual cognitive model in Figure5, when the information comes into the eyes and stimulates the retina, the optic nerve will transmit the received visual information to the brain, and the brain will process it to generate cognitive behavior [23]. That is to say, visual cognition is a series of analysis and understanding processes carried out by the brain after collecting and sorting out external information. The common template theory and visual feature recognition are theories about visual cognition. It shows that after human beings acquire information, they produce a reaction process through cognitive judgment. These pieces of information composed of words, images, and symbols stimulate the brain through the optic nerve to generate cognition. These pieces of information will be stored in the brain in the form of memory to form a corresponding cognitive judgment mechanism.Figure 5
Visual cognitive model.


## 3.1.1. Text Elements

Text is not only a carrier of information, but obvious visual recognition is also a major feature of text. Therefore, visualizing the text of the design object can make the information more vivid and make the information dissemination more appealing [10].When designing, text needs to have prominent visual communication elements. By combining arrangement and image processing, the text in the interface can express different levels of meaning. The text design in the combination of visual elements is the most basic expression method in today’s information dissemination. Text can directly convey information to the audience and make the audience understand the composition framework of the interface at a glance [11]. For example, in the design of web pages, it uses text instead of icons as link buttons in the navigation bar. This is because when the audience clicks on the web page, they can intuitively find the content they want to choose without having to process and transform information in their minds, as shown in Figure 1.Figure 1
Navigation bar links in web pages.Secondly, special fonts are used in the design of thematic advertisement titles, and the effect conveyed is in line with the artistic conception of the photo background, such as the theme advertisements of Halloween and Christmas in Hong Kong Disneyland, as shown in Figure2.Figure 2
Hong Kong Disneyland’s Halloween and Christmas themed advertisements.Text design focuses on the handling of fonts and tones. The visual expression of text styling elements is the foundation of text design. At present, this design has become a basic and important form of artistic expression.


## 3.1.2. Image Elements

In interface design, designers can transform ideas into striking forms through image design and use these images to convey information. Excellent designers can show high-level image combinations and the characteristics of design objects and make the disseminated information more vivid and three-dimensional through image design [12–14]. Most designers are good at using graphic design. They argue that images have much better propagation characteristics than text. There is also a view that the visual impact of images is 85% higher than that of text. From the above point of view, it can be seen that image design can quickly express the designer’s ideas. Using images to display information can bring more sensory stimulation and better emotional resonance.


## 3.1.3. Color Elements

When visual information is communicated, color is the main driver of emotion [15]. Excellent color matching can attract the attention of the audience and bring vitality to the design object. The sensible use of color can not only make the content more visually beautiful, but also convey emotion. This plays a very important role in the whole design process. The color configuration of the design object will directly affect the final design effect. The colors of each part need to be blended with each other and presented harmoniously. How to match colors to highlight the design theme is a problem that designers need to focus on. Excellent color matching needs to first figure out what the main idea of the design is and then make color matching around this subject, which can resonate with the audience.If it is going to work well, it needs vibrant colors first. In the design, it is necessary to use color to highlight the subject and make the subject vivid so as to attract the audience’s attention at the first time. Furthermore, it also requires unique colors. Innovation is the vitality of design. Blind imitation will make the design lose its vitality [16]. Only innovation in color configuration can impress the audience. As shown in Figure 3, the designer used a magnificent triangular element. In the work, the designer added very interesting colorful triangles. This seemingly simple and bland element makes this work full of strong individualism. These rich colors form a sharp contrast with the deer head in the background, giving the audience a greater impact. It deepens the audience’s visual cognition and leaves a deep impression on the audience. The colorful triangular color elements are matched with animal and portrait photography to create magnificent avant-garde and fashionable works.Figure 3
Colorful triangular color elements and animals.


## 3.1.4. Visual Element Combination Presented by Interactive Element Design

Visual element composition is an organic and systematic design arrangement for each element present in the interface [17]. That is, at the beginning of the design, the designer is required to comprehensively consider the layout of images, text, and colors according to the design requirements and goals and design with the overall coordination as the goal [18, 19]. In this way, the interactive design that conforms to the audience’s cognitive model can improve the audience’s cognitive ability and increase the amount of cognition and cognition accuracy per unit time. Thereby, it improves the visual cognition efficiency of the audience. The following methods of systematic integration of visual elements can help improve visual cognitive efficiency:(1)Unification of the Spacing between Elements. The concept of “spacing” is also a very important element in the system integration design. The spacing between elements includes the spacing between images, between images and text, and between text and text [20]. Unifying the spacing of each element helps to form an orderly layout effect, improving the reading efficiency of content information and the overall sense of layout.(2)Unification of Image Forms. Among the visual composition elements, images are the most visually expressive design elements [21]. Therefore, it is extremely important to choose the most appropriate image based on the message you want to convey and what you want to express. How to make the overall layout of the image harmonious and ornamental can start with the expression style of the image. It selects images of the same or similar styles to integrate the layout faster, removes images with different styles that destroy the overall harmony, or unifies the styles of images through image processing software to reduce the impact of differences on the layout. It creates a messy feel. Secondly, the arrangement position of the images is also a key factor. The overall arrangement of the image should be arranged in advance to form a certain design order so that the overall image is harmonious and orderly.(3)Unification of Text Style. In the combination of elements, the type and arrangement of text can also have an impact on the visual perception of the audience. Therefore, when designing, designers need to choose the appropriate font style according to the content they want to convey. Black body gives a sense of fashion and eye-catching, while Arial gives a sense of elegance, classic and high-end. Different fonts bring different feelings to people. Showing the personality of the font can not only reflect the obvious difference between different types of information, but also make the layout effect overall beautiful.(4)Harmony of Color Planning. Color has the power to move people’s hearts in the combination of elements, which is beneficial to convey the designer’s emotion and make the audience resonate with it [22]. Through color planning, all elements in the layout can also be coordinated to form an overall, beautiful and eye-catching picture. In the specific design, it can choose a color as the keynote to connect all the elements together, or it can form a strong color contrast, leaving the audience with an intuitive sense of visual impact. The flexible use of color helps to enhance the overall visual effect of viewing, visual impact and memory, and enhance the cognitive ability of the audience.(5)Visual Cognitive Structure. Visual cognition is divided into three stages of visual processing: early, middle, and late stages, as shown in Figure 4. Appearance information is obtained in the early stage, including the confirmation of the contained elements and the acquisition of general characteristics. It then performs shallow cognitive analysis. In the middle stage, a series of operations are performed on the initial impression to obtain an image that can reflect the specific characteristics of the cognitive object, which is called a two-dimensional (2.5D) sketch, including depth information and element clarity extracted by stereo vision operations. Based on this information, cognitive objects can be segmented into regions with clear meanings. From this, a higher-level description can be obtained than lines, shapes, and ranges. The later stage builds a three-dimensional model of the process of cognitive object recovery and relies on self-cognition to identify the object.Figure 4
Visual cognitive structure.According to the visual cognitive model in Figure5, when the information comes into the eyes and stimulates the retina, the optic nerve will transmit the received visual information to the brain, and the brain will process it to generate cognitive behavior [23]. That is to say, visual cognition is a series of analysis and understanding processes carried out by the brain after collecting and sorting out external information. The common template theory and visual feature recognition are theories about visual cognition. It shows that after human beings acquire information, they produce a reaction process through cognitive judgment. These pieces of information composed of words, images, and symbols stimulate the brain through the optic nerve to generate cognition. These pieces of information will be stored in the brain in the form of memory to form a corresponding cognitive judgment mechanism.Figure 5
Visual cognitive model.


## 3.2. Eye Movement Behavior and Visual Saliency Calculation Model

In the perceptual field of cognitive psychology, visual cognition is the main channel to obtain the vast majority of information in the external world [24]. However, human attention and energy are limited, and only certain resources are allocated to the visual system. At this time, visual selective attention will play an important role in this process. The response of visual selective attention at the human physiological level is mainly eye movement. In the research of visual cognitive efficiency, eye-tracking technology is an effective and direct research method. It can learn the human visual cognitive process and its characteristics by observing eye movements and the distribution of viewpoints [25]. This is applied to the combination of visual elements to improve the efficiency of the combination of elements and improve the efficiency of visual cognition.


### 3.2.1. Gaussian Analysis

As a very classic data analysis technique in statistics, projection tracking is highly similar to the dynamic saccade behavior in human visual cognition process [26]. It was originally proposed to exploit low-dimensional projection search to mine potentially meaningful data patterns or structures in high-dimensional data. This is in line with the human cognitive goal of searching and discovering important visual content in complex scenes. A linear projection from Yd to Yk can be defined as any linear mapping M (usually a k × d matrix of rank k):(1)WQ=MW,W∈Yd,WQ∈Yk.Among them,W is a dimension w, a random variable obeying the distribution Q. WQ is a random variable of dimension w that obeys distribution QM. Each column of WQ can be considered an independent statistical component. The process of projection tracking is to determine the projection M of interest by maximizing or minimizing an objective function FQM with respect to the distribution QM.


### 3.2.2. Extraction of Gaussian Components Based on Kurtosis Maximization

In statistics, the super-Gaussianity of a random variable is usually measured by the kurtosis function:(2)kurtx=Ex4−3Ex22.Among them,x is a given random variable and E{.} is the expectation function. If x is a random variable strictly obeying a Gaussian distribution, then kurt (x) = 0. If the kurtosis is positive, then the random variable has a super-Gaussian property. If the kurtosis is negative, it has a sub-Gaussian shape. In order to obtain the most Gaussian projection, an initial projection M can be randomly selected. It utilizes a fixed-point iteration method such that the final converged projection has the strongest kurtosis on a given image matrix J. The objective function FQ of Gaussian component projection tracking is(3)FQM=kurtMTJ.The gradient ofFQ is as follows:(4)∂FQ∂M=4EMTJ3JT−3MTMT2.When the projection direction is the same as the gradient direction or the deviation of the two is small enough, the search process converges. Then, the following can be derived:(5)MT∝EMTJ3JT−3MTMT2.Formula (5) can be solved using a fixed-point iterative algorithm:(6)M←EJJTM3,M=MM.From the above, a projection direction can be obtained so that the given data has the strongest super-Gaussianity in this direction.


### 3.2.3. Multi-Gaussian Component Extraction Based on Schmidt Orthogonalization

In order to ensure that the optimization process will not converge to the extracted Gaussian components, an orthogonalization constraint needs to be introduced in the process of multicomponent extraction. That is, the new Gaussian component should be strictly orthogonal to the previously extracted component. It is given a set of extracted orthogonal projection vectorsM1,M2,…,MQ, and the orthogonalization constraint of multiple solving processes can be guaranteed by the processing of the following formula:(7)MQ+1←MQ+1−∑s=1QMQ+1TMSMSMS.To sum up the above, the Gaussian components in the image data can be extracted one by one.


## 3.2.1. Gaussian Analysis

As a very classic data analysis technique in statistics, projection tracking is highly similar to the dynamic saccade behavior in human visual cognition process [26]. It was originally proposed to exploit low-dimensional projection search to mine potentially meaningful data patterns or structures in high-dimensional data. This is in line with the human cognitive goal of searching and discovering important visual content in complex scenes. A linear projection from Yd to Yk can be defined as any linear mapping M (usually a k × d matrix of rank k):(1)WQ=MW,W∈Yd,WQ∈Yk.Among them,W is a dimension w, a random variable obeying the distribution Q. WQ is a random variable of dimension w that obeys distribution QM. Each column of WQ can be considered an independent statistical component. The process of projection tracking is to determine the projection M of interest by maximizing or minimizing an objective function FQM with respect to the distribution QM.


## 3.2.2. Extraction of Gaussian Components Based on Kurtosis Maximization

In statistics, the super-Gaussianity of a random variable is usually measured by the kurtosis function:(2)kurtx=Ex4−3Ex22.Among them,x is a given random variable and E{.} is the expectation function. If x is a random variable strictly obeying a Gaussian distribution, then kurt (x) = 0. If the kurtosis is positive, then the random variable has a super-Gaussian property. If the kurtosis is negative, it has a sub-Gaussian shape. In order to obtain the most Gaussian projection, an initial projection M can be randomly selected. It utilizes a fixed-point iteration method such that the final converged projection has the strongest kurtosis on a given image matrix J. The objective function FQ of Gaussian component projection tracking is(3)FQM=kurtMTJ.The gradient ofFQ is as follows:(4)∂FQ∂M=4EMTJ3JT−3MTMT2.When the projection direction is the same as the gradient direction or the deviation of the two is small enough, the search process converges. Then, the following can be derived:(5)MT∝EMTJ3JT−3MTMT2.Formula (5) can be solved using a fixed-point iterative algorithm:(6)M←EJJTM3,M=MM.From the above, a projection direction can be obtained so that the given data has the strongest super-Gaussianity in this direction.


## 3.2.3. Multi-Gaussian Component Extraction Based on Schmidt Orthogonalization

In order to ensure that the optimization process will not converge to the extracted Gaussian components, an orthogonalization constraint needs to be introduced in the process of multicomponent extraction. That is, the new Gaussian component should be strictly orthogonal to the previously extracted component. It is given a set of extracted orthogonal projection vectorsM1,M2,…,MQ, and the orthogonalization constraint of multiple solving processes can be guaranteed by the processing of the following formula:(7)MQ+1←MQ+1−∑s=1QMQ+1TMSMSMS.To sum up the above, the Gaussian components in the image data can be extracted one by one.


## 3.3. Channel Saliency Test Method Based on “Where” and “What” Principles

### 3.3.1. “Where” Saliency Map Generation Based on Pure Background

In the human visual cognitive system, when the vision is stimulated, the cognitive process of the nerve to the outside world mainly depends on the sparse response state received by the neurons [27]. The segmented image is sparsely represented (SR) using the pure background after low-rank matrix factorization as a dictionary, and the sparse encoding of the entire image region is(8)αj=argminXj−Dαj22+γαj1.Among them, the parameterγ is used to balance the sparse constraint term αj1 and the error reconstruction term Xj−Dαj22. Then, the saliency value based on the pure background can be regarded as the reconstruction error after sparse coding (SC), which is expressed as(9)Sjbg=Xj−Dαj22.The “where” feature saliency map can be binarized by the adaptive thresholdTg, and the superpixel area corresponding to the “where” salient area part will be separated. To sum up, the results of time Tg=0.8∗t are the best.


### 3.3.2. Target-Centered “What” Saliency Map Generation

In biology, each neuron in a neural network is interconnected with surrounding neurons to form a crisscrossed neural network. These neurons can work in parallel and can quickly find the information that needs to be processed [28]. On the basis of the modified mechanism, a fully connected graph S=C,G is established. Among them, C is the set of all superpixel nodes X=X1,…,X1,Xj+1,…,Xn∈Rm×n; there are j marked points and u unmarked points, and the marked points are denoted as X1,Y1,…,Xj,Yj. So, N=j+u is the number of superpixels after image segmentation. S represents the degree of correlation between two superpixel nodes, which is defined as(10)ωj,k=s−cj−ck/2υ2,j,k∈V.Among them,υ is a constant that controls the size of the weight. cj and ck represent the color features of the CIELAB color space corresponding to different superpixel nodes, respectively.The salient values of each node are computed using graph-based Gaussian fields and harmonic functions. Given a graph-based functionf:V⟶R and some fixed labels, it is agreed that in the label data j=1,…,l, the function f takes the value fj=flj=yj. Therefore, to mark the significant values of nodes,(11)SF=∞∑j∈Lfj−yj2+12∑j,kωj,kfj−fk2,fj∈R.It converts to a graph-based Laplacian matrix:(12)SF=∞∑j∈Lfj−yj2+FTLF=FTLF.Among them,(13)L=D−A,A=ωj,kn×n,D=diagdj,dj=∑kωj,k.With a slight variation, it gets(14)fj=1dk∑j−kωjkfj,k=l+1,l+2,…,l+u.For the convenience of calculation, take thelth row of the weight matrix A as the benchmark, divide it into four parts, and get(15)A=AllAulAluAuu.In the same way, it will be divided into two parts to get(16)F=FlFu.Among them,Fu represents the value of the unlabeled node; then, the solution of the optimization problem is(17)Fu=Duu−Auuz−1AulFl.Therefore, the object-centric saliency based on the “what” feature is(18)Ygoalj=Fj,j=1,2,…n.


## 3.3.1. “Where” Saliency Map Generation Based on Pure Background

In the human visual cognitive system, when the vision is stimulated, the cognitive process of the nerve to the outside world mainly depends on the sparse response state received by the neurons [27]. The segmented image is sparsely represented (SR) using the pure background after low-rank matrix factorization as a dictionary, and the sparse encoding of the entire image region is(8)αj=argminXj−Dαj22+γαj1.Among them, the parameterγ is used to balance the sparse constraint term αj1 and the error reconstruction term Xj−Dαj22. Then, the saliency value based on the pure background can be regarded as the reconstruction error after sparse coding (SC), which is expressed as(9)Sjbg=Xj−Dαj22.The “where” feature saliency map can be binarized by the adaptive thresholdTg, and the superpixel area corresponding to the “where” salient area part will be separated. To sum up, the results of time Tg=0.8∗t are the best.


## 3.3.2. Target-Centered “What” Saliency Map Generation

In biology, each neuron in a neural network is interconnected with surrounding neurons to form a crisscrossed neural network. These neurons can work in parallel and can quickly find the information that needs to be processed [28]. On the basis of the modified mechanism, a fully connected graph S=C,G is established. Among them, C is the set of all superpixel nodes X=X1,…,X1,Xj+1,…,Xn∈Rm×n; there are j marked points and u unmarked points, and the marked points are denoted as X1,Y1,…,Xj,Yj. So, N=j+u is the number of superpixels after image segmentation. S represents the degree of correlation between two superpixel nodes, which is defined as(10)ωj,k=s−cj−ck/2υ2,j,k∈V.Among them,υ is a constant that controls the size of the weight. cj and ck represent the color features of the CIELAB color space corresponding to different superpixel nodes, respectively.The salient values of each node are computed using graph-based Gaussian fields and harmonic functions. Given a graph-based functionf:V⟶R and some fixed labels, it is agreed that in the label data j=1,…,l, the function f takes the value fj=flj=yj. Therefore, to mark the significant values of nodes,(11)SF=∞∑j∈Lfj−yj2+12∑j,kωj,kfj−fk2,fj∈R.It converts to a graph-based Laplacian matrix:(12)SF=∞∑j∈Lfj−yj2+FTLF=FTLF.Among them,(13)L=D−A,A=ωj,kn×n,D=diagdj,dj=∑kωj,k.With a slight variation, it gets(14)fj=1dk∑j−kωjkfj,k=l+1,l+2,…,l+u.For the convenience of calculation, take thelth row of the weight matrix A as the benchmark, divide it into four parts, and get(15)A=AllAulAluAuu.In the same way, it will be divided into two parts to get(16)F=FlFu.Among them,Fu represents the value of the unlabeled node; then, the solution of the optimization problem is(17)Fu=Duu−Auuz−1AulFl.Therefore, the object-centric saliency based on the “what” feature is(18)Ygoalj=Fj,j=1,2,…n.


## 4. Visual Element Model and Sample Experiment under the Guidance of SGP

### 4.1. Performance of the Model

Based on the SGP framework, it selects four single samples and compares them in the human eye gaze prediction experiment. First, stretch the image so that the longest side has 90 pixels. Then, four single-scale block sampling strategies of [2 × 2], [4 × 4], [6 × 6], and [8 × 8] are used to calculate the saliency of the image. Finally, quantitative evaluation is carried out based on the YORK-120 database.Looking at the absolute value of performance, the multiscale fusion method achieves the best performance on all four samples. [4 × 4], [6 × 6] have similar performance and have a small gap with multiscale fusion strategies. The gap between [2 × 2] and [8 × 8] is larger, and [2 × 2] is better than [8 × 8]. In terms of relative performance, the multiscale fusion method achieves better results than other strategies on 40% of the images. The proportion of [4 × 4] is 25.36%, and the images of [2 × 2], [6 × 6], and [8 × 8] are 16.26%, 16.26%, and 17%, respectively.The optimal processing effects obtained by different scaling strategies are shown in Table1; it can be seen from the table that the test results of the IL-KL model are ideal, with a higher mean value, while the test results of the SL-KL model are not ideal, with the lowest mean value compared to other methods.Table 1
Evaluation results obtained by different scale strategies.
[2 × 2][4 × 4][6 × 6][8 × 8]Ours—MSSL-AUC0.77950.82230.78000.75140.7905SL-KL0.28940.33520.31800.33220.3927IL-AUC0.77990.76640.79050.74380.8042IL-KL1.07601.43231.52301.30221.6176Figure6 shows the optimal processing effect of different scale strategies. The red box is the sampling window size of the corresponding scaling strategy. To sum up, it can be concluded that [2 × 2] has better effect in single-color images because it does not encode structural information. [4 × 4] to [6 × 6] include most common salient objects, such as mid-range faces, distant people, and signs. This also shows the superior performance of [4 × 4] and [6 × 6] in Table 1 under a single-scale evaluation. [8 × 8] includes close-range faces, mid-range advertisements, and long-range people. It can be seen that the multiscale fusion strategy is more effective for scene processing of salient objects at multiple scales.Figure 6
Comparison of sampling strategies at different scales.Combined with the above analysis, under a single-scale evaluation, [4 × 4] and [6 × 6] have better performance. Therefore, in the attention scale of the image, 4/90∼6/90 is relatively optimal, and the proportion of the area of the field of view is roughly 0.21%∼0.44%. On top of this, the human visual cognition efficiency is better.


### 4.2. Quantization under the Influence of Feature Dimension

Traditional saliency models extract feature vectors of specific dimensions from images with a fixed algorithm [29]. High-dimensional features do not always bring performance improvements, and complete feature representations are not optimal. Under the scale parameter of [6 × 6], the complete feature dimension is 80. The best performance of the model is under 45 dimensions, which is 3.87% higher than using 1-dimensional features. With a scale parameter of [4 × 4], the complete feature dimension is 30. When the performance of the model is optimal at dimension 25, it is improved by 4.53% compared to using 1-dimensional features. In the case of only extracting 1-dimensional features, even if some performance is lost, about 95% of the time overhead can be saved. Figure 7 shows the impact on the time overhead and SL-AUC performance metrics of the SGP model based on different numbers of Gaussian components.Figure 7
Cumulative time overhead and impact of SL-AUC performance indicators under different feature dimensions.The SGP model test results of [4 × 4] and [6 × 6] are obtained as shown in Figure8.Figure 8
SGP model test results for [4 × 4] and [6 × 6].As can be seen from Figures7 and 8, in the scale parameters of [4 × 4] and [6 × 6], the complete feature dimension and the performance of the model generally show a positive growth mode. While the feature dimension is increasing, the cumulative time is also increasing, and the performance of the model is constantly being optimized. The SL-AUC index has a large increase rate in the early stage, a slow growth trend in the middle stage, and a partial decline trend in the later stage.


### 4.3. Experiment on the Effect of Visual Elements on Visual Cognitive Efficiency

Studies have shown that pictures with the aid of words can produce better cognitive effects. The cognitive effect of words with color-coded key content is better than that of text without color, and pictures with colors are better than pictures without color. In the following experiments, we will specifically study the impact of text and pictures (including static and dynamic) on people’s visual cognitive efficiency based on the influence of color and auxiliary text so as to find ways to improve visual cognitive efficiency. This test is mainly conducted from three aspects: self-cognitive evaluation, recognition, and reasoning test.(1)Experimental Steps. This experiment was mainly assisted by junior high school students from Huaihai Middle School. The subjects of the experiment were 102 students (44 boys and 58 girls) in two classes. The level of learning of the students is about the same. The test includes three parts: personal self-perception evaluation, recognition questions, and reasoning questions. The time to complete the test is 45 minutes.(2)Experimental Results. In this experiment, the average score and standard deviation of the visual element combination presentation method were calculated. The three aspects of self-cognitive evaluation, recognition, and reasoning are analyzed.


#### 4.3.1. Differences in Self-Perception Assessment Test Results

The average score and average variance of self-cognitive evaluation of text, static pictures, and dynamic pictures were analyzed, respectively, and the results are shown in Table2. Compared with static pictures, the F text test value is 195.405, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 62.181, the significance level is less than 0.05, and the visual cognitive effect is better. The average score and average variance of the self-perception evaluation of text are the lowest, followed by static pictures, and dynamic pictures are the best. Therefore, it can be concluded that in terms of self-perception evaluation, dynamic pictures (including color and auxiliary text) > static pictures (including color and auxiliary text) > text (with color). The results of the self-perception assessment are as shown in Figure 9.Table 2
Mean scores and mean variances of self-perception evaluations for the presentation of various visual elements.
Self-cognitive evaluationAverage scoreMean varianceText9.80.713Static image13.50.945Dynamic image14.20.801Figure 9
The self-perception evaluation test results of the presentation methods of each visual element.


#### 4.3.2. Recognition Test Results’ Discrepancies

The results of the average score and average variance of the recognition test are shown in Table3. Compared with static pictures, the F-test value of text is 74.873, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 22.648, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average recognition score of the three visual elements has reached more than 3 points; that is, they have reached the passing level. However, the average score for recognition of text is higher than that of pictures with color and auxiliary text, followed by dynamic pictures, and the average score of static pictures is the lowest. It is concluded from this that in the cognition of new knowledge, learners’ recognition of words has the highest effect. The recognition efficiency of static pictures is lower than that of text. It shows that even though the picture can contain rich information, it cannot significantly represent each knowledge point. This affects the cognitive efficiency of learners. The recognition efficiency of dynamic pictures is the lowest, indicating that although dynamic pictures can attract learners’ attention and express knowledge points, they cannot present all the information, which greatly reduces cognitive efficiency. The results of the recognition test are as shown in Figure 10.Table 3
The average score and average variance of the recognition test for each visual element presentation method.
Re-recognizeAverage scoreMean varianceText4.70.879Static image4.10.414Dynamic image4.30.921Figure 10
Recognition test results of the presentation methods of each visual element.


#### 4.3.3. Differences in Reasoning Test Results

The results of the average score and average variance of the recognition test are shown in Table4. The above experiments show that, compared with static pictures, the F-test value of text is 92.367, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 49.893, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average score of text reasoning is the lowest, and the effect is the least ideal, followed by static pictures, and the reasoning effect of dynamic pictures is the best. It is concluded from this that reasoning can examine the ability of learners to grasp knowledge points. The text has a good effect in recognition, but it is slightly lacking in the reasoning test. Static pictures can better grasp the knowledge system at a macro level, allowing learners to better understand and expand the material. Therefore, the inference effect of static pictures is better. Dynamic pictures can enhance the presentation of key knowledge. This is helpful for learners to grasp the material and improve cognitive efficiency so that learners can quickly build a cognitive framework of knowledge points and avoid the interference of other factors. The results of the reasoning test are as shown in Figure 11.Table 4
Mean scores and mean variances of the reasoning test for each visual element presentation method.
ReasoningAverage scoreMean varianceText2.60.698Static image3.10.703Dynamic image3.31.114Figure 11
Reasoning test results for the presentation of various visual elements.


## 4.1. Performance of the Model

Based on the SGP framework, it selects four single samples and compares them in the human eye gaze prediction experiment. First, stretch the image so that the longest side has 90 pixels. Then, four single-scale block sampling strategies of [2 × 2], [4 × 4], [6 × 6], and [8 × 8] are used to calculate the saliency of the image. Finally, quantitative evaluation is carried out based on the YORK-120 database.Looking at the absolute value of performance, the multiscale fusion method achieves the best performance on all four samples. [4 × 4], [6 × 6] have similar performance and have a small gap with multiscale fusion strategies. The gap between [2 × 2] and [8 × 8] is larger, and [2 × 2] is better than [8 × 8]. In terms of relative performance, the multiscale fusion method achieves better results than other strategies on 40% of the images. The proportion of [4 × 4] is 25.36%, and the images of [2 × 2], [6 × 6], and [8 × 8] are 16.26%, 16.26%, and 17%, respectively.The optimal processing effects obtained by different scaling strategies are shown in Table1; it can be seen from the table that the test results of the IL-KL model are ideal, with a higher mean value, while the test results of the SL-KL model are not ideal, with the lowest mean value compared to other methods.Table 1
Evaluation results obtained by different scale strategies.
[2 × 2][4 × 4][6 × 6][8 × 8]Ours—MSSL-AUC0.77950.82230.78000.75140.7905SL-KL0.28940.33520.31800.33220.3927IL-AUC0.77990.76640.79050.74380.8042IL-KL1.07601.43231.52301.30221.6176Figure6 shows the optimal processing effect of different scale strategies. The red box is the sampling window size of the corresponding scaling strategy. To sum up, it can be concluded that [2 × 2] has better effect in single-color images because it does not encode structural information. [4 × 4] to [6 × 6] include most common salient objects, such as mid-range faces, distant people, and signs. This also shows the superior performance of [4 × 4] and [6 × 6] in Table 1 under a single-scale evaluation. [8 × 8] includes close-range faces, mid-range advertisements, and long-range people. It can be seen that the multiscale fusion strategy is more effective for scene processing of salient objects at multiple scales.Figure 6
Comparison of sampling strategies at different scales.Combined with the above analysis, under a single-scale evaluation, [4 × 4] and [6 × 6] have better performance. Therefore, in the attention scale of the image, 4/90∼6/90 is relatively optimal, and the proportion of the area of the field of view is roughly 0.21%∼0.44%. On top of this, the human visual cognition efficiency is better.


## 4.2. Quantization under the Influence of Feature Dimension

Traditional saliency models extract feature vectors of specific dimensions from images with a fixed algorithm [29]. High-dimensional features do not always bring performance improvements, and complete feature representations are not optimal. Under the scale parameter of [6 × 6], the complete feature dimension is 80. The best performance of the model is under 45 dimensions, which is 3.87% higher than using 1-dimensional features. With a scale parameter of [4 × 4], the complete feature dimension is 30. When the performance of the model is optimal at dimension 25, it is improved by 4.53% compared to using 1-dimensional features. In the case of only extracting 1-dimensional features, even if some performance is lost, about 95% of the time overhead can be saved. Figure 7 shows the impact on the time overhead and SL-AUC performance metrics of the SGP model based on different numbers of Gaussian components.Figure 7
Cumulative time overhead and impact of SL-AUC performance indicators under different feature dimensions.The SGP model test results of [4 × 4] and [6 × 6] are obtained as shown in Figure8.Figure 8
SGP model test results for [4 × 4] and [6 × 6].As can be seen from Figures7 and 8, in the scale parameters of [4 × 4] and [6 × 6], the complete feature dimension and the performance of the model generally show a positive growth mode. While the feature dimension is increasing, the cumulative time is also increasing, and the performance of the model is constantly being optimized. The SL-AUC index has a large increase rate in the early stage, a slow growth trend in the middle stage, and a partial decline trend in the later stage.


## 4.3. Experiment on the Effect of Visual Elements on Visual Cognitive Efficiency

Studies have shown that pictures with the aid of words can produce better cognitive effects. The cognitive effect of words with color-coded key content is better than that of text without color, and pictures with colors are better than pictures without color. In the following experiments, we will specifically study the impact of text and pictures (including static and dynamic) on people’s visual cognitive efficiency based on the influence of color and auxiliary text so as to find ways to improve visual cognitive efficiency. This test is mainly conducted from three aspects: self-cognitive evaluation, recognition, and reasoning test.(1)Experimental Steps. This experiment was mainly assisted by junior high school students from Huaihai Middle School. The subjects of the experiment were 102 students (44 boys and 58 girls) in two classes. The level of learning of the students is about the same. The test includes three parts: personal self-perception evaluation, recognition questions, and reasoning questions. The time to complete the test is 45 minutes.(2)Experimental Results. In this experiment, the average score and standard deviation of the visual element combination presentation method were calculated. The three aspects of self-cognitive evaluation, recognition, and reasoning are analyzed.


### 4.3.1. Differences in Self-Perception Assessment Test Results

The average score and average variance of self-cognitive evaluation of text, static pictures, and dynamic pictures were analyzed, respectively, and the results are shown in Table2. Compared with static pictures, the F text test value is 195.405, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 62.181, the significance level is less than 0.05, and the visual cognitive effect is better. The average score and average variance of the self-perception evaluation of text are the lowest, followed by static pictures, and dynamic pictures are the best. Therefore, it can be concluded that in terms of self-perception evaluation, dynamic pictures (including color and auxiliary text) > static pictures (including color and auxiliary text) > text (with color). The results of the self-perception assessment are as shown in Figure 9.Table 2
Mean scores and mean variances of self-perception evaluations for the presentation of various visual elements.
Self-cognitive evaluationAverage scoreMean varianceText9.80.713Static image13.50.945Dynamic image14.20.801Figure 9
The self-perception evaluation test results of the presentation methods of each visual element.


### 4.3.2. Recognition Test Results’ Discrepancies

The results of the average score and average variance of the recognition test are shown in Table3. Compared with static pictures, the F-test value of text is 74.873, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 22.648, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average recognition score of the three visual elements has reached more than 3 points; that is, they have reached the passing level. However, the average score for recognition of text is higher than that of pictures with color and auxiliary text, followed by dynamic pictures, and the average score of static pictures is the lowest. It is concluded from this that in the cognition of new knowledge, learners’ recognition of words has the highest effect. The recognition efficiency of static pictures is lower than that of text. It shows that even though the picture can contain rich information, it cannot significantly represent each knowledge point. This affects the cognitive efficiency of learners. The recognition efficiency of dynamic pictures is the lowest, indicating that although dynamic pictures can attract learners’ attention and express knowledge points, they cannot present all the information, which greatly reduces cognitive efficiency. The results of the recognition test are as shown in Figure 10.Table 3
The average score and average variance of the recognition test for each visual element presentation method.
Re-recognizeAverage scoreMean varianceText4.70.879Static image4.10.414Dynamic image4.30.921Figure 10
Recognition test results of the presentation methods of each visual element.


### 4.3.3. Differences in Reasoning Test Results

The results of the average score and average variance of the recognition test are shown in Table4. The above experiments show that, compared with static pictures, the F-test value of text is 92.367, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 49.893, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average score of text reasoning is the lowest, and the effect is the least ideal, followed by static pictures, and the reasoning effect of dynamic pictures is the best. It is concluded from this that reasoning can examine the ability of learners to grasp knowledge points. The text has a good effect in recognition, but it is slightly lacking in the reasoning test. Static pictures can better grasp the knowledge system at a macro level, allowing learners to better understand and expand the material. Therefore, the inference effect of static pictures is better. Dynamic pictures can enhance the presentation of key knowledge. This is helpful for learners to grasp the material and improve cognitive efficiency so that learners can quickly build a cognitive framework of knowledge points and avoid the interference of other factors. The results of the reasoning test are as shown in Figure 11.Table 4
Mean scores and mean variances of the reasoning test for each visual element presentation method.
ReasoningAverage scoreMean varianceText2.60.698Static image3.10.703Dynamic image3.31.114Figure 11
Reasoning test results for the presentation of various visual elements.


## 4.3.1. Differences in Self-Perception Assessment Test Results

The average score and average variance of self-cognitive evaluation of text, static pictures, and dynamic pictures were analyzed, respectively, and the results are shown in Table2. Compared with static pictures, the F text test value is 195.405, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 62.181, the significance level is less than 0.05, and the visual cognitive effect is better. The average score and average variance of the self-perception evaluation of text are the lowest, followed by static pictures, and dynamic pictures are the best. Therefore, it can be concluded that in terms of self-perception evaluation, dynamic pictures (including color and auxiliary text) > static pictures (including color and auxiliary text) > text (with color). The results of the self-perception assessment are as shown in Figure 9.Table 2
Mean scores and mean variances of self-perception evaluations for the presentation of various visual elements.
Self-cognitive evaluationAverage scoreMean varianceText9.80.713Static image13.50.945Dynamic image14.20.801Figure 9
The self-perception evaluation test results of the presentation methods of each visual element.


## 4.3.2. Recognition Test Results’ Discrepancies

The results of the average score and average variance of the recognition test are shown in Table3. Compared with static pictures, the F-test value of text is 74.873, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 22.648, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average recognition score of the three visual elements has reached more than 3 points; that is, they have reached the passing level. However, the average score for recognition of text is higher than that of pictures with color and auxiliary text, followed by dynamic pictures, and the average score of static pictures is the lowest. It is concluded from this that in the cognition of new knowledge, learners’ recognition of words has the highest effect. The recognition efficiency of static pictures is lower than that of text. It shows that even though the picture can contain rich information, it cannot significantly represent each knowledge point. This affects the cognitive efficiency of learners. The recognition efficiency of dynamic pictures is the lowest, indicating that although dynamic pictures can attract learners’ attention and express knowledge points, they cannot present all the information, which greatly reduces cognitive efficiency. The results of the recognition test are as shown in Figure 10.Table 3
The average score and average variance of the recognition test for each visual element presentation method.
Re-recognizeAverage scoreMean varianceText4.70.879Static image4.10.414Dynamic image4.30.921Figure 10
Recognition test results of the presentation methods of each visual element.


## 4.3.3. Differences in Reasoning Test Results

The results of the average score and average variance of the recognition test are shown in Table4. The above experiments show that, compared with static pictures, the F-test value of text is 92.367, the significance level is less than 0.05, and the visual cognitive effect is better. Compared with dynamic pictures, the F-test value of static pictures is 49.893, the significance level is less than 0.05, and the visual cognitive effect is better. It can also be found from the data that the average score of text reasoning is the lowest, and the effect is the least ideal, followed by static pictures, and the reasoning effect of dynamic pictures is the best. It is concluded from this that reasoning can examine the ability of learners to grasp knowledge points. The text has a good effect in recognition, but it is slightly lacking in the reasoning test. Static pictures can better grasp the knowledge system at a macro level, allowing learners to better understand and expand the material. Therefore, the inference effect of static pictures is better. Dynamic pictures can enhance the presentation of key knowledge. This is helpful for learners to grasp the material and improve cognitive efficiency so that learners can quickly build a cognitive framework of knowledge points and avoid the interference of other factors. The results of the reasoning test are as shown in Figure 11.Table 4
Mean scores and mean variances of the reasoning test for each visual element presentation method.
ReasoningAverage scoreMean varianceText2.60.698Static image3.10.703Dynamic image3.31.114Figure 11
Reasoning test results for the presentation of various visual elements.


## 5. Discussion

This paper is devoted to studying strategies for applying visual element combinations to improve visual cognitive efficiency. It is not only an elaboration and analysis of visual elements, eye movement behavior and visual saliency calculation model, using eye movement behavior and visual saliency calculation model, Gaussian analysis method, SGP calculation model, and other methods to analyze the combination of visual elements, but also a new attempt to improve the research method of visual cognitive efficiency strategy. Through the analysis and construction of the visual saliency calculation model and the investigation and research of students, it looks for ways to improve visual cognitive efficiency and improve cognitive performance.Through the analysis of this case, it is shown that [4 × 4] and [6 × 6] have better performance under a single-scale evaluation. On the attention scale of the image, 4/90∼6/90 is relatively optimal. In terms of visual elements, in the self-perception evaluation, the self-perception evaluation of text is positively correlated with the reasoning effect. That is, the impact of words on self-cognitive evaluation and reasoning effect is small, and the visual cognitive efficiency is low. And pictures have a greater impact on my self-cognitive evaluation and reasoning effect, and the visual cognitive efficiency is higher. Among them, dynamic pictures are better than static pictures, and the visual cognition efficiency of dynamic pictures is the best. That is to say, at the macro level, dynamic pictures with colors and auxiliary text can effectively improve the cognitive efficiency of vision so that people can grasp cognitive objects quickly and form strong cognitive ability. However, at the micro level, due to the intuitiveness and meaning of words, the visual cognitive efficiency of the recognition effect is high. Words can better help people to reunderstand things and effectively consolidate their cognition of things.


## 6. Conclusions

Through the analysis of this paper, the following conclusions are drawn: (1) Color can have a good auxiliary effect on the cognitive level of text and pictures. That is, the presentation method with color has a good effect on improving the visual cognitive efficiency. The increase in the use of color can play a better effect. (2) The aid of words can effectively deepen the understanding of the recognizing memory of the recognized object. Text rendering is the best. (3) The visual cognitive efficiency of pictures is the best in self-cognitive evaluation. And the performance of [4 × 4] is relatively optimal. The corresponding image area is about the size of a face at a medium distance or a sign at a distance. (4) Through eye movement behavior simulation and experiments, a significant Gaussian prior is found, which proposes an SGP framework model to simulate eye movement behavior. First, four samples were selected, and four different scale blocks were used as examples to calculate the saliency. Then, based on the YORK-120 database, data analysis and evaluation were performed to compare the visual cognitive efficiency of the four scale blocks. Experiments show that the SGP model has strong robustness and rationality. In the case of only extracting 1-dimensional features, even if part of the performance of the image is lost, it can save about 95% of the time overhead, and the optimal field of view ratio is calculated to be about 0.21%∼0.44%. In the method, the channel significance test method based on the “where” and “what” principles is adopted. This method effectively improves the accuracy of the experimental results. And even if the background of the experimental subject is more complex, more accurate results can be obtained. (5) Although these methods and experiments can improve the detection accuracy, there are also some shortcomings: in the saliency test method using low-rank matrix factorization, the accuracy of the saliency map is very dependent on the results of superpixel segmentation. If the processing result of superpixel segmentation is not ideal, it will affect the accuracy of the saliency map. Therefore, the preprocessing step for the saliency map is where attention and improvement are needed.



---

*Source: 3945694-2022-06-03.xml*