# Sparse Random Projections of Camera Images for Monitoring of a Combustion Process in a Gas Burner

Ewa Skubalska-Rafajlowicz

► To cite this version:

Ewa Skubalska-Rafajlowicz. Sparse Random Projections of Camera Images for Monitoring of a Combustion Process in a Gas Burner. 16th IFIP International Conference on Computer Information Systems and Industrial Management (CISIM), Jun 2017, Bialystok, Poland. pp.447-456, 10.1007/978-3-319-59105-6_38. hal-01656200

HAL Id: hal-01656200

https://inria.hal.science/hal-01656200

Submitted on 5 Dec 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Sparse random projections of camera images for monitoring of a combustion process in a gas burner

Ewa Skubalska-Rafajłowicz¹ (0000-0002-2795-3835)

Wrocław University of Science and Technology
Faculty of Electronics, Department of Computer Engineering
Wrocław, Poland
ewa.rafajlowicz@pwr.edu.pl

**Abstract.** In this paper we present a fast and easy method of quality monitoring for processes observed by cameras. A process of combustion in an industrial gas burner is used as an example. It is shown that we can observe only a small randomly chosen part of subsequent camera images. We propose a few, working in parallel manner, quality control charts. These Shewart type charts operate on squared norms of sparse partial image projections. Each chart is used for monitoring only a part of the whole camera image. The charts provide a partial decision about the state of the monitored system. A final decision is the logical product of these partial decisions. A simulation study based on 144 images of a working gas burner is presented.

**Keywords:** image processing, process monitoring, random projections, parallel processing

## 1 Introduction

Camera-based process monitoring is a recently very popular method of supervising a production process. Quality control of products [14], [15], controlling processes [17], [18], object fault detection [7], [8], [19], [21] or anomaly detection [9] are good examples.

In this paper we propose a methodology of quality monitoring for processes observed by cameras. We illustrate its applicability by monitoring a process of combustion in an industrial gas burner. Subsequent camera images of the process under consideration are used for the process analysis.

A gas burner is a device which is used to generate a flame, in order to heat up products using a gaseous fuel such as acetylene, natural gas, or propane. In the case under consideration it is a natural gas (which is mainly methane) burner. The burner has an air inlet to mix the fuel gas with air, to enable complete combustion. Burner flames depend on air flow and we can register four states of burning process:

1. when the air hole is closed (yellow-white, laminar and lighting flame, see Fig. 1a)
2. the air hole is slightly open (orange-yellow, more turbulent flame, see Fig. 1b)

3. the air hole is not sufficiently open (yellow-blue flame, see Fig. 1c)

4. the air hole fully open (roaring blue flame see Fig. 1d).

We assume that a blue flame (hardly visible on the camera image) means that the process is an in-control state.

<figure><img src="image_2.png" /><figcaption>**Fig. 1.** Different states of a gas burner. a) Laminar and lighting flame when the air hole is closed. b) c) Orange-yellow turbulent flame and yellow-blue flame when the air hole is slightly open or is not sufficiently open. d) Roaring blue flame (normal state) when the air hole is sufficiently open.</figcaption></figure>

In contrast to the other approaches (see for example [17]) the presented method is based on computing only the energy of a set of sub-images. Energy of an image is defined as a sum of image pixel values squared. In other words, the energy of an image is the squared Frobenius norm of this image treated as a matrix, or is the squared Euclidean norm of the image if it is represented as a vector.

Thus each image frame can be considered as a set of highly multidimensional observations. In the case of an appropriate partition of every frame, the same for every image, the proposed approach can be sufficiently informative in monitoring the state of the process under consideration.

A partition of each camera image is always the same and in fact it is fully content-dependent. In this paper we assume that the image partition is given (is performed by an expert). When a large set of image data is available, designing an adequate partition can be also stated as a learning problem.

Due to the very high dimensionality of image data the dimensionality reduction is rather necessary. Random projections seems to be a good choice in the case of image energy monitoring. Random projections based approaches have been widely used in computer science and machine learning applications and in image processing [1], [2], [4], [6], [12], [23], [20], [21], [22].

If sub-images are sufficiently large it is possible to estimate their energy using only a part of image pixels. Sparse random projections [1], [12] allows us
to retrieve only 1/3 of whole image pixels whilst retaining an adequate precision of computations.

In this paper we propose to use simple monitoring charts of the Shewart type [16] based on squared norms of sparse image projections in normal state (i.e., in-control).

In the next Section we provide some information about random projections. Section 3 presents the Shewart-type control chart used in our monitoring system. Section 4 describes a simulation study performed on 144 images of a working gas burner. Finally, in Section 5 some brief conclusions are presented.

## 2 Random projections

Random projections are closely related to the Johnson-Lindenstrauss lemma [11], which states that any set of $N$ points in an Euclidean space can be embedded in an Euclidean space of lower dimension ($\sim O(\log N)$) with relatively small distortion of the distances between any pair of points from the set of points. The Johnson-Lindenstrauss-lemma has been shown to be useful in many applications in computer science [1], [2],[4], [6], [12], [23], among many others.

The main idea of a random linear projection is that we can estimate the distance between two points (two vectors), let say $u$ and $z$, in a $d$-dimensional Euclidean space $D^2(u, z) = ||u - z||^2 = (u - z)^T(u - z)$, $u, z \in \mathbb{R}^d$ from the sample squared distances as follows:

$$ \hat{D}^2(u, z) = \frac{1}{k} \sum_{j=1}^{k} (s_j(u - z))^2 = \frac{1}{k} ||Su - Sz||^2, \quad (1) $$

where $s_j$ is the $j$-th row of $S$, i.e., individual projection.

Thus, for any chosen pair of vectors $u, v \in \mathbb{R}^d E(\hat{D}^2) = D^2$, $var(\hat{D}^2) = \frac{2}{k}D^4$ and $\frac{k\hat{D}}{D^2} \sim \chi_k^2$. These facts lead to the conclusion that

$$ \mathrm{Pr} \left\{ \frac{|\hat{D}^2 - D^2|}{D^2} \geq \varepsilon \right\} \leq 2 \exp \left( -\frac{k}{4}\varepsilon^2 + \frac{k}{6}\varepsilon^3 \right), \quad (2) $$

where $\varepsilon \in (0, 1)$ (see for example [6], [23] for details). The same inequalities one can obtain for norms of vectors defined by the set of points under consideration.

### 2.1 Sparse random projections

We do not have to use $s_{ij} \sim \mathcal{N}(0, 1)$ for dimension reduction in the space with Euclidean norm. For example, we can sample $s_{ij}$ from any subgaussian tails distributions [2], [12]. Sparse random projections proposed by Achlioptas [1] belong to this class,

Thus, to speed up the computations, one can generate a sparse random projection matrix for data dimensionality reduction. It is proved that the entries of projection matrix $S$ can be chosen as independent +1, 0, -1 random variables.
A projection matrix composed from independent entries of the form:

$$s_{ij} = \begin{cases} 1 & \text{with probability } \frac{1}{2c} \\ 0 & \text{with probability } 1 - \frac{1}{c} \\ -1 & \text{with probability } \frac{1}{2c} \end{cases} \qquad (3)$$

with common factor $\sqrt{c}$ leads to the projection distribution with subgaussian tails (at least up to a suitable threshold)[12].

An Achlioptas variant of this result (with $c = 3$) has the entries attaining value 0 with probability $2/3$ and values $+1$ and $-1$ with probability $1/6$ each. This setting allows for computing the projection about 3 times faster than the Gaussian projection. Since $S$ is sparse, only about one third of the entries are nonzero numbers.

This kind of sparse projection, i.e., with $c = 3$, we have used for processing a sequence of working gas burner images. Furthermore, the rows of the projection matrix were orthonormalized. This fact is not important from the point of our goals in this work, but it will be useful in a further more theoretical research on the topic of sparse random projections.

Let $S_O$ denote such an orthonormalized matrix. It is easy to show that for any vector $x \in \mathbb{R}^d$

$$E\{||S_Ox||^2 = \frac{k}{d}||x||^2\}.$$

It should be emphasized that after random construction of the projection matrix, let us say $S_O$, it is treated as unique, non-random projection matrix. Thus, further in the paper $S_O$ will be represented an ordinary matrix.

## 3 Control charts for monitoring a process using random projections of camera images

Let $p_1, p_2, \dots, p_N$, denote a sequence of historical images (sub-images) in a normal (in-control) state. Each $p_i \in [0, 1]^d$ is a vector consisting of pixel intensity values and $d$ is the number of pixels forming the image under consideration.

Let

$$x_i = \frac{1}{k} ||S_O p_i||^2, \qquad (4)$$

for $i = 1, 2, \dots, N$.

Now $X_h = (x_1, x_2, \dots, x_N)$ denote a sequence of historical observations in a normal (in-control) state. Each observation $x_i \in [0, 1]$ is a real (non-negative) value obtained according to (4).

Although we do not make any assumption about distribution of $X_h$, it is presumed that $X_h$ is a sequence of independent observations taken from the same distribution. However, we suppose that $X_i$ (i.e., observations treated as random variables) are approximately Gaussian. It is not clear how large (or may be small) should be projection dimension $k$. On the one hand, if $k$ is large we can use the Central Limit Theorem as an argument for a Gaussianity of $X_i$, but
on the other hand it is postulated [13] that typical k-dimensional projections of probability measures on R^d are approximately Gaussian when k is sufficiently small. It is in our opinion an open problem.

## 3.1 A Shewart type chart for monitoring energy of images

Let $m_h$ denote the mean value of $X_h$ and $s_h$ its standard deviation. The upper control limit (UCL) is computed as

$$UCL = m_h + 3 s_h$$

and the lower control limit (LCL) is given by

$$LCL = m_h - 3 s_h.$$

Let $p$ be any observed image. The Shewart control chart for individual observations [16] allows us to decide that if

$$x = \frac{1}{k} \|S_{Op}\|^2 > UCL$$

or

$$x = \frac{1}{k} \|S_{Op}\|^2 < LCL,$$

then the system state connected with $x$ (i.e., with image $p$) is not normal (is out-of-control). This simple test will be further used for monitoring separate parts of the whole burning process image. Thus, the final decision will be in conjunction with partial tests (the logical conjunction will be used). More technical details will be provided in the next section.

## 4 Simulation study

A data set used for experiments consists of 144 images similar to that shown in Fig 1. Each image has 120 × 352 pixels, i.e., its vector dimension is 42240. Each image is assigned by an expert to one of the four classes (see Fig. 1). The overall quality of images is rather poor. We decided to not rely on color representation of the images since color-based segmentation of these images is too time-consuming. It occurred that pixel intensity in the gray scale is sufficient for the images analysis. As an alternative one can use red color channel (R) as very similar in the intensity values to the gray level image representation in this particular case. Each image in the sequence is divided into four sub-images consisting of 0 − 120 × 0 − 88 (sub-image type A), 0 − 120 × 89 − 176 (sub-image type B), 0 − 120 × 177 − 264 (sub-image type C) and 0 − 120 × 265 − 352 (sub-image type D) pixels of the original image.

The first ten images from the data set, which present normal gas burner state (see Fig. 1 d), was used as historical data. The first image in this set indicates the state in-between normal state and some lack of air state. It was included into
the normal state learning sequence, because we want to obtain a decision system
robust to a very small shortage of air. On the basis of this subset the levels
of alarm for the 4-dimensional chart were computed. Furthermore, the last ten
images, which present "no-air" state (see Fig. 1 a), was also used for providing
the additional alarm levels for this state. Thus, the remainder of images (from
11 till 134) were used as a testing sequence.

Fig.2 shows mean energy of sub-images (A, B, C, D) for all images in the
data set. Corresponding mean energy of the images estimated using 10 and 100
random projections are drawn in Fig. 3 and Fig. 4, respectively. One can observe,
that estimated mean energy of the images (blue lines) is very close to its true
values (yellow lines) even if dimensionality of the projection *k* is low.

The number of case images was rather restricted, but despite this we have
obtained satisfactory results. We expect that larger image data sets allow us to
design decision systems which could be used in practice.

<figure><img src="image_3.png" /><figcaption>**Fig. 2.** Mean energy of images A (blue line), B (yellow line), c (green line) and D (red line).</figcaption></figure>

Fig. 6 illustrates decisions about alarm for the whole image sequence (144 items). The red line on zero level indicates the in-control state (the air inlet is sufficiently open). The red line on 1 level shows the out-of-control state (the air hole is too small). The alarming system works almost perfectly. It does not accept as normal positions 45, 50 and 53 very similar (but slightly lighter) to the mentioned earlier position 1 in the learning sequence. Removing testing based on sub-images type A results in no alarms at positions 45, 50 and 53 (see Fig.7).

In a similar way as previously we can design a decision system which produces
an additional alarm signal for the no-air state (see Fig. 1 a). The system based
on A, B, C and partial images and the last ten images labeled by an expert as
connected with no-air state (closed air hole) indicates correctly all such cases.
<figure><img src="image_4.png" /><figcaption>**Fig. 3.** Mean energy of images A (blue line), B (yellow line), C (green line) and D (red line) estimated using $k = 10$ sparse random projections.</figcaption></figure>

<figure><img src="image_5.png" /><figcaption>**Fig. 4.** Mean energy of images A (blue line), B (yellow line), C (green line) and D (red line) estimated using $k = 100$ sparse random projections.</figcaption></figure>
<figure><img src="image_6.png" /><figcaption>**Fig. 5.** Mean energy of images D – true values (yellow lines) and estimated using $k = 10$ (left panel) and $k = 100$ (right panel) sparse random projections.</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>**Fig. 6.** Mean energy of images A, B, C, D – (violet, blue, yellow and green lines respectively) and estimated using $k = 10$ sparse random projections and a global alarm decision (red line).</figcaption></figure>
<figure><img src="image_8.png" /><figcaption>**Fig. 7.** Mean energy of images B,C, D – (blue, yellow and green lines respectively) and estimated using $k = 10$ sparse random projections and a global alarm level (red line).</figcaption></figure>

Additionally 6 images characterized by slightly turbulent flow (positions 24, 66, 74, 75 and 120, 121 also produce this kind of alarm. In fact this occurred when the air inlet was almost closed.

# 5 Comments and conclusion

The method proposed here can be applied to other processes observed using a camera when relatively large image changes are important. The proposed control chart may also be used without dimensionality reduction by random projections. Our motivation behind applying a sparse random projection are twofold. First, we want to obtain simultaneously a really simple and fast algorithm. Second, it is suggested [13] that typical $k$-dimensional projections of probability measures on $R^d$ are approximately Gaussian when $k$ is sufficiently small. The problem of obtaining an adequate statistical model of the monitored sequence of images is outside the scope of this paper.

*Acknowledgments* This research has been supported by the National Science Center under grant: 2012/07/B/ST7/01216.

# References

1. Achlioptas D.: Database-friendly random projections: Johnson-Lindenstrauss with binary coins, Journal of Computer and System Sciences 66, 671–687 (2003)
2. Ailon N. and Chazelle B.: The fast Johnson-Lindenstrauss transform and approximate nearest neighbors. SIAM J. Comput. 39 (1), 302-322 (2009)

3. Amador J.J.: Random projection and orthonormality for lossy image compression, Image and Vision Computing 25, 754-766 (2007)

4. Arriaga R.I., Vempala S.: An Algorithmic Theory of Learning: Robust Concepts and Random Projection. In: Proc. 40th Ann. Symp. Foundations of Computer Science, 616-623, (1999)

5. Brunelli, R.: Template matching techniques in computer vision. Theory and practice. Southern Gate, Chichester: Wiley (2009)

6. Dasgupta S. and Gupta A.: An elementary proof of the Johnson-Lindenstrauss Lemma. Random Structures and Algorithms, 22(1), 60-65 (2002)

7. Davies, E. R.: A comparison of methods for the rapid location of products and their features and defects. In: P. A. McKeown (Ed.). Proceedings of the 7th international conference on automated inspection and product control. Birmingham, AL (March 2628), 111-120 (1985)

8. Davies, E. R.: Machine vision: Theory, algorithms, practicalities. San Francisco: Morgan Kaufmann Publishers Inc (2005)

9. J. E. Fowler, Q. Du.: Anomaly Detection and Reconstruction From Random Projections, IEEE Transactions on Image Processing, 21(1), 184-195 (2012)

10. Gonzalez R.C., Woods R.E.: Digital Image Processing. Prentice Hall (2007)

11. Johnson WB., Lindenstrauss J.: Extensions of Lipshitz mapping into Hilbert space. Contemporary Mathematics 26, 189-206 (1984)

12. Matoušek, J.: On variants of the Johnson-Lindenstrauss lemma, Random Structures and Algorithms 33(2), 142-156 (2008)

13. Meckes E.: Approximation of Projections of Random Vectors. Journal of Theoretical Probability 25(2), 333-352 (2012)

14. Megahed, F.M., Woodall W.H. and Camelio, J.A.: A Review and Perspective on Control Charting with Image Data, Journal of Quality Technology 43(2), 84-98 (2011)

15. Megahed, F. M., Wells L. J., Camelio, J. A. and Woodall W.H.: A Spatiotemporal Method for the Monitoring of Image Data, Quality and Reliability Engineering International 28, 967-980 (2012)

16. Montgomery, D.C. : Introduction to Statistical Quality Control, 3rd Edn., John Wiley and Sons, New York, NY (1996)

17. Rafajlowicz E., Pawlak-Kruczek H. and Rafajlowicz W.: Statistical Classifier with Ordered Decisions as an Image Based Controller with Application to Gas Burners, Artificial Intelligence and Soft Computing - 13th International Conference, ICAISC 2014, Zakopane, Poland, June 1-5, 2014, Proceedings, Part I 586-597 (2014)

18. Scheitler, Christian, et al.: Experimental investigation of direct diamond laser cladding in combination with high speed camera based process monitoring, Journal of Laser Applications 28, 022304 (2016)

19. Skubalska-Rafajlowicz E.: Local correlation and entropy maps as tools for detecting defects in industrial images, International Journal of Applied Mathematics and Computer Science 18(1), 4147 (2008)

20. Skubalska-Rafajlowicz, E.: Detection and estimation translations of large images using random projections, In 7th International workshop on multidimensional (nD) systems (nDs), Poitiers 5-7 Sept. 2011, doi:10.1109/nDS.2011.6076838 (2011)

21. Skubalska-Rafajlowicz, E.: Random projections and Hotellings $T^2$ statistics for change detection in high-dimensional data stream, Int. J. Appl. Math. Comput. Sci. 23(2), 447-461 (2013)
22. Tsagkatakis, G., and Savakis, A.: A random projections model for object tracking under variable pose and multi-camera views. In: Proceedings of the third ACM/IEEE international conference on distributed smart cameras, 2009. ICDSC, 1–7 (2009) doi:10.1109/ICDSC.2009.5289384

23. Vempala S.: The Random Projection Method. American Mathematical Society, Providence (2004)