# Experimental Research on Quick Structural Health Monitoring Technique for Bridges Using Smartphone

Authors: Xuefeng Zhao; Kwang Ri; Ruicong Han; Yan Yu; Mingchu Li; Jinping Ou
Journal: Advances in Materials Science and Engineering
 (2016)

---

## Abstract

In the recent years, with the development and popularization of smartphone, the utilization of smartphone in the Structural Health Monitoring (SHM) has attracted increasing attention owing to its unique feature. Since bridges are of great importance to society and economy, bridge health monitoring has very practical significance during its service life. Furthermore, rapid damage assessment of bridge after an extreme event such as earthquake is very important in the recovery work. Smartphone-based bridge health monitoring and postevent damage evaluation have advantages over the conventional monitoring techniques, such as low cost, ease of installation, and convenience. Therefore, this study investigates the implementation feasibility of the quick bridge health monitoring technique using smartphone. A novel vision-based cable force measurement method using smartphone camera is proposed, and, then, its feasibility and practicality is initially validated through cable model test. An experiment regarding multiple parameters monitoring of one bridge scale model is carried out. Parameters, such as acceleration, displacement, and angle, are monitored using smartphone. The experiment results show that there is a good agreement between the reference sensor and smartphone measurements in both time and frequency domains.


---

## Body

## 1. Introduction

With the advances in sensor and computer technologies in the recent years, Structural Health Monitoring (SHM) has developed rapidly and has become a major research field in civil engineering, which provides a useful diagnostic tool for ensuring integrity and safety, detecting damage, and evaluating performance deterioration of civil infrastructures [1–3]. SHM systems have undergone significant development and been widely utilized on infrastructures, especially bridge structures [4, 5]. Present SHM systems have been mainly installed on some of large-scale structures or major construction projects with great significance [6], such as long-span bridges, due to the financial problems and practical difficulties associated with instrumentation and monitoring.Generally, there is possibility for the civil structures to be subjected to severe loadings during their service life owing to extreme disaster such as earthquake and typhoon, which causes serious damage to the integrity of the structures. When an extreme disaster occurs, the rapid damage detection of bridges will be helpful for the quick evaluation of transportation networks for the emergency response [7]. Although the SHM system installed on bridge provides real-time information for damage assessment after a disaster, not all bridges have been installed with the SHM system. Furthermore, the installed SHM systems can be easily destroyed in the disaster. Therefore, it is necessary to develop quick SHM technique for rapid structure response monitoring and safety assessment, which will provide preliminary damage evaluation result before time-consuming common inspection can be conducted. The rapid SHM technique based on ubiquitous smartphone with built-in sensors would make it possible for personnel to evaluate initial damage and safety status quickly, because of its features such as low cost, ease of installation, and convenience.Several researchers studied the monitoring ability of smartphones through laboratory and field tests and confirmed the potential usage of smartphones in the health monitoring of civil infrastructures. Yu et al. [8] proposed a new idea for mobile SHM using smartphone built-in sensors or external sensors board for the first time, carried out preliminary test to validate its feasibility and implementation, and then mentioned that mobile SHM system based on public participant under emergency condition is possible because of its features such as low cost and popularization. Morgenthal and Höpfner [9] investigated the effect of sampling rate on acceleration measurement. Android device (version 2.3) recorded acceleration data of shaking table with a sampling rate of 27 Hz under excitations of different frequencies. It was found that the vibration responses could not be accurately obtained for measuring vibration above Nyquist frequency of smartphone built-in accelerometer. Reilly et al. [10] developed a mobile application iShake using smartphones as seismologic sensors, which is possible for smartphones to measure and transmit ground motion data to a central server, and validated the accuracy of smartphone built-in sensors for seismic sensing application through shaking table tests. Sharma and Gupta [11] studied the use of smartphone in civil engineering and measured various field parameters including absolute location, distance, area, and perimeter using smartphone GPS receiver and also evaluated noise pollution using microphone of smartphone. Cimellaro et al. [12] developed multiple platforms including smartphones and Internet for rapid building damage assessment after a seismic event, which collected photos of damaged houses taken by residents or volunteers in damaged area as the first emergency response information. Han et al. [13] measured cable force of cable-stayed bridge with accelerometer embedded in smartphone, which showed that it is appropriate to estimate the cable force from smartphone inner sensors limited in precision of measurement because cable is relatively distinct in vibration rather than the other structural elements. Yu et al. [14] proposed a combination method of external sensor board and smartphone by a serial port or Wi-Fi interface to improve measurement accuracy, integrated high-precision micro electromechanical system (MEMS) sensors, and then validated its accuracy through vibration test on a three-layer steel frame model. Feng et al. [15] and Ozer et al. [16] studied the utilization of accelerometers embedded in smartphone for measuring different types of vibration and validated its capability for SHM through vibration response test on a reinforced concrete pedestrian bridge. Tan and Chen [17] verified the sensitivity and accuracy of smartphone inner sensors for measuring different vibration patterns such as sinusoidal waves of various frequencies, sinusoidal sweep, and earthquake waves through shaking table tests. Tests results demonstrated that the measurement accuracy of smartphones mainly depends on the type of vibration, the vibration directions, and the installation manner. Zhao et al. [18–20] performed the hoisting monitoring for structural members of bridge based on real-time monitoring information feedback between one controller smartphone and several collector smartphones and also developed displacement monitoring software D-Viewer, which enable monitoring of structural dynamic displacements by recognizing a laser spot centroid or predefined circle target via smartphone camera. Meanwhile, an international data sharing platform for cloud-SHM based on smartphone has been established, which is possible to upload the SHM data information collected by smartphone application Orion-CC and share with the public. Peng et al. [21] developed smartphone software E-Explorer using mobile Bluetooth communication technology to realize information delivery without any external network in the emergency events such as earthquake. As can be seen from the above studies, the research of SHM based on smartphone has developed rapidly and received considerable attention from numerous countries. Furthermore, it progresses from the previous single smartphone monitoring to multismartphones monitoring and from local monitoring to global data sharing, and the parameter has also expanded from acceleration as traditional measuring parameter to multiparameters such as displacement and angle.This paper carries out a comprehensive experimental study on the major structural members of cable-stayed bridge including deck and cable to verify the feasibility of the utilization of smartphone in the quick bridge health monitoring. First, one novel cable force measurement method is proposed, which enables the estimation of cable force based on the recognition for cable vibration using smartphone camera. And then comprehensive monitoring test regarding multiple structural parameters such as accelerometer, displacement, and angle is conducted on the bridge deck. The test results demonstrate the feasibility, accuracy, and reliability of bridge health monitoring method using smartphones.


## 2. D-Viewer and Orion-CC

Smartphone application provides users with a tool for extracting structural performance parameters by various integrated sensors, processing data automatically, and transmitting data wirelessly to a central server. D-Viewer and Orion-CC (Orion-Cloud Cell) are typical iOS (iPhone Operating System) smartphone applications developed by our research group for Structural Health Monitoring using smartphone, which are currently available for free at the iTunes Store [22, 23].


### 2.1. D-Viewer

In SHM practice, the displacement monitoring of bridges has an important effect on the evaluation of the structural safety and the damage detection. Recently, the laser projection-sensing technology has attracted growing interest for monitoring displacement in the field of bridge health monitoring owing to its low cost and ease of operation over traditional measuring methods [24].D-Viewer is a smartphone application for monitoring structural dynamic displacement with the aid of laser device and projection plate. A laser device is installed on the monitored object, the movement of the laser spot shot on the projection plate is recognized by the camera of smartphone, and then the real-time structural displacement is obtained by means of image processing method. Figure1 shows the initial setup interface. In this interface, the region of interest (ROI) and the function of front or rear camera can be selected for recognizing the movement of the laser spot; the diameter of a black circle as the calibration reference can be set to determine the ratio between the actual size and the pixel size of the black circle in advance. The interface of displacement monitoring is shown in Figure 2. Further details regarding operation guide and image processing method can be found in [18].Figure 1
Initial setup interface.Figure 2
Monitoring interface.D-Viewer was designed to identify a black circle as well as the laser spot shot on the projection as shown in Figure3; therefore, the structural static and dynamic displacements can be obtained easily by recognizing the movement of the preprinted black circle target attached on the structure using smartphone camera without laser device and projection plate, moreover, without professional expensive displacement sensors.Figure 3
Interface of selecting a monitoring method.


### 2.2. Orion-CC

Orion-CC was built for iOS 7.0 or higher platform, which can obtain not only acceleration and angle but also cable force by measuring structural vibration with the smartphone-embedded accelerometer and gyroscope. Figure4 shows three screenshots of the iOS (iPhone Operating System) application interface, which enables users to interact with the smartphone sensors.Figure 4
Main interface of Orion-CC.Orion-CC utilizes vibration method based on the iPhone built-in accelerometer to measure the cable force. In engineering application, the vibration method by which cable forces are estimated from measured frequency difference is often used for the measurement of cable forces due to its simplicity and speediness. In general, the frequency difference and the force calculation precision are influenced by mass, length, stiffness, and sag of the cable. Orion-CC uses the relationship between the frequency difference and cable force shown in (1), in which the effects of sag and stiffness are ignored to measure cable forces rapidly and conveniently using smartphone [25].(1)
T
=
4
m
l
2
Δ
f
2
,where m is the linear mass density, l is the cable length, and Δ
f is the frequency difference. The main function interface of cable force calculation is shown in Figure 5.Figure 5
Main function interface of cable force calculation.According to the cable vibrations, the power spectral density can be obtained from the acceleration time-history using FFT. And then the peak picking method is applied to extract the frequency difference from the power spectral density of the response acceleration. Finally, the cable force is estimated according to the cable length, cable linear density, and frequency difference. The interactive interface of Orion-CC reduces the need for professional training, as shown in Figures4 and 5. Therefore, the cable force can be extracted directly and rapidly by the application Orion-CC without any professional inspection device and training. Orion-CC is a valuable tool for an actual application of Structural Health Monitoring (SHM) because the cable force measuring method by Orion-CC has many advantages over other measuring methods, such as economy, convenience, and ease of operation.


## 2.1. D-Viewer

In SHM practice, the displacement monitoring of bridges has an important effect on the evaluation of the structural safety and the damage detection. Recently, the laser projection-sensing technology has attracted growing interest for monitoring displacement in the field of bridge health monitoring owing to its low cost and ease of operation over traditional measuring methods [24].D-Viewer is a smartphone application for monitoring structural dynamic displacement with the aid of laser device and projection plate. A laser device is installed on the monitored object, the movement of the laser spot shot on the projection plate is recognized by the camera of smartphone, and then the real-time structural displacement is obtained by means of image processing method. Figure1 shows the initial setup interface. In this interface, the region of interest (ROI) and the function of front or rear camera can be selected for recognizing the movement of the laser spot; the diameter of a black circle as the calibration reference can be set to determine the ratio between the actual size and the pixel size of the black circle in advance. The interface of displacement monitoring is shown in Figure 2. Further details regarding operation guide and image processing method can be found in [18].Figure 1
Initial setup interface.Figure 2
Monitoring interface.D-Viewer was designed to identify a black circle as well as the laser spot shot on the projection as shown in Figure3; therefore, the structural static and dynamic displacements can be obtained easily by recognizing the movement of the preprinted black circle target attached on the structure using smartphone camera without laser device and projection plate, moreover, without professional expensive displacement sensors.Figure 3
Interface of selecting a monitoring method.


## 2.2. Orion-CC

Orion-CC was built for iOS 7.0 or higher platform, which can obtain not only acceleration and angle but also cable force by measuring structural vibration with the smartphone-embedded accelerometer and gyroscope. Figure4 shows three screenshots of the iOS (iPhone Operating System) application interface, which enables users to interact with the smartphone sensors.Figure 4
Main interface of Orion-CC.Orion-CC utilizes vibration method based on the iPhone built-in accelerometer to measure the cable force. In engineering application, the vibration method by which cable forces are estimated from measured frequency difference is often used for the measurement of cable forces due to its simplicity and speediness. In general, the frequency difference and the force calculation precision are influenced by mass, length, stiffness, and sag of the cable. Orion-CC uses the relationship between the frequency difference and cable force shown in (1), in which the effects of sag and stiffness are ignored to measure cable forces rapidly and conveniently using smartphone [25].(1)
T
=
4
m
l
2
Δ
f
2
,where m is the linear mass density, l is the cable length, and Δ
f is the frequency difference. The main function interface of cable force calculation is shown in Figure 5.Figure 5
Main function interface of cable force calculation.According to the cable vibrations, the power spectral density can be obtained from the acceleration time-history using FFT. And then the peak picking method is applied to extract the frequency difference from the power spectral density of the response acceleration. Finally, the cable force is estimated according to the cable length, cable linear density, and frequency difference. The interactive interface of Orion-CC reduces the need for professional training, as shown in Figures4 and 5. Therefore, the cable force can be extracted directly and rapidly by the application Orion-CC without any professional inspection device and training. Orion-CC is a valuable tool for an actual application of Structural Health Monitoring (SHM) because the cable force measuring method by Orion-CC has many advantages over other measuring methods, such as economy, convenience, and ease of operation.


## 3. Vision-Based Cable Force Measuring Test

### 3.1. Overview of Experiment

As mentioned before, the structural static and dynamic displacements can be obtained easily by recognizing the movement of not only a laser spot but also a black circle target, by means of smartphone camera. Based on this fact, the cable force test on the model cable is conducted in order to investigate the feasibility of a novel vision-based cable force measuring method using smartphone.The cable model is installed in the Bridge Lab of Dalian University of Technology. The model is a 15.53 m single cable, and its linear mass density is 3.95 kg/m. As the smartphone for experiment, two smartphones, iPhone 6, are used; the one installed with APP D-Viewer is mounted on a tripod via double-sided adhesive tape in order to extract vibration characteristics of cable for determining cable force using smartphone camera, while the other installed with APP Orion-CC is fixed on the cable model via mobile phone jacket to obtain cable force using smartphone built-in accelerometer. An organic glass panel, on which there is a preprinted black circle, is attached to the model cable using superglue. The distance between smartphone and cable model is adjusted using the tripod according to the size of panel in order to ensure a whole white background. Figure6 shows the installation of smartphones, and Table 1 shows the relevant parameters of iPhone 6 used in test [26].Table 1
Relevant parameters of iPhone 6.
Operating system
Display
Chips
Video recording
Sensors
IOS 9
Retina HD display4.7-inch (diagonal)1334-by-750-pixel resolution at 326 ppi1400 : 1 contrast ratio (typical)
A8 chip with 64-bit architectureM8 motion coprocessor
1080 p HD video recording (30 fps or 60 fps)
BarometerThree-axis gyroAccelerometerProximity sensorAmbient light sensorFigure 6
The installation of smartphones.Orion-CC is designed to collect data with a sampling rate of 100 Hz, and the sampling rate of D-Viewer is 30 Hz; namely, it is the same as the frames per second (fps) of smartphone camera. Both of smartphones collect the vibration data of the cable simultaneously under the artificial excitation for one minute.


### 3.2. Test Results

Since the focus of this test is on the verification of feasibility of cable force measurement method using smartphone camera, the vibration data of the model cable acquired by Orion-CC and D-Viewer is analyzed using MATLAB. Figures7 and 8 plot the acceleration and displacement time histories obtained, respectively, from D-Viewer and Orion-CC, together with corresponding PSD results.Figure 7
Results of Orion-CC.
(a)
Acceleration time history
(b)
Corresponding PSDFigure 8
Results of D-Viewer.
(a)
Displacement time history
(b)
Corresponding PSDAs shown in figures, although the vibration amplitudes and PSD peak values are different due to the differences of sampling rate, measuring position, and measuring item, it is observed that the same frequency components can be accurately obtained by the different methods from both of smartphone applications. Moreover, it is noteworthy that the natural frequency of the first vibration mode for estimating cable force can be accurately obtained by the displacement response measurement of the cable using the application D-Viewer. In general, as the position at which smartphone is mounted is relatively low compared with the length of cable, the first peak in the corresponding PSD obtained by the vibration measurement of cable is not very clear, and thus it is usually difficult to identify the natural frequency of the first vibration mode for estimating cable force by the application Orion-CC using smartphone built-in accelerometer. As can be seen from Figure8(b), it is impossible to extract the natural frequencies at the higher mode (above 15 Hz) by the application D-Viewer because of its low sampling rate. However, the result shows that the frequency components can be accurately obtained in the lower frequency domain, and it is clear that the fps of smartphone camera will be increased along with the improvement of smartphone performance in the future.The frequency difference is obtained by means of peak picking method from PSD, and the cable force is determined from (1). Table 2 summarizes the frequency difference and cable force identified by two methods. As can be seen from Table 2, the cable forces obtained by D-Viewer and Orion-CC are highly comparable, with significantly small error of less than 1.1%. Therefore, it is concluded that vision-based cable force measurement using smartphone camera is feasible in the sampling rate of 30 fps.Table 2
Comparison of the results from Orion-CC and D-Viewer.
Item
Frequency difference (Hz)
Cable force (KN)
Orion-CC
3.72
52.466
D-Viewer
3.70
51.904
Error (%)
0.54
1.07


## 3.1. Overview of Experiment

As mentioned before, the structural static and dynamic displacements can be obtained easily by recognizing the movement of not only a laser spot but also a black circle target, by means of smartphone camera. Based on this fact, the cable force test on the model cable is conducted in order to investigate the feasibility of a novel vision-based cable force measuring method using smartphone.The cable model is installed in the Bridge Lab of Dalian University of Technology. The model is a 15.53 m single cable, and its linear mass density is 3.95 kg/m. As the smartphone for experiment, two smartphones, iPhone 6, are used; the one installed with APP D-Viewer is mounted on a tripod via double-sided adhesive tape in order to extract vibration characteristics of cable for determining cable force using smartphone camera, while the other installed with APP Orion-CC is fixed on the cable model via mobile phone jacket to obtain cable force using smartphone built-in accelerometer. An organic glass panel, on which there is a preprinted black circle, is attached to the model cable using superglue. The distance between smartphone and cable model is adjusted using the tripod according to the size of panel in order to ensure a whole white background. Figure6 shows the installation of smartphones, and Table 1 shows the relevant parameters of iPhone 6 used in test [26].Table 1
Relevant parameters of iPhone 6.
Operating system
Display
Chips
Video recording
Sensors
IOS 9
Retina HD display4.7-inch (diagonal)1334-by-750-pixel resolution at 326 ppi1400 : 1 contrast ratio (typical)
A8 chip with 64-bit architectureM8 motion coprocessor
1080 p HD video recording (30 fps or 60 fps)
BarometerThree-axis gyroAccelerometerProximity sensorAmbient light sensorFigure 6
The installation of smartphones.Orion-CC is designed to collect data with a sampling rate of 100 Hz, and the sampling rate of D-Viewer is 30 Hz; namely, it is the same as the frames per second (fps) of smartphone camera. Both of smartphones collect the vibration data of the cable simultaneously under the artificial excitation for one minute.


## 3.2. Test Results

Since the focus of this test is on the verification of feasibility of cable force measurement method using smartphone camera, the vibration data of the model cable acquired by Orion-CC and D-Viewer is analyzed using MATLAB. Figures7 and 8 plot the acceleration and displacement time histories obtained, respectively, from D-Viewer and Orion-CC, together with corresponding PSD results.Figure 7
Results of Orion-CC.
(a)
Acceleration time history
(b)
Corresponding PSDFigure 8
Results of D-Viewer.
(a)
Displacement time history
(b)
Corresponding PSDAs shown in figures, although the vibration amplitudes and PSD peak values are different due to the differences of sampling rate, measuring position, and measuring item, it is observed that the same frequency components can be accurately obtained by the different methods from both of smartphone applications. Moreover, it is noteworthy that the natural frequency of the first vibration mode for estimating cable force can be accurately obtained by the displacement response measurement of the cable using the application D-Viewer. In general, as the position at which smartphone is mounted is relatively low compared with the length of cable, the first peak in the corresponding PSD obtained by the vibration measurement of cable is not very clear, and thus it is usually difficult to identify the natural frequency of the first vibration mode for estimating cable force by the application Orion-CC using smartphone built-in accelerometer. As can be seen from Figure8(b), it is impossible to extract the natural frequencies at the higher mode (above 15 Hz) by the application D-Viewer because of its low sampling rate. However, the result shows that the frequency components can be accurately obtained in the lower frequency domain, and it is clear that the fps of smartphone camera will be increased along with the improvement of smartphone performance in the future.The frequency difference is obtained by means of peak picking method from PSD, and the cable force is determined from (1). Table 2 summarizes the frequency difference and cable force identified by two methods. As can be seen from Table 2, the cable forces obtained by D-Viewer and Orion-CC are highly comparable, with significantly small error of less than 1.1%. Therefore, it is concluded that vision-based cable force measurement using smartphone camera is feasible in the sampling rate of 30 fps.Table 2
Comparison of the results from Orion-CC and D-Viewer.
Item
Frequency difference (Hz)
Cable force (KN)
Orion-CC
3.72
52.466
D-Viewer
3.70
51.904
Error (%)
0.54
1.07


## 4. Smartphone-Based Structural Health Monitoring Testing

### 4.1. Overview of Experiment

In order to investigate the implementation feasibility of the quick bridge health monitoring technique using smartphone, a comprehensive experiment is conducted for a laboratory-scale suspension bridge. The test focuses on the identification of natural frequency through the extraction of vibration response of different physical indices such as acceleration, displacement, and angle in different locations using smartphone application.As the experiment object, a concrete self-anchored suspension bridge model, which is designed and constructed with 1/28 scale of Zhuanghe Construction Bridge located in Zhuanghe city of China shown in Figure9, is selected in the Bridge Lab of Dalian University of Technology. This scale bridge model consists of a main span of 7.14 m, a box girder of reinforced concrete, main cables and hangers of twisted wire rope, and two towers.Figure 9
Zhuanghe Construction Bridge.To measure the dynamic characteristics of the bridge model, three smartphones and acceleration sensors are installed at mid span and one-quarter spans of the model via double-sided adhesive tape, respectively. The reference coordinate of smartphone for measuring vibration responses is shown in Figure10.Figure 10
The reference coordinate system of smartphone.Also the displacement monitoring system using smartphone, including a laser transmitter and a projection plate, is mounted on the bridge model to measure the displacement response of mid span. A sheet of A4 white paper, on which a black circle of 25 mm in diameter is preprinted, is attached to projection plate, and then the calibration is conducted in the initial setup interface for measuring. The laser transmitter is fixed at one end of the bridge model to remain stationary during experiment. To verify the accuracy of the displacement monitoring method based on the smartphone, a laser displacement sensor is fixed by means of steel frame at the mid span of the model. The main instrument parameters are indicated in Table3.Table 3
Main instruments parameters.
Instrument
Brand
Model
Parameter
Piezoelectric accelerometer
SINOCERA
CA-YD-188
Sensitivity: 500 mV/g ± 5%Measurement range: 10 gFrequency range: 0.3–2500 Hz
Laser displacement sensor
MICR-EPSILON
ILD 11300
Measuring range: 50 mm to 150 mmResolution (dynamic): 100 microns
Laser transmitter
Ruic
Red-light semiconductor laser
Output wavelength: 650 nmOverall dimensions: Φ 20 mm × 90 mm Light spot diameter is 3 mm at a 20 m distanceAll of the four smartphones used in experiment are iPhone 6 with a three-axis Bosch BMA280 accelerometer [27], a three-axis InvenSense MPU-6500 accelerometer, and a three-axis InvenSense MPU-6500 gyroscope [28]. The properties of two accelerometers and gyroscope are listed in Tables 4 and 5.Table 4
Bosch BMA280 and InvenSense MPU-6500 accelerometer properties.
Parameter
Bosch BMA280
InvenSense MPU-6500
Units
Digital resolution
14
16
Bits
Full-scale range
±2
±2
g
±4
±4
g
±8
±8
g
±16
±16
g
Sensitivity scale
4096
16384
LSB/g
2048
8192
LSB/g
1024
4096
LSB/g
512
2048
LSB/g
Cross-axis sensitivity
1
2
%
Nonlinearity
0.5
0.5
%
Zero-g offset
±50
±60
mg
Noise density
120
300
μg/√HzTable 5
InvenSense MPU-6500 gyroscope properties.
Parameter
Technical data
Units
Digital resolution
16
Bits
Full-scale range
±250
°/s
±500
°/s
±1000
°/s
±2000
°/s
Sensitivity scale
131
LSB/(°/s)
65.5
LSB/(°/s)
32.8
LSB/(°/s)
16.4
LSB/(°/s)
Nonlinearity
±0.1
%
Cross-axis sensitivity
±2
%
Noise density
0.01
°/s/√Hz
Initial zero-rate output
±5
°/s
Mechanical frequency
27
KHzAs mentioned before, the dynamic responses of acceleration and angle in the vibration of structure can be obtained by the application Orion-CC using the smartphone-embedded accelerometer and gyroscope, and also the dynamic displacement response of the structure can be extracted by recognizing the movement of the laser spot shot on the projection plate by means of the application D-Viewer using smartphone camera.In this experiment, three smartphones (1 (left), 2 (mid), and 3 (right)) installed with Orion-CC are used to measure both acceleration and angle responses of the model with a sampling rate of 100 Hz, and the other smartphone (4 (mid)) installed with D-Viewer monitors the dynamic displacement of the mid span of the model with a sampling rate of 30 Hz. All of reference sensors are connected to a sensor node through cable, respectively, and the vibration responses are recorded in computer during measurement. The scale bridge model and the layout of the smartphone and sensors are shown in Figure11. The test is carried out simultaneously under the artificial impact excited on the mid span.Figure 11
Setup of experiment.


### 4.2. Test Results

The vibration responses obtained from smartphones and sensors are compared in both time and frequency domains. The natural frequency of the bridge model is identified by the peak picking method from the power spectral densities of different vibration responses. For brevity, thez-axis (direction of gravity) acceleration responses and the rotation angle responses around x-axis (vertical to span direction) are used to identify the natural frequency of the bridge model.


#### 4.2.1. Acceleration Response Results

Figures12–14 show the acceleration time history responses, comparisons in time domain, and the corresponding PSD measured by the smartphones and the reference accelerometers at three different points of the bridge model, respectively. Since the duration of vibration response on the artificial impact is less than 10 s, the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details. The peak responses are obtained as 0.38 g (left), 0.64 g (mid), and 0.29 g (right) by smartphones, respectively. A noticeable difference exists between the mid span and quarter span in terms of amplitude.Figure 12
Acceleration measurements (left quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 13
Acceleration measurements (mid span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 14
Acceleration measurements (right quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen from comparison figures, the measurements of smartphone agree well with the measurements of reference accelerometers in terms of amplitude characteristics. The identified natural frequencies of bridge model are summarized in Table6. The natural frequency is identified as 4.58, 4.56, and 4.57 Hz, respectively, at three different measuring points by three reference accelerometers. Their counterparts measured by three smartphones are 4.56, 4.57, and 4.58 Hz. The excellent agreement is observed between the frequency values obtained by the reference accelerometers and smartphones at different measuring points, with a maximum error of 0.44%.Table 6
Comparison of natural frequency identified from acceleration measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.58
4.56
4.57
Error (%)
0.44
0.22
0.22


#### 4.2.2. Angle Response Results

The angle time history responses and corresponding PSD measured by three smartphones at different measuring points are shown in Figures15–18, respectively. As can be seen from Figures 16 and 18, the angle vibration responses of the mid span obtained from smartphone 2 are not very clear in both time and frequency domains compared to the other ones because theoretically there is no change in the slope of the mid span according to the vibration in this test case. The natural frequencies extracted from PSD of angle measurements are compared with the previous ones measured by the reference accelerometers. Table 7 lists the identified natural frequency values. The natural frequency is not accurately extracted from the angle measurement of the mid span as shown in Table 7. The other ones are 4.68 and 4.59 Hz, while their counterparts measured by the reference accelerometers are 4.56 and 4.58 Hz. The errors in the natural frequency values at each measuring point are within 2.63%. It is observed that the bridge health monitoring based on the angle measurements using smartphones is feasible and reliable.Table 7
Comparison of natural frequency identified from angle measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.68
—
4.59
Error (%)
2.63
—
0.22Figure 15
Angle measurement (left quarter span).Figure 16
Angle measurement (mid span).Figure 17
Angle measurement (right quarter span).Figure 18
PSD of angle responses.


#### 4.2.3. Displacement Response Results

Figure19 plots the displacement time history responses, comparisons in time domain, and the corresponding PSD obtained from smartphone 4 and the laser displacement sensor at mid span of the bridge model. The identified natural frequencies of bridge model are summarized in Table 8. Since the sampling rate of the smartphone for displacement monitoring (30 Hz) is different with the reference one (100 Hz), the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details.Table 8
Comparison of natural frequency identified from displacement measurements.
Location
4 (mid)
Natural frequency (Hz)
Displacement sensor
4.56
Smartphone (D-Viewer)
4.68
Error (%)
2.63Figure 19
Displacement measurement.
(a)
Displacement time history (sensor)
(b)
Displacement time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen in Figure19(c), although the sampling rates are different, the displacement response time histories agree well with one another. The natural frequency of the bridge model measured by the laser displacement sensor is 4.56 Hz, while the one measured by smartphone 4 is 4.68 Hz. Again, the satisfactory agreement is observed between the frequency values obtained by the reference sensor and smartphone.


## 4.1. Overview of Experiment

In order to investigate the implementation feasibility of the quick bridge health monitoring technique using smartphone, a comprehensive experiment is conducted for a laboratory-scale suspension bridge. The test focuses on the identification of natural frequency through the extraction of vibration response of different physical indices such as acceleration, displacement, and angle in different locations using smartphone application.As the experiment object, a concrete self-anchored suspension bridge model, which is designed and constructed with 1/28 scale of Zhuanghe Construction Bridge located in Zhuanghe city of China shown in Figure9, is selected in the Bridge Lab of Dalian University of Technology. This scale bridge model consists of a main span of 7.14 m, a box girder of reinforced concrete, main cables and hangers of twisted wire rope, and two towers.Figure 9
Zhuanghe Construction Bridge.To measure the dynamic characteristics of the bridge model, three smartphones and acceleration sensors are installed at mid span and one-quarter spans of the model via double-sided adhesive tape, respectively. The reference coordinate of smartphone for measuring vibration responses is shown in Figure10.Figure 10
The reference coordinate system of smartphone.Also the displacement monitoring system using smartphone, including a laser transmitter and a projection plate, is mounted on the bridge model to measure the displacement response of mid span. A sheet of A4 white paper, on which a black circle of 25 mm in diameter is preprinted, is attached to projection plate, and then the calibration is conducted in the initial setup interface for measuring. The laser transmitter is fixed at one end of the bridge model to remain stationary during experiment. To verify the accuracy of the displacement monitoring method based on the smartphone, a laser displacement sensor is fixed by means of steel frame at the mid span of the model. The main instrument parameters are indicated in Table3.Table 3
Main instruments parameters.
Instrument
Brand
Model
Parameter
Piezoelectric accelerometer
SINOCERA
CA-YD-188
Sensitivity: 500 mV/g ± 5%Measurement range: 10 gFrequency range: 0.3–2500 Hz
Laser displacement sensor
MICR-EPSILON
ILD 11300
Measuring range: 50 mm to 150 mmResolution (dynamic): 100 microns
Laser transmitter
Ruic
Red-light semiconductor laser
Output wavelength: 650 nmOverall dimensions: Φ 20 mm × 90 mm Light spot diameter is 3 mm at a 20 m distanceAll of the four smartphones used in experiment are iPhone 6 with a three-axis Bosch BMA280 accelerometer [27], a three-axis InvenSense MPU-6500 accelerometer, and a three-axis InvenSense MPU-6500 gyroscope [28]. The properties of two accelerometers and gyroscope are listed in Tables 4 and 5.Table 4
Bosch BMA280 and InvenSense MPU-6500 accelerometer properties.
Parameter
Bosch BMA280
InvenSense MPU-6500
Units
Digital resolution
14
16
Bits
Full-scale range
±2
±2
g
±4
±4
g
±8
±8
g
±16
±16
g
Sensitivity scale
4096
16384
LSB/g
2048
8192
LSB/g
1024
4096
LSB/g
512
2048
LSB/g
Cross-axis sensitivity
1
2
%
Nonlinearity
0.5
0.5
%
Zero-g offset
±50
±60
mg
Noise density
120
300
μg/√HzTable 5
InvenSense MPU-6500 gyroscope properties.
Parameter
Technical data
Units
Digital resolution
16
Bits
Full-scale range
±250
°/s
±500
°/s
±1000
°/s
±2000
°/s
Sensitivity scale
131
LSB/(°/s)
65.5
LSB/(°/s)
32.8
LSB/(°/s)
16.4
LSB/(°/s)
Nonlinearity
±0.1
%
Cross-axis sensitivity
±2
%
Noise density
0.01
°/s/√Hz
Initial zero-rate output
±5
°/s
Mechanical frequency
27
KHzAs mentioned before, the dynamic responses of acceleration and angle in the vibration of structure can be obtained by the application Orion-CC using the smartphone-embedded accelerometer and gyroscope, and also the dynamic displacement response of the structure can be extracted by recognizing the movement of the laser spot shot on the projection plate by means of the application D-Viewer using smartphone camera.In this experiment, three smartphones (1 (left), 2 (mid), and 3 (right)) installed with Orion-CC are used to measure both acceleration and angle responses of the model with a sampling rate of 100 Hz, and the other smartphone (4 (mid)) installed with D-Viewer monitors the dynamic displacement of the mid span of the model with a sampling rate of 30 Hz. All of reference sensors are connected to a sensor node through cable, respectively, and the vibration responses are recorded in computer during measurement. The scale bridge model and the layout of the smartphone and sensors are shown in Figure11. The test is carried out simultaneously under the artificial impact excited on the mid span.Figure 11
Setup of experiment.


## 4.2. Test Results

The vibration responses obtained from smartphones and sensors are compared in both time and frequency domains. The natural frequency of the bridge model is identified by the peak picking method from the power spectral densities of different vibration responses. For brevity, thez-axis (direction of gravity) acceleration responses and the rotation angle responses around x-axis (vertical to span direction) are used to identify the natural frequency of the bridge model.


### 4.2.1. Acceleration Response Results

Figures12–14 show the acceleration time history responses, comparisons in time domain, and the corresponding PSD measured by the smartphones and the reference accelerometers at three different points of the bridge model, respectively. Since the duration of vibration response on the artificial impact is less than 10 s, the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details. The peak responses are obtained as 0.38 g (left), 0.64 g (mid), and 0.29 g (right) by smartphones, respectively. A noticeable difference exists between the mid span and quarter span in terms of amplitude.Figure 12
Acceleration measurements (left quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 13
Acceleration measurements (mid span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 14
Acceleration measurements (right quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen from comparison figures, the measurements of smartphone agree well with the measurements of reference accelerometers in terms of amplitude characteristics. The identified natural frequencies of bridge model are summarized in Table6. The natural frequency is identified as 4.58, 4.56, and 4.57 Hz, respectively, at three different measuring points by three reference accelerometers. Their counterparts measured by three smartphones are 4.56, 4.57, and 4.58 Hz. The excellent agreement is observed between the frequency values obtained by the reference accelerometers and smartphones at different measuring points, with a maximum error of 0.44%.Table 6
Comparison of natural frequency identified from acceleration measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.58
4.56
4.57
Error (%)
0.44
0.22
0.22


### 4.2.2. Angle Response Results

The angle time history responses and corresponding PSD measured by three smartphones at different measuring points are shown in Figures15–18, respectively. As can be seen from Figures 16 and 18, the angle vibration responses of the mid span obtained from smartphone 2 are not very clear in both time and frequency domains compared to the other ones because theoretically there is no change in the slope of the mid span according to the vibration in this test case. The natural frequencies extracted from PSD of angle measurements are compared with the previous ones measured by the reference accelerometers. Table 7 lists the identified natural frequency values. The natural frequency is not accurately extracted from the angle measurement of the mid span as shown in Table 7. The other ones are 4.68 and 4.59 Hz, while their counterparts measured by the reference accelerometers are 4.56 and 4.58 Hz. The errors in the natural frequency values at each measuring point are within 2.63%. It is observed that the bridge health monitoring based on the angle measurements using smartphones is feasible and reliable.Table 7
Comparison of natural frequency identified from angle measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.68
—
4.59
Error (%)
2.63
—
0.22Figure 15
Angle measurement (left quarter span).Figure 16
Angle measurement (mid span).Figure 17
Angle measurement (right quarter span).Figure 18
PSD of angle responses.


### 4.2.3. Displacement Response Results

Figure19 plots the displacement time history responses, comparisons in time domain, and the corresponding PSD obtained from smartphone 4 and the laser displacement sensor at mid span of the bridge model. The identified natural frequencies of bridge model are summarized in Table 8. Since the sampling rate of the smartphone for displacement monitoring (30 Hz) is different with the reference one (100 Hz), the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details.Table 8
Comparison of natural frequency identified from displacement measurements.
Location
4 (mid)
Natural frequency (Hz)
Displacement sensor
4.56
Smartphone (D-Viewer)
4.68
Error (%)
2.63Figure 19
Displacement measurement.
(a)
Displacement time history (sensor)
(b)
Displacement time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen in Figure19(c), although the sampling rates are different, the displacement response time histories agree well with one another. The natural frequency of the bridge model measured by the laser displacement sensor is 4.56 Hz, while the one measured by smartphone 4 is 4.68 Hz. Again, the satisfactory agreement is observed between the frequency values obtained by the reference sensor and smartphone.


## 4.2.1. Acceleration Response Results

Figures12–14 show the acceleration time history responses, comparisons in time domain, and the corresponding PSD measured by the smartphones and the reference accelerometers at three different points of the bridge model, respectively. Since the duration of vibration response on the artificial impact is less than 10 s, the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details. The peak responses are obtained as 0.38 g (left), 0.64 g (mid), and 0.29 g (right) by smartphones, respectively. A noticeable difference exists between the mid span and quarter span in terms of amplitude.Figure 12
Acceleration measurements (left quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 13
Acceleration measurements (mid span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDFigure 14
Acceleration measurements (right quarter span).
(a)
Acceleration time history (sensor)
(b)
Acceleration time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen from comparison figures, the measurements of smartphone agree well with the measurements of reference accelerometers in terms of amplitude characteristics. The identified natural frequencies of bridge model are summarized in Table6. The natural frequency is identified as 4.58, 4.56, and 4.57 Hz, respectively, at three different measuring points by three reference accelerometers. Their counterparts measured by three smartphones are 4.56, 4.57, and 4.58 Hz. The excellent agreement is observed between the frequency values obtained by the reference accelerometers and smartphones at different measuring points, with a maximum error of 0.44%.Table 6
Comparison of natural frequency identified from acceleration measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.58
4.56
4.57
Error (%)
0.44
0.22
0.22


## 4.2.2. Angle Response Results

The angle time history responses and corresponding PSD measured by three smartphones at different measuring points are shown in Figures15–18, respectively. As can be seen from Figures 16 and 18, the angle vibration responses of the mid span obtained from smartphone 2 are not very clear in both time and frequency domains compared to the other ones because theoretically there is no change in the slope of the mid span according to the vibration in this test case. The natural frequencies extracted from PSD of angle measurements are compared with the previous ones measured by the reference accelerometers. Table 7 lists the identified natural frequency values. The natural frequency is not accurately extracted from the angle measurement of the mid span as shown in Table 7. The other ones are 4.68 and 4.59 Hz, while their counterparts measured by the reference accelerometers are 4.56 and 4.58 Hz. The errors in the natural frequency values at each measuring point are within 2.63%. It is observed that the bridge health monitoring based on the angle measurements using smartphones is feasible and reliable.Table 7
Comparison of natural frequency identified from angle measurements.
Location
1 (left)
2 (mid)
3 (right)
Natural frequency (Hz)
Accelerometer
4.56
4.57
4.58
Smartphone (Orion-CC)
4.68
—
4.59
Error (%)
2.63
—
0.22Figure 15
Angle measurement (left quarter span).Figure 16
Angle measurement (mid span).Figure 17
Angle measurement (right quarter span).Figure 18
PSD of angle responses.


## 4.2.3. Displacement Response Results

Figure19 plots the displacement time history responses, comparisons in time domain, and the corresponding PSD obtained from smartphone 4 and the laser displacement sensor at mid span of the bridge model. The identified natural frequencies of bridge model are summarized in Table 8. Since the sampling rate of the smartphone for displacement monitoring (30 Hz) is different with the reference one (100 Hz), the plots of comparisons in time domain are enlarged (between 4 s and 5 s) to show more details.Table 8
Comparison of natural frequency identified from displacement measurements.
Location
4 (mid)
Natural frequency (Hz)
Displacement sensor
4.56
Smartphone (D-Viewer)
4.68
Error (%)
2.63Figure 19
Displacement measurement.
(a)
Displacement time history (sensor)
(b)
Displacement time history (smartphone)
(c)
Comparison
(d)
Corresponding PSDAs can be seen in Figure19(c), although the sampling rates are different, the displacement response time histories agree well with one another. The natural frequency of the bridge model measured by the laser displacement sensor is 4.56 Hz, while the one measured by smartphone 4 is 4.68 Hz. Again, the satisfactory agreement is observed between the frequency values obtained by the reference sensor and smartphone.


## 5. Conclusion

In this study, a comprehensive experiment research, including cable force test and bridge model test, was carried out to verify the feasibility of the quick bridge health monitoring technique using smartphone. First, the vision-based cable force measurement method was proposed in this paper, and then the comparison test was conducted on the cable model to verify the feasibility of proposed method. The natural frequency components and cable forces measured by the application D-Viewer were compared with the results measured by the application Orion-CC. While it is difficult to obtain the natural frequencies at the higher mode due to the sampling rate of smartphone camera, the frequency components including the natural frequency of the first mode were estimated accurately at the lower vibration mode. The test result demonstrated the feasibility and accuracy of vision-based cable force measurement using smartphone, with significantly small error of less than 1.1%. Finally, the comprehensive monitoring test regarding multiple structural parameters was conducted on the scale bridge model. The vibration responses obtained from smartphones and sensors were compared in both time and frequency domains. The natural frequency of the bridge model was estimated accurately from the vibration responses of multiple structural parameters such as acceleration, angle, and displacement, with a maximum error of 2.63%. The tests demonstrated that it is possible to extract the dynamic characteristics of the bridge from the various kinds of vibration responses using smartphone and verified the feasibility, accuracy, and reliability of bridge health monitoring method using smartphones.Based on these preliminary efforts, we are exploring the comprehensive and rapid postevent damage assessment application for bridges using smartphones.



---

*Source: 1871230-2016-10-16.xml*