# Encryption of 3D Point Cloud Object with Deformed Fringe

Authors: Xin Yang; Hongbo Zhang
Journal: Advances in Optical Technologies
 (2016)

---

## Abstract

A 3D point cloud object encryption method was proposed with this study. With the method, a mapping relationship between 3D coordinates was formulated andZ coordinate was transformed to deformed fringe by a phase coding method. The deformed fringe and gray image were used for encryption and decryption with simulated off-axis digital Fresnel hologram. Results indicated that the proposed method is able to accurately decrypt the coordinates and gray image of the 3D object. The method is also robust against occlusion attacks.


---

## Body

## 1. Introduction

Image encryption has been extensively studied in the past. It includes encryption of 2D and 3D objects through computational methods. For example, discrete fractional Fourier transform, Fibonacci transformation, and discrete cosine transform have been used to for image or 3D object encryption [1–3]. Alternatively, holographic encryption has also been applied for encrypting and decrypting information. Holographic encryption has advantages in providing flexibility in selection of various encryption parameters including optical wavelength, diffraction distance, and polarization. The encryption of 2D image uses optical methods such as wavelength multiplexing method [4, 5], two-step phase-shifting interferometry [6], computer-generated hologram [7], joint transform correlator [8], and modulation of plane wave [9] as reference wave. The significance of 3D information encryption is also obvious and many methods for the encryption of 3D objects such as using digital holography [10–12] and computer-generated holography [13] have been proposed. However, for most of 3D object encryption, object information has yet been fully reconstructed in terms of accuracy and robustness, although the 3D information is very important for practical utilization [14, 15]. It is mostly due to the complexity of the computation and sensitivity of the parameters inherited in the methods.More robust methods were created to reduce the sensitivity of the encryption parameters hence to increase the validity of the encryption under different environment. Among them, the integral imaging method has been popularized due to its use of structured pinholes to enhance the data redundancy and encryption robustness, yet the method involves use of complex experimental setup and simulation [1, 16]. Advanced 3D digital holography that has been also applied for 3D image encryption, though robust, lacks accuracy and is insufficiently strong in encryption process due to the direct use of object coordinate information in the encryption process [17].In this paper, we proposed robust and accurate, yet less computation intensive 3D point cloud object encryption. At the center of the method, a mapping relationship betweenX, Y, and Z was formulated. Z coordinate of the 3D object was phase coded and subsequently transformed to deformed fringe. With deformed fringe and gray image of the 3D object, a conventional off-axis digital Fresnel holography method was utilized to encrypt and record their information. Following the decryption and reconstruction, both deformed fringe and gray image were reconstructed. 3D object was hence reconstructed with X, Y, Z, and gray image information.


## 2. Methods

The angular orthogonal projection geometry [18] is used to convert the 3D point objects of one specific perspective into x-y plane and Z coordinate. Figure 1 is the angular orthogonal projection and the projection image coordinate (xi,yi) and the object point (xk,yk,zk,grayk) from a gray model are related by(1)xi=xkcos⁡φ-zksin⁡φ,yi=ykcos⁡θ-zksin⁡θcos⁡φ-xksin⁡φsin⁡θ.For a specific situation when φ=π/2 and θ=π/2, (2)xi=xk,yi=yk.A little difference from the traditional angular orthogonal projection is that two arrays gray and Z are used to save the gray value and z coordinates. The sampling intervals in the projection plane are Δx and Δy, respectively, in x and y coordinate and the resolution of projection plane is M by N. The arrays are calculated based on the following rules:(3)Zi,j=ZykΔy+M2,xkΔx+N2=zk,Grayi,j=GrayykΔy+M2,xkΔx+N2=grayk.A 3D point cloud object was used. The size of this model is 21.25 × 34.87 × 17.89 mm3. The kth point of the 3D object can be represented by Pk(xk,yk,zk,grayk), where k is within the range of 1 to K. K is the number of object points, where Δx and Δy are both 0.02 mm, which gives the resolution of 300 × 300 corresponding to M rows multiplied by N columns in x-y plane for the point cloud object as is shown in Figure 2.Figure 1
The angular orthogonal projection geometry.Figure 2
The coordinate system of 3D point cloud inx-y plane.The calculation ofx and y coordinates can be extracted from (3), which can be expressed as(4)xki,j=j-N2Δx,yki,j=i-M2Δy.Steps of proposed method for encryption and decryption of the 3D object are shown in Figure 3.Figure 3
Steps of encryption and decryption for 3D point cloud object.The detailed description of the two steps is presented in below.Step 1 (transformation ofZ coordinate to deformed fringe).
The method starts from decomposing the 3D object intox-y plane and Z coordinate for a given view port. It is followed by transforming Z coordinate of the 3D object into phase ϕ(i,j) shown below: (5)ϕi,j=ξ2πZi,j-MiMx-Mi-π,where Mx=max{Z}, Mi=min{Z}, and ξ is a constant between 0 and 1. max{Z} is the calculation of maximum value of Z and min{Z} is the calculation of minimum value of Z. With a proper selection of ξ, the range of ϕ could be within [-π,π]. Mx=1.7893, Mi=0, and ξ=0.9 was used.
The phase is further coded to deformed fringe with phase coding method inspired by Fourier transform profilometry [19, 20], which can be expressed as(6)Ix,y=a+bcos⁡2πfxx+ϕ=a+b2exp⁡i2πfxx+ϕ+b2exp⁡-i2πfxx+ϕ,where a and b are some constants and fx carrier frequency is 0.11.
Z coordinate and deformed fringe are shown in Figure 4. Figure 4(a) is the normalized Z coordinate of 3D object. Figure 4(b) is the deformed fringe coded from phase calculated from the mapping formula between height and phase. Figure 4(c) is the gray image of 3D object.Figure 4
NormalizedZ coordinate of 3D object (a), deformed fringe coded from phase (b), and gray image (c).
(a)
(b)
(c)Step 2 (encryption and decryption).
Multiplexing methods [4, 5] are often used in information encryption with Fresnel hologram. The space multiplexing method, the combination of deformed fringe and gray image as object, is used to simulate off-axis Fresnel holography shown in Figure 5. In the simulation, 4f optical system constructed from lenses L1 and L2 was used. Laser with λ=632.8μm was used in the simulation. Two random phase masks, which are also used as encryption keys, PR1 and PR2, were used to encrypt the object and reference waves. The object wave on the hologram plane is described:(7)Oxh,yh=Fresnelobjx,yexp⁡iϕPR1x,y,zf,where Fresnel{∙,zf} is the Fresnel diffraction in (8) of ∙ with a diffraction distance zf. zf=600 mm. obj(x,y) is the distribution of object and ϕPR1(x,y) is the phase due to random phase mask PR1. Consider(8)Fresnel∙,zf=1iλzfexp⁡zfexp⁡ik2zfxh2+yh2∬∙exp⁡ik2zfx2+y2exp⁡-j2πλzfxhx+yhydxdy.The Fresnel hologram is written as(9)Hxh,yh=Oxh,yh2+Rxh,yh2+Oxh,yhR∗xh,yh+O∗xh,yhRxh,yh,where R(xh,yh)=exp[iϕPR1(x,y)] and asterisk denotes the conjugate wave of O(xh,yh) and R(xh,yh). It consists of DCs (first two components), first order, and conjugate terms (third and fourth items). The resolution of hologram is 1400×1400 and the sampling interval in hologram plane is 10 μm in both x and y directions. The angle between the reference and object waves is 2.4 degrees.
The hologram reconstruction and decryption process is written as(10)objx,y=FresnelOxh,yhR∗xh,yhRxh,yh,-zfexp⁡-iϕPR2x,y,where ϕPR2(x,y) is the phase due to random phase mask PR2.
The phase masksPR1 and PR2 are generated based on logistic chaos sequence [20, 21], which is expressed as(11)Xj+1=μXj1-Xj,where 0≤μ≤4 and Xj∈(0,1). μ is within the range of [3.5999456,4] such that X becomes chaotic to increase the encryption strength. For two random phase masks, the values of μ1=3.625875, X11=0.6 and μ2=3.625875, X12=0.5632 were used.
Following the hologram reconstruction, gray image and deformed fringe are obtained. For deformed fringe, with a specific choice of carrier frequencyfx shown in (6) and filtering in frequency domain, the deformed fringe can be simplified to [16, 17](12)Iax,y=b2exp⁡iϕ.The phase ϕ(i,j) can be calculated based on simplified deformed fringe:(13)ϕi,j=atan⁡realIaimagIa.real{Ia} is the real part of Ia and imag{Ia} is the imaginary part of Ia. The phase was truncated within the range of [-π,π] avoiding the phase unwrap problem [16, 17].
With phaseϕ(i,j), Z coordinate can be reconstructed based on (5). Using reconstructed gray image and Z coordinate and sampling intervals Δx and Δy in x and y directions, the x and y coordinates of 3D object can also be reconstructed using (4).Figure 5
A 4f optical holographic encryption system. PR1 and PR2 are encryption keys.Simulated Occlusion Attacks. The occlusion attacks of the Fresnel hologram simulation were conducted. It was done through removal of partial Fresnel hologram data. The occlusion ratio is defined as the ratio of the removed Fresnel hologram data dividing the total Fresnel hologram data. The mean square error (MSE) between real z coordinates and reconstructed z coordinates was calculated and correlation coefficient (CC) of reconstructed gray image comparing with original gray image was also tested when occlusion ratio was different.Direct
Z
Coordinate versus Deformed Fringe Encryption. In order to comparably quantify the robustness of using deformed fringe for Z coordinate encryption, comparison of performance of direct (just using) Z coordinate versus deformed fringe encryption was conducted. It was used to illustrate the relationship between occlusion ratio and mean square error of Z coordinate reconstruction by just using Z coordinate versus using deformed fringe for Fresnel hologram encryption.


## 3. Results

The encrypted Fresnel hologram and reconstructed deformed fringe and gray image of 3D object are shown in Figure6. Correlation coefficient between the reconstructed gray image and original gray image is 0.9824.Figure 6
Encrypted Fresnel hologram (a), reconstructed deformed fringe (b), and gray image (c).
(a)
(b)
(c)Following Fresnel hologram reconstruction and decryption, reconstructed phase andZ coordinate are shown in Figures 7(a) and 7(b). For specific rows (e.g., 80th) of the reconstruction, the comparison between original and reconstructed phase and Z coordinate is shown in Figures 7(c) and 7(d), where the mean square errors (MSEs) are 0.0068 and 0.0012.Figure 7
Reconstructed phase (a) andZ coordinate (b), comparison between original and reconstructed phase (c) and Z (d).
(a)
(b)
(c)
(d)With wrong phase masks, both deformed fringe and gray image could not be decrypted as illustrated in Figure8.Figure 8
Reconstructed deformed fringe (a) and gray image (b) with wrong phase masks.
(a)
(b)Results of deformed fringe and gray image showed the reduced phase and gray image quality with increased occlusion attack ratio shown in Figure9.Figure 9
Reconstructed deformed fringe and gray image with occlusion attack ratio of 40% ((a) and (b)) and 60% ((c) and (d)).
(a)
(b)
(c)
(d)The mean square error (MSE) and correlation coefficients (CC) used to evaluate the decrypted quality between the reconstructed images without occlusion attacks and the reconstructed images under different occlusion attacks are displayed in Figures10(a) and 10(b). In Figure 10(a), the blue line presents the MSE between reconstructed Z coordinates without occlusion and with different occlusion attacks when z coordinate is directly used for encryption. And the red line presents the MSE when the phase coding method is used. The phase coding method can reduce the reconstructed Z coordinate error compared with the directly encrypted z coordinate under 50% occlusion attacks. Above 50% attacks, the comparison is meaningless because Z coordinate cannot be calculated from both methods.Figure 10
Mean square error (MSE) values of reconstructedZ coordinate for different occlusion attacks (a). Correlation coefficients (CC) values for reconstructed gray image under different occlusion attacks (b).
(a)
(b)


## 4. Conclusion

In this research, a 3D point cloud object encryption method was proposed. The method uses off-axis digital Fresnel hologram and phase masks for encrypting and decrypting 3D information of the object, in contrast to conventional digital hologram encryption method, which has been restricted to encryption and decryption of 2D or 3D objects with Fresnel hologram. The mapping relationship betweenX, Y, and Z coordinates was formulated and, for Z coordinate, a transformation was conducted to translate it to deformed fringe. With deformed fringe, Fresnel hologram encryption and decryption were performed.Results showed that the proposed method is able to encrypt and decrypt the deformed fringe and gray image of the 3D object. The proposed method is also sufficiently accurate just yielding small errors between reconstructedZ coordinate and real Z coordinate as shown in Figure 7(d). The method is also robust for different occlusion attacks as shown in Figure 9. Additionally, in comparison to direct Z coordinate encryption, deformed fringe is associated with smaller MSE for the occlusion attack ratio under 50% as illustrated in Figure 10. It indicates that the deformed fringe is more robust than directly using Z coordinate for encryption. This might be because deformed fringe is less sensitive to increased noise-signal ratio relative to simply using Z coordinate.One possible contribution of this research is that, by transforming theZ coordinate of 3D object to deformed fringe, it increases the encryption strength because without knowing the mapping relationship between deformed fringe and Z coordinate, Z coordinate decryption and reconstruction would be challenging.One major limitation of the research should be noted. This study has only investigatedZ coordinate deformed fringe encryption and decryption. It would be ideal if all X,Y,Z, and gray image of the 3D object can be transformed, encoded, and encrypted, which can further increase the encryption strength. This however could be also an interesting topic to study in the future.



---

*Source: 4601462-2016-02-15.xml*