Skip to main content

Three-dimensional shape measurement of complex surfaces based on optimized dithering fringe patterns

Abstract

Background

Optimized dithering fringe pattern is a promising method for high-speed, high-accuracy three-dimensional shape measurement. The recently proposed dithering optimization technology optimizes the fringe quality in either phase domain or intensity domain according to their objective functions. Phase-based optimization is direct and effective, but it is sensitive to projector defocusing levels. Intensity-based optimization is robust to projector defocusing levels, but it does not fully improve the phase quality. In practice, it is difficult to control defocusing levels so it is still a challenge to get high quality fringe patterns which affects the measurement quality under different defocusing levels.

Methods

In order to get high-quality binary dithered patterns which are robust to defocusing levels, this paper proposes a weight object function. This function combines two parts: a global intensity part and a local structure part. The global intensity measurement is based on the normalized mean squared error. The local structure measurement is based on residual error of intensity. To generate high quality fringe patterns, the weight object function is applied to the best patch framework.

Results and discussion

Both simulation and experimental results demonstrate that the phase-based optimization method and the proposed method perform better than the intensity-based optimization method under nearly focused. However the quality of measurement results from phase-based optimization will decrease with the defoucsing levels increasing. The proposed method is robust to the defocusing levels and it can still reduce the phase error when the projector is strongly defocused.

Conclusions

The proposed method can get high-quality binary dithered patterns under different defocusing levels by combining global similarity and local residual error of intensity. It inherits the merits of binary fringe pattern so that gamma calibration of projector is not required. In practice, the proposed method can be used to generate high quality fringe patterns. The experiment results verify that the proposed method can get better measurement results without considering the projector defocusing levels.

Introduction

In the past decades, digital fringe projection (DFP) methods have been proposed as one of the most reliable techniques to reconstruct the surface of objects because of their accuracy and efficiency [1,2,3]. Because it is easier and more convenient to generate fringe patterns and project patterns with a high speed, 3D shape measurement of dynamic objects has been rapidly expanding [4, 5]. However, conventional DFP technique has major limitations: the projection nonlinearity and speed bottleneck [6,7,8,9]. These shortcomings make it difficult to be applied to high-quality and high-speed 3D shape measurement.

To overcome the bottleneck, binary defocusing technique is recently developed which has successfully made speed breakthrough [10,11,12]. However, binary defocusing technique cannot achieve the same measurement capability compared with conventional DFP methods: (1) the measurement accuracy decreases due to high-frequency harmonics influence and (2) the measurement range is smaller since the projector must be properly focused for high-quality measurement [13,14,15]. Lately, pulse width modulation (PWM) [16] and optimal pulse width modulation (OPWM) [17] techniques are proposed to improve the fringe quality by eliminating high-frequency harmonics. However improvement is limited to wide fringe stripes, because the modulation is only one-dimensional without making full use of two-dimensional information.

Dithering technology is developed to take advantage of two-dimensional binary images so it could improve fringe quality of wide fringe stripes [18,19,20,21]. These techniques maintain low-frequency component so that the overall image is similar to the original pattern when a low-pass filter is applied. However, if fringe stripes are narrow, the improvement is rather small because high-frequency sinusoidal fringe patterns are usually desirable since they provide better measurement quality when the period of fringe pattern is small.

Taking advantage of two-dimensional (2D) nature of the structured patterns, dithering optimization methods are developed for DFP systems [22,23,24]. According to their objective functions, these optimization methods can be classified into two categories: intensity-based optimization [25, 26] and phase-based optimization [27, 28]. The former makes the dithered pattern approximation for an ideal sinusoidal fringe after defocusing. They are robust to projector defocusing levels but they can not reduce phase errors efficiently. Since the ultimate goal of optimization is to generate high-quality phase, it is natural to optimize the pattern in the phase domain [29]. The latter makes the phase close to the desired linear phase when properly focused. However, the phase-based optimization method is sensitive to different defocusing levels.

In order to address the aforementioned challenge, this paper proposes a weight object function combining normalized mean squared error and intensity residual error. Instead of optimizing the whole pattern, our framework is optimizing pixels group by group to find the best binary patches, and then tiling the best patch to generate the full-size pattern utilizing symmetry and periodicity structure of the sinusoidal pattern. The proposed fringe patterns belong to dithering binary stripes so they inherit the property of dithering binary pattern which means that they can increase the measurement speed without using 8-bit information. It can also be used to overcome the gamma of projector without projector non-linearity calibration. Moreover, these patterns can overcome the shortcomings from phase-based optimization and intensity-based optimization.

Both simulation and experiments demonstrate that the proposed method can achieve substantial phase quality improvements when the projector is at different defocusing levels.

The rest of the paper is organized as follows. Section Methods explains the principles concerned in this technique and the process of fringe pattern generation. Section Results and Discussion presents simulation results, experimental results and the merits of the proposed technique. Section Conclusions summarizes this paper.

Methods

Three-step phase-shifting algorithm

Sinusoidal phase shifting algorithms are very widely used in conventional optical metrology due to their fast speed and high accuracy [30]. Typically, the more numbers of fringe patterns are used, the better measurement quality can be achieved. For high-speed 3D shape measurement, a three-step phase-shifting algorithm is usually adopted since it requires the minimum number of patterns to get the phase uniquely point by point. Since our research focuses on high-speed 3D shape measurement, a simple three-step phase-shifting algorithm with a phase shift of 2Ï€/3is used to evaluate the proposed optimization algorithm. Three fringe images can be described as:

$$ {I}_1=A\left(x,y\right)+B\left(x,y\right)\cos \left[\varphi \left(x,y\right)-2\pi /3\right] $$
(1)
$$ {I}_2=A\left(x,y\right)+B\left(x,y\right)\cos \left[\varphi \left(x,y\right)\right] $$
(2)
$$ {I}_3=A\left(x,y\right)+B\left(x,y\right)\cos \left[\varphi \left(x,y\right)+2\pi /3\right] $$
(3)

Where A(x, y) is average intensity. B(x, y) is intensity modulation. ϕ(x, y) is the phase to be solved for:

$$ \phi \left(x,y\right)={\tan}^{-1}\frac{\sqrt{3}\left({I}_1-{I}_3\right)}{2{I}_2-{I}_1-{I}_3} $$
(4)

This equation provides the phase ranging [−π, π) with 2π discontinuities. A continuous phase map can be obtained by adopting a spatial or temporal phase unwrapping algorithm. In this research, we use the temporal phase unwrapping method with three frequency phase-shifting algorithms.

Bayer-dithering technique

Dithering techniques have been developed to convert a higher bit depth into a lower bit depth, and this is analogous to halftone technique used in printing. Various dithering algorithms can be used to approximate an ideal sinusoidal fringe pattern, such as simple thresholding, random dithering, and ordered dithering [31].

Among these dithering methods, Bayer-ordered dithering has been extensively utilized in many applications due to its simplicity and efficiency, which is adopted in this study. The Bayer dithering technique compares the original image with a 2D grid of thresholds called Bayer kernel, and then the original image is quantized according to corresponding pixels in the Bayer kernel: if the grayscale value is larger than the kernel, the pixel is turned to 1 (or 255 grayscale value), otherwise to 0. Neighboring pixels do not affect each other. Different kernels can generate completely different dithering effects. Among the kernels used, Bayer has shown that if the sizes of the matrices are 2N (N is an integer), there is an optimal dither kernel that results in the pattern noise being as high-frequency as possible. A low-pass filter can suppress the high-frequency noises. The Bayer kernel can be obtained by:

$$ {M}_1=\left[\begin{array}{l}0\kern2em 2\\ {}3\kern2em 1\end{array}\right] $$
(5)

Where M1 is the smallest base, and other larger patterns can be obtained by:

$$ {M}_{n+1}=\left[\begin{array}{l}\kern2.5em 4{M}_n\kern4.5em 4{M}_n+2{U}_n\\ {}4{M}_n+3{U}_n\kern3.5em 4{M}_n+{U}_n\end{array}\right] $$
(6)

Where Un is n-dimensional unit matrix. In this research, we find that the Bayer kernel 8 × 8 produces the best results for all tested fringe stripes, and then it is utilized.

Weight objection function

Dithering optimization technique has been researched in reducing its overall phase error. The objective function of all these optimization techniques is to get the best fit of the binary patterns [32]. The optimization process can be described as a norm function such as Frobenius norm function:

$$ \underset{B,G}{\min}\left\Vert I\left(x,y\right)-G\left(x,y\right)\ast B{\left(x,y\right)}_F\right\Vert $$
(7)

Where ‖•‖ represents the Frobenius norm. I(x, y) is the ideal sinusoidal intensity pattern. G(x, y) represents a 2D Gaussian function. B(x, y) is a 2D binary pattern and ∗ represents convolution. The optimization function evaluates the global intensity similarity between the dithering pattern and its corresponding ideal pattern, but it just considers the global similarity without focusing on local structure similarity. In addition, NP problem makes it difficult to calculate the object function [15].

The objective of all these optimization techniques is to obtain the best fit of the binary patterns which are close to the ideal sinusoidal pattern. The optimized binary patterns should be as close as possible to the ideal sinusoidal patterns after applying Gaussian filter. The local detailed structure is one of the important resources in an image. It contains particular high-frequency components. In order to contain local similarity in the objective function, we propose a weighted object function (WOF). The objective function combines two parts: a global intensity part and a local structure part. The global intensity measurement is based on the normalized mean squared error (NMSE). The local structure measurement is based on the residual error of intensity (REI). If the intensity of ideal pattern are I and the intensity of dithering pattern is Id, WOF can be expressed as:

$$ WOF={\omega}_1 NMSE\left(I,{I}_d\right)+{\omega}_2 REI\left(I,{I}_d\right) $$
(8)

Where NMSE(I, Id) measures the global similarity and REI(I, Id) measures the local similarity, respectively. WOF gets the synthetic error between the ideal pattern I and the dithering pattern Id. ω1 and ω2 are weighted factors limited by ω1 + ω2 = 1. Figure 1 illustrates phase root mean square error values RMS (rad) when weighted factor ω1 = 0~1. In order to simplify the description, we call it phase RMS error in the following parts. The lowest point of the broken line in Fig. 1 means the root mean square error values RMS value is the smallest when ω1 is 0.7. Thus, in this research, we set ω1 = 0.7.

Fig. 1
figure 1

The phase root mean square error values RMS with different weighted value ω1

First a global intensity similarity is introduced into the WOF expression. NMSE(I, Id) can evaluate the global intensity similarity between the dithering pattern and the corresponding ideal pattern. NMSE(I, Id) can be shown as:

$$ NMSE\left(I,{I}_d\right)=\frac{\sum_H{\sum}_W{\left(I\left(x,y\right)-{I}_d\left(x,y\right)\right)}^2}{\sum_H{\sum}_W{\left(I\left(x,y\right)\right)}^2} $$
(9)

Where H and W respectively represent height and width of the pattern. NMSE(I, Id) method reflects statistical errors from the whole fringe pattern intensity. Thus, the smaller the NMSE(I, Id) is, the better the whole pattern quality becomes. However NMSE(I, Id) only focuses on the global similarity, so REI(I, Id) is introduced as an optimization term to evaluate the local structure similarity between the dithering pattern and the corresponding ideal pattern.

Because the existence of the third harmonics does not induce any phase errors for three-step phase-shifting algorithm [33], it can be proved that if the intensity error varies periodically at the frequency which is multiple of 3f0 (f0is the fundamental frequency of the desired sinusoidal pattern). The obtained phase map could be as same as the ideal phase map. The intensity error could not vary periodically but it is possible to separate the 3f0 harmonics from the total intensity error. Therefore, the intensity residual error function REI(I, Id) is designed as:

$$ REI\left(I,{I}_d\right)=E\left(x,y\right)-{E}_{3{f}_0}\left(x,y\right) $$
(10)
$$ E\left(x,y\right)=G\left(x,y\right)\ast B\left(x,y\right)-I\left(x,y\right) $$
(11)

Where E(x, y) is the total intensity error between the defocused binary pattern and the ideal sinusoidal pattern. \( {E}_{3{f}_0}\left(x,y\right) \) is the periodically harmonics. G(x, y) is a Gaussian function. B(x, y) is the binary dithered pattern. * is convolution. I(x, y) is the ideal sinusoidal pattern intensity.

It can be assumed that a periodical signal s(x) varies along x direction for one period T(T = 3 N) and s3N(x) is one part of s(x). In order to extract the harmonics sN(x) from the whole signal s3N(x), discrete Fourier transform is employed to obtain its spectrum S3N(k). After that, all those harmonics at the frequency (3l)th should be retained and other harmonics should be removed. Therefore, the new sampled spectrum SN(k) can be described as:

$$ {S}_N(k)={S}_{3N}(k)\cdot H(k) $$
(12)
$$ {\displaystyle \begin{array}{l}H(k)=\frac{1}{3} comb\left(\frac{k}{3}\right)=\frac{1}{3}\sum \limits_{l=0}^{N-1}\delta \left(\frac{k}{3}-l\right)\\ {}\kern4em =\sum \limits_{l=0}^{N-1}\delta \left(k-3l\right)\end{array}} $$
(13)

Where H(k) is the Dirac comb function and every δ function is separated from each other at 3. According to discrete Fourier transform theory and convolution principle, the filtering process in the spatial domain can be described as:

$$ {s}_N(x)={s}_{3N}(x)\ast h(x) $$
(14)
$$ {\displaystyle \begin{array}{l}h(x)=\frac{1}{3N} comb\left(\frac{x}{N}\right)=\frac{1}{3N}\sum \limits_{m=0}^2\delta \left(\frac{x}{N}-m\right)\\ {}\kern4em =\frac{1}{3}\sum \limits_{m=0}^2\delta \left(x- Nm\right)\end{array}} $$
(15)

Where h(x) is the spatial filtering function. ∗ represents convolution. It turns out that h(x) is a Dirac comb function, but it is composed of three δ functions and the extent decreases to one-third. Therefore, the (3l)th harmonics of sN(x) can be solved for:

$$ {\displaystyle \begin{array}{l}{s}_N(x)={s}_{3N}(x)\ast \frac{\delta (x)+\delta \left(x-N\right)+\delta \left(x-2N\right)}{3}\\ {}=\frac{s_{3N}(x)+{s}_{3N}\left(x-N\right)+{s}_{3N}\left(x-2N\right)}{3}\end{array}} $$
(16)

Therefore, the (3l)th intensity error \( {E}_{3{f}_0}\left(x,y\right) \) can be extracted from the intensity error E(x, y), which can be described as the following function:

$$ {E}_{3{f}_0}\left(x,y\right)=\frac{1}{3}\left[E\left(x,y\right)+E\left(x+\frac{T}{3},y\right)+E\left(x+\frac{2T}{3},y\right)\right] $$
(17)

This function demonstrates a simple way to extract the (3l)th harmonics sN(x) out of signal without discrete Fourier transform. Firstly, s3N(x) is divided into three segments at the same length N. Secondly, three segments are added together to calculate an average segment. And finally, the (3l)th harmonics sN(x) are generated by periodically extending the average segment along x direction three times. Then, the intensity residual error REI(I, Id) can be calculated.

Implementation in the best patch optimization framework

Instead of optimizing the whole fringe pattern, we use an idea which called binary patch, and then the patch are tiled to generate full-size patterns using symmetry and periodicity. Assuming that the desired sinusoidal fringe patterns vary along x direction: the best-fit binary pattern should be symmetric along x direction for one fringe period (T); and it should be periodic along the y direction. The period in every row Sy is defined as the period along y direction. In this paper, we take Sx = T/2 as the patch column period and T is the fringe period. The row period Sy for a best patch is set to different widths which are optimized respectively and from which the best one is chosen. This framework also includes two parts, the global intensity optimization and the further combined optimization. The process of optimization can be divided into the following major steps:

  • Step 1: Initial patch generation. Bayer dithered sinusoidal fringes are generated firstly. The patch size of the row period Sy ranges from 2 to 10. Then, according to the symmetry of the sinusoidal pattern and the optimization efficiency, the patch column period Sx is set to T/2 which is one half of fringe period.

  • Step 2: Patch optimization based on weighted error function. Each pixel (i, j) are mutated from 0 to 1 or from 1 to 0. Because three step phase-shifting algorithm is used, there are eight groups: (0,0,0), (0,01), (0,1,0), (0,1,1), (1,0,0), (1,0,1), (1,1,0), (1,1,1). They are filtered by a Gaussian filter with size G = 5. Weighted error function is further optimized for each group and the group error ζ is kept from the one with biggest absolute phase error to the smallest one. The further optimization is performed iteratively until phase RMS error is less than 0.01% or the number of iteration reaches maximum times. Figure 2 shows the phase RMS error after each round of optimization.

  • Step 3: Patch shifting. The global optimization binary patch is tiled and shifted to produce phase shifted fringes.

  • Step 4: Patch selection. After a number of patch mutations, a set of optimized patches are generated. From these patches, the best patch is selected based on the following two rules: (1) phase error does not change drastically if different sizes of Gaussian filter are applied; and (2) the resultant phase error is consistently small. These two rules imply that the best patch under one defocusing level may not be chosen.

  • Step 5: Fringe pattern generation. Utilizing symmetry and periodicity properties of fringe patterns, the desired size fringe pattern is generated by tiling the best patch together.

Fig. 2
figure 2

The phase root mean square error values RMS after each round of optimization

Figure 3 shows binary patterns before and after applying the optimization algorithms. Figure 3a shows the desired sinusoidal pattern. The period of every fringe pattern is T = 20pixels. Figure 3b, c and d show three binary patterns comparison, which are respectively generated by utilizing intensity-based optimization, phase-based optimization and the proposed method.

Fig. 3
figure 3

Example of binary patterns after applying different algorithms. a Ideal sinusoidal pattern (T = 20pixels); b intensity-based optimization pattern; c phase-based optimization pattern; d proposed method optimization pattern

Phase-based optimization (p-opt) and intensity-based optimization (i-opt) are also two main categories to improve the quality of fringe patterns. In order to show the superiority of the proposed optimization method, we compare it with the norm Frobenius (NF), the p-opt [17], i-opt [14] and ideal sinusoidal fringe patterns under the same condition. Figure 3 shows the comparison among different optimization. Figure 4a shows the comparison between the ideal sinusoidal curve and cross-sections from different fringe patterns. Figure 4b and c give the intensity difference and phase difference with i-opt, o-opt, NF and the proposed method. From the results we can find that the optimization framework can generate better quality and less phase error. Because NF just compares the global similarity without considering the local structure similarity, in the following section we just compare the intensity-based optimization, phase-based optimization and the proposed optimization.

Fig. 4
figure 4

The cross-section fringe comparison of different optimization. a The comparison between ideal sinusoidal curve and cross section fringe pattern with different optimization. b The intensity difference among four methods. c The phase error comparison among four methods

Results and discussion

We evaluate the proposed algorithm through simulation where different periods are used. In this simulation, we use fringe periods T = 30,50,70 and 90 pixels. Different defocusing levels are expressed by applying different sizes of Gaussian filters. The size of Gaussian filterGranges from 5 to 17 and standard deviation is σ = G/3.

When the size of Gaussian filter is 5 × 5 (σ = 5/3), it represents the case that the projector is nearly focused. When the size of Gaussian filter is 17 × 17 (σ = 17/3), it represents the case that the projector is defocused to a much more degree. In this simulation, the wrapped phase is obtained based on three-step phase-shifting algorithm and the phase RMS error is obtained by calculating the difference between the phase obtained from the binary patterns and the phase obtained from the ideal sinusoidal fringe pattern. Figure 5 shows the phase RMS error comparison among phase-based optimization (Phase-opt) [17], intensity-based optimization (Intensity-opt) [14] and the proposed best-patch optimization (Proposed-opt).

Fig. 5
figure 5

The phase RMS error comparison among the phase optimized fringes (P-opt), intensity optimized fringes (I-opt) and the proposed fringes of best-patch optimization (Proposed)

By analyzing the simulation, we can find that when the projector is nearly focused (Gaussian filter size is 5 × 5 and standard deviation is 5/3), the phase-based optimization has the lowest phase RMS error. When the period changes from 20 pixels to 90 pixels, the phase-based has the best phase quality. While with the Gaussian filter size increasing, the quality from phase-based optimization decreases because it is sensitive to filter sizes. When the projector is slightly defocused (Gaussian filter size is 11 × 11 and standard deviation is 11/3 pixels). The phase error from the intensity-based optimization and the phase error from the proposed method decrease greatly as the filter size increases and they produce better results. They have the same tendency when the filter sizes increases. From simulation results, we can also find when the filter size is small, the proposed optimization almost have smaller phase RMS errors than the intensity-based optimization. It means that when projector is nearly focused(the filter size is small), the proposed optimization can perform better than intensity-based optimization. Besides it is robust to defocusing levels. When the projector is slightly focused and strongly defocused (the filter size is large), the proposed optimization can still get high quality fringe pattern with less phase RMS error. Simulation has verified the superiority of the proposed optimization technique which can produce fringes with high phase quality under different defocusing levels.

We also develop a 3D shape measurement system to verify the proposed method which consists of a DLP projector (Samsung SP-P310MEMX) and a digital CCD camera (Daheng MER-500-14U3M/C-L). The camera is attached with a 16 mm focal length lens (Computar M1614-MP) and the lens resolution is 1024 × 768. The resolution of projector is 800 × 600 and it has 0.49–2.80 m projection distance.

A uniform flat board is measured based on different optimization under three defocusing levels. Because phase-shifting algorithm with (n + 2) steps is insensitive to high-order harmonics up to the nth-order [20]. So in this research, the ideal phase is obtained by a ten-step phase-shifting algorithm and the period of fringe patterns is set to 20 pixels. Figure 6a-c show dithering fringe patterns which are optimized based on the proposed method from nearly focused, slightly defocused and strongly defocused respectively. Figure 6d-f show the corresponding phase RMS errors and the phase RMS errors comparison from intensity-based optimization and phase-based optimization. This experimental results show that when the projector is nearly focused, the proposed method and phase-based method have better phase quality and the intensity-based method has the largest rms error. With the defocusing levels increasing, the intensity-based method performs better than the phase-based method while the proposed method has small fluctuate. However phase errors are still smaller. It indicates that the proposed method performs consistently well to get the better phase quality under three defousing levels.

Fig. 6
figure 6

Experimental phase quality comparison among intensity-based optimization, phase-based optimization and the proposed method under different amounts of defocusing. a-c show dithering fringe patterns under different defocusing levels; d-f show the corresponding phase RMS errors

Furthermore, a more complex 3D statue is measured to compare these optimization methods under the same projector defocusing levels respectively. Figure 7 shows the deformed fringe pattern under nearly focused, slightly defocused and strongly defocused respectively. The measurement results are shown in Fig. 8. In order to compare the quality of results, Figs. 9, 10 and 11 show the results based on phase optimization and the results based on intensity optimization at the same defocusing levels respectively. From the measurement results, it can be found that when the projector is nearly focused, the result from the phase-based optimization appears slightly better than the intensity-based optimization method. Under slightly defocused and strongly defoucsed, the results from the intensity-based optimization method have less errors than the results from phase-based optimization method. Because the proposed method decreases the phase error and it optimizes the intensity errors, the proposed method can reconstruct smoother surface than both optimization methods.

Fig. 7
figure 7

The deformed fringe pattern under different defocusing levels. a the deformed fringe pattern under nearly focused; b the deformed fringe pattern under slightly defocused; c the deformed fringe pattern under strongly defocused

Fig. 8
figure 8

The measurement results based on proposed method with different projector focusing levels

Fig. 9
figure 9

The measurement results based on phase optimization and intensity optimization with projector nearly focused

Fig. 10
figure 10

The measurement results based on phase optimization and intensity optimization with projector slightly defocused

Fig. 11
figure 11

The measurement results based on phase optimization and intensity optimization with projector strongly defocused

In order to give a more clear comparison, the phase errors of three dithering methods are calculated and they are shown in Fig. 12 according to Figs. 8, 9, 10 and 11. When the projector is nearly focused, phase RMS errors of intensity-based optimization, phase-based optimization and the proposed optimization are 0.057 rad, 0.048 rad, and 0.045 rad. When the projector is slightly defocused, the corresponding phase RMS errors are 0.049 rad, 0.055 rad, and 0.045 rad for slightly defocused and when the projector is strongly defocused, the phase RMS errors are 0.045 rad, 0.058 rad and 0.042 rad. Table 1 lists the corresponding measurement time based on Fig. 12. By comparison between the measurement time, it can be found that the proposed method can increase measurement speed.

Fig. 12
figure 12

The phase error comparison of measurement results

Table 1 The measurement time comparison between different optimization methods. (Unit:s)

These results also clearly show that phase-based optimization technology can improve phase quality under a certain condition but it is sensitive to the amount of defocusing. The intensity-based optimization technology is able to improve the fringe quality with the defocusing levels increasing, but it can not reduce phase errors efficiently. The proposed technique has the same tendency with intensity-based optimization but it can increase the phase quality under different defocusing levels. The results are consistent with the simulation analysis.

Conclusions

This paper has presented an optimization method based on the weight objective function to generate high-quality sinusoidal fringe patterns. By using normalized mean squared error and residual error of intensity, the global similarity and local similarity can be optimized. Utilizing symmetry and periodicity properties of the fringe patterns, the desired fringe pattern is generated by tiling the best patch together. Simulation shows that the proposed fringes maintain high phase quality under different filter sizes. Experimental results also verify the feasibility and advantage of the proposed technique that the proposed method can generate high-quality binary fringes under different defocusing levels.

Abbreviations

2D:

Two-dimensional

3D:

Three-dimensional

DFP:

Digital fringe projection

I-opt:

Intensity-based optimization

NMSE:

Normalized mean squared error

OPWM:

Optimal pulse width modulation

P-opt:

Phase-based optimization

PWM:

Pulse width modulation

REI:

Residual error of intensity

RMS:

Phase root mean square

WOF:

Weighted object function

References

  1. Angelo, J.P., van de Giessen, M., Gioux, S.: Real-time endoscopic optical properties imaging. Biomed. Opt. Express. 8(11), 5113–5126 (2017)

    Article  Google Scholar 

  2. Reich, C., Ritter, R., Thesing, J.: 3-D shape measurement of complex objects by combining photogrammetry and fringe projection. Opt. Eng. 39(1), 224–232 (2000)

    Article  ADS  Google Scholar 

  3. Günther, P., Kuschmierz, R., Pfister, T., Czarske, J.: Distance measurement technique using tilted interference fringe systems and receiving optic matching. Opt. Lett. 37(22), 4702–4704 (2012)

    Article  ADS  Google Scholar 

  4. Feng, S., Zhang, Y., Chen, Q., Zuo, C., Li, R., Shen, G.: General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique. Opt. Lasers Eng. 59, 56–71 (2014)

    Article  Google Scholar 

  5. Osten, W.: Application of optical shape measurement for the nondestructive evaluation of complex objects. Opt. Eng. 39(1), 232–244 (2000)

    Article  ADS  Google Scholar 

  6. Feng, S., Chen, Q., Zuo, C., Li, R., Shen, G., Feng, F.: Automatic identification and removal of outliers for high-speed fringe projection profilometry. Opt. Eng. 52, 013605 (2013)

    Article  ADS  Google Scholar 

  7. Zheng, D., Da, F.: Absolute phase retrieval for defocused fringe projection three-dimensional measurement. Opt. Commun. 312(4), 302–311 (2014)

    Article  ADS  Google Scholar 

  8. Zuo, C., Chen, Q., Gu, G., Feng, S., Feng, F.: High-speed three-dimensional profilometry for multiple objects with complex shapes. Opt. Express. 20, 19493–19510 (2012)

    Article  ADS  Google Scholar 

  9. Heist, S., Kühmstedt, P., Tünnermann, A., Notni, G.: Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement. Appl. Opt. 54(35), 10541–10551 (2015)

    Article  ADS  Google Scholar 

  10. Zhang, S., Van Der Weide, D., Oliver, J.: Superfast phase-shifting method for 3-D shape measurement. Opt. Express. 18(9), 9684–9689 (2010)

    Article  ADS  Google Scholar 

  11. Dreier, F., Günther, P., Pfister, T., Czarske, J.W., Fischer, A.: Interferometric sensor system for blade vibration measurements in turbomachine applications. IEEE Trans. Instrum. Meas. 62(8), 2297–2302 (2013)

    Article  Google Scholar 

  12. Heist, S., Lutzke, P., Schmidt, I., Dietrich, P., Kühmstedt, P.: High-speed three-dimensional shape measurement using GOBO projection. Opt. Lasers Eng. 87, 90–96 (2016)

    Article  Google Scholar 

  13. Xu, Y., Ekstrand, L., Dai, J., Zhang, S.: Phase error compensation for three-dimensional shape measurement with projector defocusing. Appl. Opt. 50(17), 2572–81.6 (2011)

    Article  ADS  Google Scholar 

  14. Takeda, M., Gu, Q., Kinoshita, M., Takai, H., Takahashi, Y.: Frequency-multiplex Fourier-transform profilometry: a single-shot three-dimensional shape measurement of objects with large height discontinuities and/or surface isolations. Appl. Opt. 36, 5347–5354 (1997)

    Article  ADS  Google Scholar 

  15. Wagner, C., Osten, W., Seebacher, S.: Direct shape measurement by digital wavefront reconstruction and multi-wavelength contouring. Opt. Eng. 39(1), 79–86 (2000)

    Article  ADS  Google Scholar 

  16. Ayubi, G.A., Ayubi, J.A., Di Martino, J.M., Ferrari, J.A., Di Martino, J.M., Ferrari, J.A.: Pulse-width modulation in defocused three-dimensional fringe projection. Opt. Lett. 35(21), 3682–3684 (2010)

    Article  ADS  Google Scholar 

  17. Wang, Y., Zhang, S.: Optimal pulse width modulation for sinusoidal fringe generation with projector defocusing. Opt. Lett. 35(24), 4121–4123 (2010)

    Article  ADS  Google Scholar 

  18. Garnica, G., Padilla, M., Servin, M.: Dual-sensitivity profilometry with defocused projection of binary fringes. Appl. Opt. 56(28), 7985–7989 (2017)

    Article  ADS  Google Scholar 

  19. Zi-Xin, X.U., Chan, Y.H.: Removing harmonic distortion of measurements of a defocusing three-step phase-shifting digital fringe projection system. Opt. Lasers Eng. 90, 139–145 (2017)

    Article  Google Scholar 

  20. Kite, T.D., Evans, B.L., Bovik, A.C.: Modeling and quality assessment of Halftoning by error diffusion. IEEE Int. Conf. Image Process. 9(5), 909–922 (2000)

    Article  ADS  Google Scholar 

  21. Kuschmierz, R., et al.: Optical, in situ, three-dimensional, absolute shape measurements in CNC metal working lathes. Int. J. Adv. Manuf. Technol. 84(9-12), 2739–2749 (2016)

    Article  Google Scholar 

  22. Dai, J., Li, B., Zhang, S.: Improve dithering technique for 3D shape measurement: phase vs intensity optimization[C]//Dimensional Optical Metrology and Inspection for Practical Applications II. Int. Soc. Opt. Photon. 8839, 883904 (2013)

  23. Ettl, S., Kaminski, J., Knauer, M.C., Häusler, G.: Shape reconstruction from gradient data. Appl. Opt. 47, 2091–2097 (2008)

    Article  ADS  Google Scholar 

  24. Wang, Y., Laughner, J.I., Efimov, I.R., Zhang, S.: 3D absolute shape measurement of live rabbit hearts with a superfast two-frequency phase-shifting technique. Opt. Express. 21(5), 5822–5832 (2013)

    Article  ADS  Google Scholar 

  25. Dai, J., Li, B., Zhang, S.: Intensity-optimized dithering technique for three-dimensional shape measurement with projector defocusing. Opt. Lasers Eng. 53, 79–85 (2014)

    Article  Google Scholar 

  26. Li, X.-X., Zhang, Z., Yang, C.: High-quality fringe pattern generation using binary pattern optimization based on a novel objective function. Opt. J. Light Electron Opt. 127(13), 5322–5327 (2016)

    Article  Google Scholar 

  27. Li, J., Hassebrook, L.G., Guan, C.: Optimized two-frequency phase-measuring-profilometry light-sensor temporal-noise sensitivity. JOSA A. 20(1), 106–115 (2003)

    Article  ADS  Google Scholar 

  28. Dai, J., Zhang, S.: Phase-optimized dithering technique for high-quality 3D shape measurement. Opt. Lasers Eng. 51(6), 790–795 (2013)

    Article  Google Scholar 

  29. Li, B., Wang, Y., Dai, J., et al.: Some recent advances on superfast 3D shape measurement with digital binary defocusing techniques. Opt. Lasers Eng. 54, 236–246 (2014)

    Article  Google Scholar 

  30. Sun, J.S., Zuo, C., Feng, S.J., Yu, S.L., Zhang, Y.Z., Chen, Q.: Improved intensity optimized dithering technique for 3D shape measurement. Opt. Lasers Eng. 66, 158–164 (2015)

    Article  Google Scholar 

  31. Wang, Y., Zhang, S.: Three-dimensional shape measurement with binary dithered patterns. Appl. Opt. 51(27), 6631–6636 (2012)

    Article  ADS  Google Scholar 

  32. Dai, J., Li, B., Zhang, S.: High-quality fringe pattern generation using binary pattern optimization through symmetry and periodicity. Opt. Lasers Eng. 52(1), 195–200 (2014)

    Article  Google Scholar 

  33. Zuo, C., Chen, Q., Gu, G., Ren, J., Sui, X., Zhang, Y.: Optimized three-step phase-shifting profilometry using the third harmonic injection. Opt. Appl. 51, 393–408 (2013)

    Google Scholar 

Download references

Acknowledgments

This work was supported by National Key R&D Program of China (2017YBF1300900), the the National Natural Science Foundation of China (U1713216) and the Fund of Shenyang (17-87-0-00).

Funding

Faculty of Robot and Engineering of Northeastern University, Shenyang, China provides the funding for this research.

Availability of data and materials

Details data has been provided in this paper.

Author information

Authors and Affiliations

Authors

Contributions

All authors contribute equally in all the sections of this work. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Feng Lu.

Ethics declarations

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, F., Wu, C. & Yang, J. Three-dimensional shape measurement of complex surfaces based on optimized dithering fringe patterns. J. Eur. Opt. Soc.-Rapid Publ. 14, 26 (2018). https://doi.org/10.1186/s41476-018-0094-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41476-018-0094-8

Keywords