- Open Access
Sparse kronecker pascal measurement matrices for compressive imaging
Journal of the European Optical Society-Rapid Publications volume 13, Article number: 17 (2017)
The construction of measurement matrix becomes a focus in compressed sensing (CS) theory. Although random matrices have been theoretically and practically shown to reconstruct signals, it is still necessary to study the more promising deterministic measurement matrix.
In this paper, a new method to construct a simple and efficient deterministic measurement matrix, sparse kronecker pascal (SKP) measurement matrix, is proposed, which is based on the kronecker product and the pascal matrix.
Simulation results show that the reconstruction performance of the SKP measurement matrices is superior to that of the random Gaussian measurement matrices and random Bernoulli measurement matrices.
The SKP measurement matrix can be applied to reconstruct high-dimensional signals such as natural images. And the reconstruction performance of the SKP measurement matrix with a proper pascal matrix outperforms the random measurement matrices.
Compressed sensing (CS) theory is a novel sampling scheme, which indicates that a sparse signal can be recovered from much fewer samples than conventional method [1, 2]. The sampling and the compression procedure are completed by the linear projection in CS. In matrix notation, it can be expressed as
where x ∈ ℝN is the original signal, Φ is an M × N(M ≪ N) measurement matrix, y ∈ ℝM is the measurement vector. x is said to be K-sparse if ‖x‖0 ≤ K. CS theory asserts that if the measurement matrix Φ satisfies some conditions, the signal x can be recovered from measurements y without distortion.
The emergence of CS provides a new inspiration for optical imaging. Actually most of the nature images are compressible in terms of some sparsity basis, such as Discrete cosine transform (DCT) and Discrete wavelet transform (DWT). The compressibility of the real-word images shows the potential for optical compressive imaging. In the past few years, CS technique has made great progress in many research fields, which include terahertz compressive imaging , spectral imaging , single pixel imaging  and infrared imaging . Some optical imaging applications have been implemented in specific physical experiments.
Measurement matrix construction is a crucial problem in CS. The measurements obtained by measurement matrix are related to whether the signal can be accurately reconstructed. If there is enough information within the measurements, the signal can be recovered with high probability. Random measurement matrices are proved to have the merit of universality but suffer from several shortcomings. Firstly, random measurement matrices consume lots of storage resources. Secondly, there is no feasible algorithm to verify whether the random matrix satisfies the requirement as a measurement matrix [7, 8]. The research on deterministic sampling can be tracked back to the binary matrices via polynomials over finite field . The deterministic measurement matrix has the superiority in physical implementation and the advantage of saving storage space. Therefore, many researches on the deterministic measurement matrix construction have been carried out. Lu introduced a construction of ternary matrices with small coherence . Yao presented a novel simple and efficient measurement matrix named incoherence rotated chaotic matrix . Huang proposed a symmetric Toeplitz measurement matrix . Zhao introduced a deterministic complex measurement matrix to sample the signals in the single pixel imaging .
In this paper, we propose a new construction method of deterministic measurement matrix, termed sparse kronecker pascal (SKP) measurement matrix. The SKP measurement matrix combines the properties of the kronecker product and the pascal matrix. It is suitable for the reconstruction of natural images, which are usually high-dimensional signals. Simulations and analyses confirm that the SKP measurement matrices can reconstruct the natural images with a better performance.
The SKP measurement matrix construction
In mathematics, the kronecker product is an operation on two matrices of arbitrary size resulting in a block matrix .
Definition: If A is an m × n matrix, B is a p × q matrix, then the kronecker product A ⊗ B is the mp × nq block matrix. It can be expressed as
Pascal matrix is a symmetric positive definite matrix with integer entries taken from pascal’s triangle . The 4 × 4 truncations of these are shown below
it can be seen clearly that the entries near the diagonal of the pascal matrix increase with a geometric growth. It is effective to achieve sparse purpose by the kronecker product. Based on the pascal matrix and the kronecker product, we present the SKP matrix
where H is the proposed SKP matrix, k signifies the scaling factor, I represents an identity matrix, P denotes the pascal matrix. Suppose that I is a q × q matrix, P is a p × p matrix, then H is a pq × pq matrix. We can get an m × n SKP measurement matrix Φ by selecting appropriately m rows from H for CS, here n = p × q, m < n.
Now we describe how to select right rows from H to construct various dimensional measurement matrices. The selection method is to follow the principle of equal interval, which can improve the irrelevance between the selected row vectors. From the first row, we can construct the measurement matrix of multiple dimensions by choosing different interval lengths. If the interval length d = 2, p = 4, q = 64, the size of the SKP measurement matrix is 128 × 256. Similarly, when the interval length d = 3, the size becomes 86 × 256.
In CS, the measurement matrix must satisfy certain conditions. Candes and Tao propose a criterion named restricted isometry property (RIP) [16, 17]. A measurement matrix is said to satisfy the RIP of order K if there exists a constant δ K ∈ (0, 1) such that
for any K-sparse vector x. It is similar to that any K column vectors of the measurement matrix Φ are linearly independent. The RIP criterion guarantees that the sparse signal can be recovered exactly from the measurements.
The SKP measurement matrix is a particular matrix. The determinant of every P n is 1 and the determinant of SKP matrix H is k 1 (k 1 ≠ 0), which signify that any column vectors or row vectors from Pn and H are linearly independent. Therefore the SKP measurement matrix Φ is also a linear independent system between row vectors. The correlation among the resulting measurements is reduced, and the unique distribution of the SKP measurement matrix facilitates its implementation.
Results and discussion
In this part, we conduct numerical experiments to validate the performance of the SKP measurement matrix. The test images are of size 256 × 256 pixels. Orthogonal matching pursuit (OMP) algorithm is chosen as the recovery algorithm . The sparsity basis Ψ is selected as the DCT matrix. Reconstruction processes are implemented in MATLAB R2016a. The size of the pascal matrix is 4 × 4, the scaling factor k = 0.05 and the identity matrix I is 64 × 64. Firstly the interval length is set to d = 2. We compare the reconstruction performance among the SKP measurement matrix, the random Gaussian measurement matrix and random Bernoulli measurement matrix. The quality of reconstructed images is measured by the peak signal-to-noise ratio (PSNR) in Eq. (7)
Simulation results are shown in Figs. 1 and 2. It can be observed that the reconstructed images using the SKP measurement matrix is the clearest among all the reconstructed images. The reconstructed images by the random Gaussian measurement matrices and random Bernoulli measurement matrices are blurry and lose some details compared to the SKP measurement matrix. In addition, the differences between the reconstructed images are also very obvious in terms of PSNR values. The PSNR values of reconstructed images by the SKP measurement matrix are almost 4 dB higher than that by the random measurement matrices. Figs. 1 and 2 demonstrate that the SKP measurement matrix outperforms the random Gaussian measurement matrices and random Bernoulli measurement matrices at the compression ratio of 0.5.
The further results present in Table 1. Table 1 shows more PSNR values of reconstructed images. And the measurement matrices include the random Gaussian measurement matrices, random Bernoulli measurement matrices and the SKP measurement matrices. In this part, the size of the pascal matrix is considered.
It can be seen from Table 1 when the size of the pascal matrix is 2 or 4, the reconstruction property of the SKP measurement matrices is better than that of the random Gaussian measurement matrices and random Bernoulli measurement matrices from PSNR values. When the size of the pascal matrix is 8, the reconstruction performance of the SKP measurement matrices has a serious decline or even less than the random Gaussian measurement matrices and random Bernoulli measurement matrices, which is caused by the further weakening of the orthogonality between row vectors of the SKP measurement matrices. Thus, the SKP measurement matrix construction needs to consider the influence of the pascal matrix dimension. The reconstruction accuracy of Lena image between each measurement matrix under different compression ratios is shown intuitively in Fig. 3.
In this paper, a new deterministic measurement matrix, SKP measurement matrix, is proposed for compressive imaging. The SKP measurement matrix has the advantages of simple structure, less storage space and convenient physical implementation, which offer great potential for compressive imaging applications. And we find that the size of the pascal matrix affects the reconstruction performance of the SKP measurement matrix. Simulation results demonstrate that the SKP measurement matrix with a proper pascal matrix can be used to effectively reconstruct the natural images and outperforms the random measurement matrices.
Discrete cosine transform
Discrete wavelet transform
Orthogonal matching pursuit
Peak signal-to-noise ratio
Restricted isometry property
Sparse kronecker pascal
Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)
Candes, E.J., Wakin, M.B.: An introduction to Compressive sampling. IEEE Signal Process. Mag. 25(2), 21–30 (2008)
Chan, W.L., Moravec, M.L., Baraniuk, R.G., et al.: Terahertz imaging with compressed sensing and phase retrieval. Opt. Lett. 33(9), 974–976 (2008)
Arguello, H., Arce, G.R.: Colored Coded Aperture Design by Concentration of Measure in Compressive Spectral Imaging. IEEE Trans. Image Process. 23(4), 1896–1908 (2014)
Duarte, M.F., Davenport, M.A., Takhar, D., et al.: Single-Pixel Imaging via Compressive Sampling. IEEE Signal Process. Mag. 25(2), 83–91 (2008)
Xiao, L.L., Liu, K., Han, D.P., et al.: A compressed sensing approach for enhancing infrared imaging resolution. Opt. Laser Technol. 44(8), 2354–2360 (2012)
DeVore, R.A.: Deterministic constructions of compressed sensing matrices. J. Complex 23(4), 918–925 (2007)
Li, S.X., Ge, G.N.: Deterministic construction of sparse sensing matrices via finite geometry. IEEE Trans. Signal Process. 62(11), 2850–2859 (2014)
Calderbank, R., Howard, S., Jafarpour, S.: Construction of a large class of deterministic sensing matrices that satisfy a statistical isometry property. IEEE J. Sel. Top Sign Process. 4(2), 358–374 (2010)
Lu, W.Z., Xia, S.T.: Construction of ternary matrices with small coherence for compressed sensing. Electron. Lett. 52(6), 447–448 (2016)
Yao, S., Wang, T., Shen, W., Pan, S., Chong, Y.: Research of incoherence rotated chaotic measurement matrix in compressed sensing. Multimedia Tools Appl. 1–19 (2015)
Huang, T., Fan, Y.Z., Zhu, M.: Symmetric Toeplitz-Structured Compressed Sensing Matrices. Sens. Imaging. 16(1), 1–9 (2015)
Zhao, M., Liu, J., Chen, S., Kang, C., Xu, W.: Single-pixel imaging with deterministic complex-valued sensing matrices. J. Eur. Opt. Soc. 10, 15041 (2015)
Loan, C.F.V.: The ubiquitous Kronecker product. J. Comput. Appl. Math. 123(1-2), 85–100 (2000)
Edelman, A., Strang, G.: Pascal Matrices. Am Math Mon 111(3), 189–197 (2004)
Candes, E.J., Tao, T.: Decoding by linear programming. IEEE Trans. Inf. Theory 51(12), 4203–4215 (2005)
Candes, E.J.: The restricted isometry property and its implications for compressed sensing. Comp. Rendus Math. Acad. Sci. Paris. 346(9–10), 589–592 (2008)
Tropp, J.A., Gilbert, A.C.: Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit. IEEE Trans. Inf. Theory 53(12), 4655–4666 (2007)
This work was supported by the National Natural Science Foundation of China (No.61571146), the Natural Science Foundation of Heilongjiang Province (No. F201407) and the Fundamental Research Funds for the Central Universities (HEUCF170802).
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article and its additional file.
All the authors make contribution to this work. YJ and QT conceived the idea and wrote the manuscript; HW designed the experiments and analyzed the data; QJ revised the manuscript. All authors read and approved the final manuscript.
Consent for publication
The authors declare that they have no competing interests.
Ethics approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.