--- title: "Multichannel Color Image Denoising via Weighted Schatten p-norm Minimization" authors: - "Xinjian Huang" - "Bo Du" - "Weiwei Liu" doi: "10.24963/ijcai.2020/89" url: "https://ijcai.org/proceedings/2020/89" pdf: "https://ijcai.org/proceedings/2020/0089.pdf" venue: "Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence" year: 2020 pages: "637-644" track: "Main track" keywords: - "Computer Vision: Other" - "Computer Vision: 2D and 3D Computer Vision" - "Machine Learning Applications: Applications of Unsupervised Learning" --- # Multichannel Color Image Denoising via Weighted Schatten p-norm Minimization Xinjian Huang, Bo Du, Weiwei Liu *Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence*, pages 637-644. DOI: [10.24963/ijcai.2020/89](https://doi.org/10.24963/ijcai.2020/89) ## Abstract The R, G and B channels of a color image generally have different noise statistical properties or noise strengths. It is thus problematic to apply grayscale image denoising algorithms to color image denoising. In this paper, based on the non-local self-similarity of an image and the different noise strength across each channel, we propose a MultiChannel Weighted Schatten p-Norm Minimization (MCWSNM) model for RGB color image denoising. More specifically, considering a small local RGB patch in a noisy image, we first find its nonlocal similar cubic patches in a search window with an appropriate size. These similar cubic patches are then vectorized and grouped to construct a noisy low-rank matrix, which can be recovered using the Schatten p-norm minimization framework. Moreover, a weight matrix is introduced to balance each channel’s contribution to the final denoising results. The proposed MCWSNM can be solved via the alternating direction method of multipliers. Convergence property of the proposed method are also theoretically analyzed . Experiments conducted on both synthetic and real noisy color image datasets demonstrate highly competitive denoising performance, outperforming comparison algorithms, including several methods based on neural networks. ## Full text ## 1 Introduction Noise corruption is inevitable during the image acquisition process and may heavily degrade the visual quality of an acquired image. Image denoising is thus an essential preprocessing step in various image processing and computer vision tasks [Chatterjee and Milanfar, 2010; Ye et al., 2018; Wang et al., 2018b]; moreover, it is also an ideal test platform for evaluating image prior models and optimization methods [Roth and Black, 2005]. As a result, image denoising remains a challenging yet fundamental problem. Early denoising algorithms were mainly devised on the basis of filter and transformation [Dabov et al., 2007b], such as wavelet transform and curvelet transform [Starck et al., 2002]. State-ofthe-art denoising methods are mainly based on sparse representation [Dabov et al., 2007b], low-rank approximation [Gu et al., 2017; Xie et al., 2016], dictionary learning [Zhang and Aeron, 2016; Marsousi et al., 2014; Mairal et al., 2012], nonlocal self-similarity [Buades et al., 2005; Dong et al., 2013a; Hu et al., 2019] and neural networks [Liu et al., 2018; Zhang et al., 2017a; Zhang et al., 2017b; Zhang et al., 2018]. ∗Co-corresponding Author. Current methods for RGB color image denoising can be categorized into three classes. The first kind involves applying grayscale image denoising algorithms to each channel in a channel-wise manner. However, these methods ignore the correlations between R, G and B channels, meaning that unsatisfactory results may be obtained. The second method is to transform the RGB color image into other color spaces [Dabov et al., 2007a]. This transform, however, may change the noise distribution of the original observation data and introduce artifacts. The third type of method involves making full use of the correlation information across each channel and conduct the denoising task on R, G and B channels simultaneously [Zhang et al., 2017a]. Similar to the case of grayscale images, noise from each channel can be generally, regarded as additive white Gaussian noise. However, the noise levels of each channel are diverse due to camera sensor characteristics and the imagery environment, such as fog, haze, illumination intensity, etc. Moreover, the on-board processing steps in digital camera pipelines may also introduce different noise strength assigned to different channels [Nam et al., 2016]. This reveals the difficulties and challenges faced by RGB color image denoising. Intuitively, if we apply the grayscale image denoising algorithm to color images in a band-wise manner without considering the mutual information and noise difference between each channel, artifacts or false colors could be generated [Mairal et al., 2008]. An example of this is presented in Fig.1. Here, we apply a representative low-rank-based method, WSNM [Xie et al., 2016], and our proposed method, MCWSNM (see Section 2), to the Kodak PhotoCD Dataset 1 . It can be seen from the figure that WSNM retains a large amount of noise and, to some extent, introduces some artifacts. Thus, the issue of how noise differences in each channel should be modeled is key to designing a good RGB color denoising algorithm. One well-known color image denoising method is color block-matching 3D (CBM3D) [Dabov et al., 2007a]. This is a transformation field method that may destroy the noise distribution across each channel and introduce artifacts. The method in [Zhu et al., 2016] concatenates similar patches of RGB channels into a long vector. However, this concatenation operation regards each channel equally and ignores the noise level differences across each channel. For a long time, low-rank theory has been widely used in many fields, such as recommendation system [Wang et al., 2018a], community search [Fang et al., 2020b; Fang et al., 2020a], multi-out task [Liu et al., 2019] and multi-label[Liu et al., 2017], etc. 1 http://r0k.us/graphics/kodak/ Figure 1: Denoised results of "kodim07" in the Kodak PhotoCD Dataset with σr = 50, σg = 5 and σb = 20. WSNM performs in a band-wise manner; MCWSNM jointly processes three channels jointly and considers their noise differences simultaneously. (It is best to zoom in on these images on-screen). ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000000_b31ff8fd58d0027c10571d52a936342927e3bd2c6e4ce5f0fc8ac37a00bb78bc.png) Recently, based on the non-local self-similarity of an image and SVD, several low-rank-based denoising algorithms have been proposed, such as weighted nuclear norm minimization (WNNM) [Gu et al., 2017] and WSNM [Xie et al., 2016]. The nuclear norm and Schatten p-norm [Xie et al., 2016] are two surrogates of the rank function [Xu et al., 2017a]. In WNNM and WSNM, singular values are assigned different weights using a weight vector. It has been proven that WNNM is a special case of WSNM and that WSNM outperforms WNNM. Multi-channel WNNM (MCWNNM) [Xu et al., 2017b] is an extension of WNNM from grayscale image to color image that operates by introducing a weight matrix to adjust each channel's contribution to the final results based on noise level. In this paper, based on the low-rank property of the nonlocal self-similar patches and the different noise strength across each channel, we propose a multi-channel weighted Schatten p-norm minimization (MCWSNM) model for RGB color image denoising. More specifically, considering a small local RGB patch in a noisy image, we first find its nonlocal similar cubic patches in a search window with an appropriate size. These similar cubic patches are then vectorized and concatenated to construct a noisy low-rank matrix; then Schatten p-norm minimization method is performed to recover the noise-free low-rank matrix. Moreover, in order to make full use of the redundant information across each channel, a weight matrix is introduced to balance each channel's contribution to the final denoising results. This model can be solved via alternating direction method of multipliers (ADMM) framework, and each variable can be updated with a closed-form solution. In addition, the convergence property of our proposed algorithm is also provided. Figure 2: Illusion of the grouped local patches. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000001_ee3904805c6f00a0402f31513803935fe3650d51915a2f433261349130b01620.png) ## 2 Our ProposedMethod ## 2.1 Method Formulation The image denoising task involves recovering a clean image xc from its noisy observation data yc, where c = {r, g, b} is the index of the R, G and B channels. Here, we assume that the noisy image is corrupted by additive white Gaussian noise nc with σc = (σr, σg, σb), where σr, σg, σb denote the noise standard deviation in the R, G, B channels, respectively. Mathematically, yc = xc + nc. Low-rank-based denoising methods utilize the low-rank property of the grouped nonlocal similarity patches; this group procedure is illustrated in Fig.2. Given a noisy RGB color image yc, each local patch of size s × s × 3 is extracted and stretched into a vector y = (yT r , yT g , yT b )T ∈ R3s2 , where yr, yg, yb ∈ Rs2 are the corresponding patches in the R, G and B channels. For each vectorized local patch y, we find its M most similar patches (including y itself) by Euclidean distance in a proper size search window around it. We then stack the M similar patches vector column by column to obtain the noisy patch matrix Y = X + N ∈ R3s2×M , where X and N are the corresponding clean and noise patch matrix, respectively. It is clear that Y is a low-rank matrix and X can be recovered using a low-rank approximation algorithm. As a nonconvex surrogate of the rank function, the weighted Schatten p-norm of a matrix Z ∈ Rm×n is defined as ‖Z‖w,Sp = (∑min{m,n} i=1 wiσp i ) 1p , 0 < p < 1, where w = (w1,w2, . . . ,wmin{m,n})T is a non-negative weight vector and σi is the i-th singular value of Z. The weighted nuclear norm [Gu et al., 2017] is a special case of the weighted Schatten p-norm when the power p = 1. It has been proven that the Schatten p-norm with 0 < p < 1 is a better approximation of rank function than the nuclear norm [Zhang et al., 2013]. Intuitively, when denoising a noisy color image, if a channel is heavily polluted, the contribution of this channel to the final denoised results should be less, and vice versa. Thus, a weight matrix W assigned to the noise strength of each channel is introduced. Based on the low-rank property of the non-local self-similarity, we propose the following multichannel WSNM (MCWSNM) model to recover the local lowrank patch X: where λ > 0 is a tradeoff parameter used to balance the ## Algorithm 1 minX ‖Y -X‖2F + λ‖X‖pw,Sp via GST ## Input: Y , weight {wi}ri=1 , λ, p, K - 1: Singular value decomposition Y = UΣV T , Σ = ``` diag{σ1, σ2, . . . , σr}; 2: for i = 1 : r do 3: τ GST p (wi, λ) = (2λwi(1-p)) 1 2-p +λwip(2λwi(1p)) p-1 2-p ; 4: if |σi| ≤ τ GST p (wi) then 5: δi = 0; 6: else 7: δ(k) i = |σi|; 8: for k = 0, 1, . . . , K do 9: δ(k+1) i = |σi| -wip(δ(k) i )p-1 ; 10: k = k + 1; 11: end for 12: δi = sgn(σi)δ(k) i ; 13: end if 14: end for 15: ∆ = diag(δ1, δ2, . . . , δr); Output: X∗ = U∆V T ``` data fidelity term and the regularization term, while W = diag(τrI, τgI, τbI), I ∈ Rs2×s2 is the identity matrix, (τr, τg, τb) = min{σr, σg, σb}/(σr, σg, σb). ## 2.2 Model Optimization We utilize the variable splitting method to the MCWSNM model (1). By introducing an augmented variable Z, model (1) can be reformulated as a linear constrained optimization problem. Thus, model (1) can be expressed as follows: Because the two variables X and Z in problem (2) are separable, this programming problem can be solved using the ADMM framework. The augmented Lagrangian function of (2) is where L is the augmented Lagrangian multiplier and ρ > 0 is the penalty parameter. By taking derivatives of L with respect to X and Z and setting the derivative function to be zero, the variables can be alternatively updated as follows: (1) Xk+1 (2) Zk+1 This is a weighted Schatten p-norm minimization problem. It was noted in [Xie et al., 2016] that if the weights follow the non-descending permutation, (5) can be equivalently transformed into independent nonconvex ℓp-norm subproblems, ## Algorithm 2 Solve MCWSNM via ADMM Input: data Y , weight W, p, K1, µ > 1, tol > 0; - 1: Initialization: X0 = Z0 = 0, L0 = 0, ρ0 > 0, flag = False, k = 0; - 2: while flag == False do - 3: Update X by using (4); - 4: Update Z by solving (5); - 5: Update L: Lk+1 = Lk +ρk(Xk+1 -Zk+1); - 6: Update ρ: ρk+1 = µρk; - 7: k = k +1; - 8: if (Convergence condition is satisfied) or (k ≥ K1) then - 9: flag = True; - 10: end if - 11: end while Output: X∗ . the global optima of which can be efficiently solved by the generalized soft-thresholding (GST) algorithm. This is summarized in Algorithm 1. - (4) ρk+1 = µρk, (µ > 1). The above alternative updating steps are repeated until either the convergence condition is satisfied or the number of iterations exceeds a preset K1. The ADMM algorithm converges when 1) ‖Xk+1 - Zk+1‖F ≤ tol, 2) ‖Xk+1 - Xk‖F ≤ tol and 3) ‖Zk+1-Zk‖F ≤ tol are simultaneously satisfied; here, tol is a small tolerance value. The complete updating procedures are summarized in Algorithm 2. ## 2.3 Convergence and Complexity Although the proposed MCWSNM (1) is nonconvex, the global optimum also can be obtained for the limitations of weights permutation in GST. From Fig.3, it can be seen that ‖Xk+1 -Xk‖2, ‖Zk+1 -Zk‖2 and ‖Xk+1 -Zk+1‖2 simultaneously approach 0 during the iteration process. This curve is based on a synthetic experiment on Kodak PhotoCD Dataset and the test image is "kodim01" (see Experiments Section in detail). Figure 3: The convergence curves of ‖Xk+1 -Xk‖2, ‖Zk+1 - Zk‖2 and ‖Xk+1 - Zk+1‖2 of image "kodim01" in the Kodak Dataset. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000002_7a54ec5a149e1a38e2061a1e3ca729b810d0ddb364324f4890d899de3fb387cd.png) We next provide a theorem that theoretically guarantees the convergence property of Algorithm 2. Theorem 1. Assume that the weights w are sorted in a non-descending order and the parameter ρk is unbounded; then the sequences {Xk}, {Zk} and {Lk} generated in Algorithm 2 satisfy: (a) limk→+∞‖Xk+1 - Zk+1‖F = 0; (b) limk→+∞ ‖Xk+1 - Xk‖F = 0; (c) limk→+∞ ‖Zk+1 - Zk‖F = 0. Proof. We first prove that the sequence {Lk} generated by Algorithm 2 is upper bounded. UkΛkV T k denotes the SVD of matrix 1 ρk Lk + Xk+1 in the k + 1 iteration, where Λk is the diagonal singular value matrix. By using the GST algorithm for WSNM, we have Zk+1 = Uk∆kV T k , where ∆k = {diag(δ1 k , δ2 k , . . . , δn k )} is the diagonal singular value matrix after generalized soft-thresholding operation. Then: Hence, the sequence {Lk} is upper bounded. We then prove that the sequence of the Lagrange function {L(Xk+1,Zk+1,Lk+1, ρk+1)} is also upper bounded. The inequality L(Xk+1, Zk+1, Lk, ρk) ≤ L(Xk, Zk, Lk, ρk) always holds since we have the globally optimal solution of X and Z in their corresponding subproblems (step 3 and step 4 in Algorithm 2. Based on the updating rule of L, it yields Since {Lk} is upper bounded, the sequence {Lk+1 -Lk} is also upper bounded. Denote by a the upper bound of {Lk+1Lk} for all k ≥ 0, i.e. {Lk+1 - Lk} ≤ a, ∀k ≥ 0. We therefore conclude that Thus, {L(Xk+1, Zk+1, Lk+1, ρk+1)} is upper bounded. We next prove the sequences of {Xk} and {Zk} are upper bounded. Since {L(Xk,Zk,Lk, ρk)} and {Lk} are upper bounded and and the sequence {W(Y -Xk)} and {Zk} are upper bounded. Since Lk+1 = Lk + ρk(Xk+1 -Zk+1), {Xk} is also upper bounded. Thus, there exists at least one accumulation point for {Xk, Zk}. More specifically, we obtain that and that the accumulation point is a feasible solution to the objective function. Thus, equation (a) is proved. Finally, we prove that the change of sequence {Xk} and {Zk} in adjacent iterations tends to be 0. For Xk+1 and Xk = 1 ρk-1 (Lk - Lk-1) + Zk, we have This completes the proof. The main computational cost in a single iteration of Algorithm 2 consists of two parts. The first part involves updating X, in which the time complexity is O(max{s4M,M 3 }). The second part involves updating Z. The predominant cost of this updating is the SVD and the calculation of X∗ . Its complexity is O(min{s4M, s2M 2 } + s2 r4M). The costs for updating L and ρ can be ignored. Therefore, the total time complexity of our MCWSNM for solving problem (1) is about O(K1M 3 ). ## 3 Experiments To illustrate the performance of the proposed MCWSNM, we implement MCWSNM on synthetic and real color noisy images. We also compare the proposed method with several recent proposed methods, including NC [Lebrun et al., 2015], NCSR [Dong et al., 2013b], PGPD [Xu et al., 2015], MCWNNM [Xu et al., 2017b], DnCNN [Zhang et al., 2017a], FFDNet [Zhang et al., 2018] and IRCNN [Zhang et al., 2017b]. In more detail, NC is an online blind image denoising platform, NCSR and PGPD are designed for grayscale images and MCWNNM is a color image denoising method while DnCNN, FFDNet, and IRCNN are three methods that operate on the basis of convolutional neural networks. All the parameters of the comparison algorithms are either optimally assigned, or chosen as described in the reference papers. Noise level of MCWSNM and most comparative methods should be provided as parameters. In the synthetic experimental case, the noise (σr, σg, σb) in the R, G and B channels are assumed to be known. In the case involving real noise, we utilize the noise estimation method outlined in [Chen et al., 2015] to estimate the noise level of the noisy image for each channel. We implement the grayscale denoising methods, NCSR and PGPD, on the color noisy images in a bandwise manner with the corresponding channel noise level. ## 3.1 Synthetic Noisy Color Image Experiments The Kodak PhotoCD Dataset is first utilized in our synthetic experiments. It includes 24 color images, each of which is either 768 × 512 or 512 × 768 in size. The noisy image is generated by adding zero mean Gaussian noise with σr = 40, σg = 20 and σb = 30. In MCWSNM, we set the local search Figure 5: Denoised images of "kodim1" in Kodak PhotoCD Dataset window size of each patch as 20, the similar patch number M = 70, each patch size s = 6, K1 = 10, K = 4, c = 2√2, λ = 0.6, p = 0.999 and ρ = 3. Figure 4: Line graph of the denoising results in Kodak Dataset. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000003_a1cdd64502c09324e073c941a33a66ffc064161898be778e034540acc7b4430b.png) ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000004_dbc3f07523a8370beb9e5d151b82520cabc024cf68ae7ef7123c651c4b207d73.png) with σr = 40, σg = 20 and σb = 30. ((a): Original, (b): Noisy, (c): NC, (d): NCSR, (e): PGPD, (f): MCWNNM, (g): DnCNN, (h): FFDNet, (i): IRCNN, (j): MCWSNM). ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000005_6043e8186ccbbecdea786b0e7453453afa16cac1ef2ae74fd8b0eca112587cb4.png) Figure 6: Denoised images of cropped "kodim3" in the Kodak PhotoCD Dataset with σr = 40, σg = 20 and σb = 30. The line graph of the PSNR results for MCWSNM and the comparison methods are presented in Fig.4. It can be seen from this graph that our proposed method outperforms the other competing methods in most cases. Moreover, Fig.5 and Fig.6 show the denoised results of "kodim1" and "kodim3" Figure 7: Ten noisy images in the CC Dataset. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000006_1d2bbb6868c8ebdc81cba73f3b963fd275e0e91e4949ecbc8ed255df454c39e9.png) Figure 8: Denoised images of cropped #7 in real Dataset CC. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000007_dff94dbf1b18626e63fd96efd72be7513470b3ffa15b49b4febb480abb595d39.png) in Kodak PhotoCD Dataset, respectively. Visual inspection reveals that MCWSNM can obtain the best visual result and clear texture information. Color artifacts are generated by NCSR and PGPD, while NC over-smooths the image. While MCWNNM, DnCNN, FFDNet and IRCNN can get a clean image, some of the detailed information is lost compared with the original image. ## 3.2 Real Noisy Color Image Experiments We implement the WCWSNM on a real noisy color image dataset, CC [Nam et al., 2016], to evaluate the method's performance. This dataset includes 11 static scenes. The noisy images were captured in an indoor environment with different cameras and camera settings. For each scene, 500 images were taken using the same camera and camera settings. The mean image of each scene was then calculated to generate the noisy-free images, which were roughly regarded as the ground truth (GT). As the size of the original image is very large, 60 cropped smaller images with size 512 × 512 were provided in [Nam et al., 2016]. In this paper, we select 10 cropped images (see Fig.7) to conduct the experiment. For MCWSNM, we set the local search window size for each patch as 20, the similar patch number M = 60, each patch size s = 5, K1 = 10, K = 4, c = 2√2, λ = 0.6, p = 0.999 and ρ = 3. Because the GT are provided, a quantitative assessment of each method is accessible. PSNR results for different cameras and camera settings are provided in Table Figure 9: Denoised images of cropped image #10 in the real Dataset CC. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000008_bbc6005a24b72fdfc66a7a2d62082a25c3cd46e43553d2df6bc0a6101d121f78.png) Figure 10: The influence of changing p on denoised results under different noise levels (σr, σg, σb) on 24 images in the Kodak PhotoCD Dataset. ![Image](https://ijcai.org/proceedings/2020/fulltext/89/image_000009_477f130c250a4af9edeaf9c3c6304291e02957401a1e0de46a54734c40fd19a4.png) 1. It can be seen from the table that the proposed MCWSNM obtains the highest PSNR value in most noisy images. Fig. 8 and Fig. 9 show the visual results of #7 and #10 images in CC dataset, respectively. Compared with other methods, MCWSNM gets the best visual effect. It not only remove the noise completely, but also preserve the detailed information effectively. Table 1: PSNR results (dB) of real color image CC Dataset. | Camera Settings | # | NC | NCSR | PGPD | MCWNNM | DnCNN | FFDNET | IRCNN | MCWSNM | |----------------------|-----|---------|---------|---------|----------|---------|----------|---------|----------| | Canon 5D, ISO=3200 | 1 | 38.5689 | 37.8693 | 36.8979 | 40.8160 | 40.8445 | 40.6137 | 41.3212 | 42.1242 | | Canon 5D, ISO=3200 | 2 | 35.0985 | 34.7144 | 33.8614 | 36.5158 | 35.7199 | 35.6380 | 36.0826 | 35.8209 | | Nikon D600, ISO=3200 | 3 | 36.8310 | 36.4562 | 35.8916 | 38.9327 | 38.9287 | 38.7748 | 39.3098 | 37.9467 | | Nikon D600, ISO=3200 | 4 | 38.6322 | 36.3762 | 35.9296 | 40.1002 | 39.3217 | 38.7881 | 40.4201 | 40.4434 | | Nikon D800, ISO=1600 | 5 | 38.2259 | 36.8040 | 36.2972 | 39.4494 | 39.8094 | 39.5719 | 39.9118 | 40.0471 | | Nikon D800, ISO=1600 | 6 | 39.0023 | 37.3847 | 36.4443 | 42.3815 | 40.6930 | 40.2738 | 42.8365 | 41.9094 | | Nikon D800, ISO=3200 | 7 | 36.5622 | 34.2501 | 33.9318 | 39.5804 | 36.7582 | 36.2557 | 38.9257 | 41.5596 | | Nikon D800, ISO=3200 | 8 | 35.9500 | 33.8988 | 33.5135 | 36.7548 | 36.0972 | 35.8297 | 38.2784 | 37.8922 | | Nikon D600, ISO=6400 | 9 | 33.2295 | 31.1022 | 30.7797 | 36.5241 | 32.1810 | 31.9962 | 33.4272 | 38.2520 | | Nikon D600, ISO=6400 | 10 | 32.2609 | 30.6858 | 30.4058 | 32.2105 | 31.6635 | 31.4748 | 32.7171 | 32.4324 | damental Research Funds for the Central Universities under Grant 413000092 and 413000082. ## References 1. [Buades et al., 2005] Antoni Buades, Bartomeu Coll, and Jean-Michel Morel. A non-local algorithm for image de- noising. In CVPR, pages 60-65, 2005. 2. [Chatterjee and Milanfar, 2010] Priyam Chatterjee and Pey- man Milanfar. Is denoising dead? IEEE Transactions on Image Processing, 19(4):895-911, 2010. 3. [Chen et al., 2015] Guangyong Chen, Fengyuan Zhu, and Pheng-Ann Heng. An efficient statistical method for im- age noise level estimation. In ICCV, pages 447-485, 2015. 4. [Dabov et al., 2007a] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. Color image denoising via sparse 3D col- laborative filter with grouping constraint in Luminance- Chrominance space. In ICIP, pages 313-316, 2007. 5. [Dabov et al., 2007b] Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen O. Egiazarian. Im- age denoising by sparse 3-D transform-domain collabo- rative filtering. IEEE Transactions on Image Processing, 16(8):2080-2095, 2007. 6. [Dong et al., 2013a] Weisheng Dong, Guangming Shi, and Xin Li. Nonlocal image restoration with bilateral variance estimation: A low-rank approach. IEEE Transactions on Image Processing, 22(2):700-711, 2013. 7. [Dong et al., 2013b] Weisheng Dong, Lei Zhang, Guang- ming Shi, and Xin Li. Nonlocally centralized sparse rep- resentation for image restoration. IEEE Transactions on Image Processing, 22(4):1620-1630, 2013. 8. [Fang et al., 2020a] Yixiang Fang, Xin Huang, Lu Qin, Ying Zhang, Wenjie Zhang, Reynold Cheng, and Xuemin Lin. A survey of community search over big graphs. The VLDB Journal, 29:353-392, 2020. 9. [Fang et al., 2020b] Yixiang Fang, Yixing Yang, Wenjie Zhang, Xuemin Lin, and Xin Gao. Effective and effi- cient community search over large heterogeneous infor- mation networks. Proceedings of the VLDB Endowment, 13(6):854-867, 2020. 10. [Gu et al., 2017] Shuhang Gu, Qi Xie, Deyu Meng, Wang- meng Zuo, Xiangchu Feng, and Lei Zhang. Weighted nuclear norm minimization and its applications to low level vision. International Journal of Computer Vision, 121(2):183-208, 2017. 11. [Hu et al., 2019] Zhentao Hu, Zhiqiang Huang, Xinjian Huang, Fulin Luo, and Renzhen Ye. An adaptive nonlocal gaussian prior for hyperspectral image denoising. IEEE Geoscience and Remote Sensing Letters, 16(9):1487- 1491, 2019. 12. [Lebrun et al., 2015] Marc Lebrun, Miguel Colom, and Jean-Michel Morel. The noise clinic: A blind image de- noising algorithm. IPOL Journal, 5:1-54, 2015. 13. [Liu et al., 2017] Weiwei Liu, Ivor W. Tsang, and Klaus- Robert Müller. An easy-to-hard learning paradigm for multiple classes and multiple labels. Journal of Machine Learning Research, 18(94):1-38, 2017. 14. [Liu et al., 2018] Ding Liu, BihanWen, Xianming Liu, Zhangyang Wang, and Thomas S. Huang. When image denoising meets high-level vision tasks: A deep learning approach. In IJCAI, pages 842-848, 2018. 15. [Liu et al., 2019] Weiwei Liu, Donna Xu, Ivor W. Tsang, and Wenjie Zhang. Metric learning for multi-output tasks. IEEE Transactions on Pattern Analysis and Machine In- telligence, 42(2):408-422, 2019. 16. [Mairal et al., 2008] Julien Mairal, Michael Elad, and Guillermo Sapiro. Sparse representation for color im- age restoration. IEEE Transactions on Image Processing, 17(1):53-69, 2008. 17. [Mairal et al., 2012] Julien Mairal, Francis R. Bach, and Jean Ponce. Task-driven dictionary learning. IEEE Trans- actions on Pattern Analysis and Machine Intelligence, 34(4):791-804, 2012. 18. [Marsousi et al., 2014] Mahdi Marsousi, Kaveh Abhari, Paul Babyn, and Javad Alirezaie. An adaptive approach to learn overcomplete dictionaries with efficient numbers of elements. IEEE Transactions on Signal Processing, 62(12):3272-3283, 2014. 19. [Nam et al., 2016] Seonghyeon Nam, Youngbae Hwang, Ya- suyuki Matsushita, and Seon Joo Kim. A holistic approach to cross-channel image noise modeling and its application to image denoising. In CVPR, pages 1683-1691, 2016. 20. [Roth and Black, 2005] Stefan Roth and Michael J. Black. Fields of experts: A framework for learning image priors. In CVPR, volume 2, pages 860-867, 2005. 21. [Starck et al., 2002] Jean-Luc Starck, Emmanuel J. Candès, and David L. Donoho. The curvelet transform for im- age denoising. IEEE Transactions on Image Processing, 11(6):670-684, 2002. 22. [Wang et al., 2018a] Zengmao Wang, Yuhong Guo, and Bo Du. Matrix completion with preference ranking for top-N recommendation. In IJCAI, pages 3585-3591, 2018. 23. [Wang et al., 2018b] Zheng Wang, Xiang Bai, Mang Ye, and Shin'ichi Satoh. Incremental deep hidden attribute learn- ing. In ACM MM, pages 72-80, 2018. 24. [Xie et al., 2016] Yuan Xie, Shuhang Gu, Yan Liu, Wang- meng Zuo, Wensheng Zhang, and Lei Zhang. Weight- ed Schatten p-norm minimization for image denoising and background subtraction. IEEE Transactions on Image Pro- cessing, 25(10):4842-4857, 2016. 25. [Xu et al., 2015] Jun Xu, Lei Zhang, Wangmeng Zuo, David Zhang, and Xiangchu Feng. Patch group based nonlocal self-similarity prior learning for image denoising. In IC- CV, pages 244-252, 2015. 26. [Xu et al., 2017a] Chen Xu, Zhouchen Lin, and Hongbin Zha. A unified convex surrogate for the Schatten-p nor- m. In AAAI, pages 926-932, 2017. 27. [Xu et al., 2017b] Jun Xu, Lei Zhang, David Zhang, and Xi- angchu Feng. Multi-channel weighted nuclear norm min- imization for real color image denoising. In ICCV, pages 1096-1104, 2017. 28. [Ye et al., 2018] Mang Ye, Zheng Wang, Xiangyuan Lan, and Pong C. Yuen. Visible thermal person re-identification via dual-constrained top-ranking. In IJCAI, pages 1092- 1099, 2018. 29. [Zhang and Aeron, 2016] Zemin Zhang and Shuchin Aeron. Denoising and completion of 3D data via multidimension- al dictionary learning. In IJCAI, pages 2371-2377, 2016. 30. [Zhang et al., 2013] Min Zhang, Zheng-Hai Huang, and Y- ing Zhang. Restricted p-isometry properties of nonconvex matrix recovery. IEEE Transactions on Information Theo- ry, 59(7):4316-4323, 2013. 31. [Zhang et al., 2017a] Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. Beyond a Gaussian de- noiser: Residual learning of deep CNN for image denois- ing. IEEE Transactions on Image Processing, 26(7):3142- 3155, 2017. 32. [Zhang et al., 2017b] Kai Zhang, Wangmeng Zuo, Shuhang Gu, and Lei Zhang. Learning deep CNN denoiser prior for image restoration. In CVPR, pages 2808-2817, 2017. 33. [Zhang et al., 2018] Kai Zhang, Wangmeng Zuo, and Lei Zhang. FFDNet: Toward a fast and flexible solution for CNN-based image denoising. IEEE Transactions on Im- age Processing, 27(9):4608-4622, 2018. 34. [Zhu et al., 2016] Fengyuan Zhu, Guangyong Chen, and Pheng-Ann Heng. From noise modeling to blind image denoising. In CVPR, pages 420-429, 2016.