Codes（源程序） Liang Lin, Keze Wang, Deyu Meng, Wangmeng Zuo, Lei Zhang. Active SelfPaced Learning for CostEffective and Progressive Face Identification. To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017. [arxiv version][code]
Yang Chen, Xiangyong Cao, Qian Zhao, Deyu Meng, Zongben Xu. Denoising Hyperspectral Image with Noni.i.d. Noise Structure. IEEE Transactions on Cybernetics. 2017. [arxiv version][Appendix][code]
Kede Ma, Hui Li, Hongwei Yong, Zhou Wang, Deyu Meng, Lei Zhang. Robust MultiExposure Image Fusion: A Structural Patch Decomposition Approach. IEEE Trans. on Image Processing, 2017. [supplementary material][code]
Xiangyong Cao, Lin Xu, Deyu Meng, Qian Zhao, Zongben Xu. Integration of 3dimensional discrete wavelet transform and Markov random field for hyperspectral image classification. Neurocomputing 226, 90100, 2017. [code] (This paper designs a new feature leading to the stateoftheart performance on hyperspectral image classification.)
Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, Lei Zhang, Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising, IEEE Trans. on Image Processing, 2017. [code]
ShoouI Yu, Deyu Meng, Wangmeng Zuo, Alexander G Hauptmann, The solution path algorithm for identityaware multiobject tracking. CVPR 2016. [code and data]
Chenqiang Gao, Yinhe Du, Jiang Liu, Jing Lv, Luyu Yang, Deyu Meng, Alexander G Hauptmann, InfAR dataset: Infrared action recognition at different times, Neurocomputing, 2016. [InfAR Dataset]
Qi Xie, Qian Zhao, Deyu Meng, Zongben Xu, Shuhang Gu, Wangmeng Zuo and Lei Zhang. Multispectral images denoising by intrinsic tensor sparsity regularization. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. [supplementary material] [Matlab code]
Wenfei Cao, Yao Wang, Jian Sun, Deyu Meng, Can Yang, Andrzej Cichocki, Zongben Xu. Total Variation Regularized Tensor RPCA for Background Subtraction from Compressive Measurements. IEEE Transactions on Image Processing, 2016. [Demo code]
Xiangyong Cao, Yang Chen, Qian Zhao, Deyu Meng, Yao Wang, Dong Wang, Zongben Xu. Lowrank Matrix Factorization under General Mixture Noise DIstributions. ICCV (oral), 2015. [supplementary material] [Matlab code][arxiv version]
Lu Jiang, ShoouI Yu, Deyu Meng, Teruko Mitamura, Alexander Hauptmann. Bridging the Ultimate Semantic Gap: A Semantic Search Engine for Internet Videos. In ACM International Conference on Multimedia Retrieval (ICMR). 2015. [BibTex supplementary materials  slides  project page] Best paper runnerup [featured in] Pittsburgh Supercomputing Center
Yong Xu, Bo Huang, Yuyue Xu, Kai Cao, Chunlan Guo, Deyu Meng. Spatial and Temporal Image Fusion via Regularized Spatial Unmixing. IEEE Geoscience and Remote Sensing Letters, 12(6): 13621366, 2015. Matlab code.
Lu Jiang, Deyu Meng, Qian Zhao, Shiguang Shan, Alexander Hauptmann. Selfpaced Curriculum Learning. AAAI, 2015. Supplementary material, slides, code.
Lu Jiang, Deyu Meng, ShoouI Yu, ZhenZhong Lan, Shiguang Shan, Alexander Hauptmann.Selfpaced Learning with Diversity. NIPS, 2014.Supplementary material, code.
Deyu Meng, Fernando De la Torre. Robust Matrix Factorization with Unknown Noise. ICCV, 2013. Matlab code.
Chenqiang Gao, Deyu Meng, Yi Yang, Yongtao Wang, Xiaofang Gao, Alexander G. Hauptmann. Infrared Patchimage Model for Small Target Detection in A Single Image. IEEE Transactions on Image Processing. 22(12): 49965009, 2013. Matlab Code (Our robust PCA method can effectively detect small targets from a single infrared image.
Haoquan Shen, ShoouI Yu, Yi Yang, Deyu Meng, Alexander Hauptmann. Unsupervised Video Adaptation for Parsing Human Motion. ECCV, 2014. [Project Page] [Code and Dataset] [Demo Video]
Qian Zhao, Deyu Meng, Zongben Xu, Wangmeng Zuo, Lei Zhang. Robust principal component analysis with complex noise, Supplementary Material, ICML, 2014, Matlab code. (Our robust PCA method can well ﬁt more complex noise beyond conventional Gaussian, Laplacian, Sparse noise or any combinations of them) Introduction: We propose a generative RPCA model under the Bayesian framework by modeling data noise as a mixture of Gaussians (MoG). The MoG is a universal approximator to continuous distributions and thus our model is able to fit a wide range of noises such as Laplacian, Gaussian, sparse noises and any combinations of them. A variational Bayes algorithm is presented to infer the posterior of the proposed model. All involved parameters can be recursively updated in closed form. The advantage of our method is demonstrated by extensive experiments on synthetic data, face modeling and background subtraction.
Ji Zhao, Deyu Meng. FastMMD: Ensemble of Circular Discrepancy for Efficient TwoSample Test, arXiv:1405.2664, 2014, Matlab Code. (Our proposed FastMMD method decreases the time complexity of MMD calculation from conventional O(N^2d) to O(Nlog(d))). Introduction: The maximum mean discrepancy (MMD) is a recently proposed test statistic for twosample test. Its quadratic time complexity, however, greatly hampers its availability to largescale applications. To accelerate the MMD calculation, in this study we propose an efficient method called FastMMD. The transform the MMD with shiftinvariant kernels into the amplitude expectation of a linear combination of sinusoid components based on Bochner’s theorem and Fourier transform. Taking advantage of sampling of Fourier transform, FastMMD decreases the time complexity for MMD calculation from O(N^2d) to O(Nd), where N and d are the size and dimension of the sample set, respectively. For kernels that are spherically invariant, the computation can be further accelerated to O(N log d) by using the Fastfood technique. The uniform convergence of our method has also been theoretically proved in both unbiased and biased estimates. We have further provided a geometric explanation for our method, namely ensemble of circular discrepancy, which facilitates us to understand the insight of MMD, and is hopeful to help arouse more extensive metrics for assessing twosample test.
Yi Peng, Deyu Meng, Zongben Xu, Chenqiang Gao, Yi Yang, Biao Zhang. Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising. Supplementary Material, CVPR, 2014. (We got the stateoftheart performance for multispectral image denoising) Matlab code. Introduction: In this paper we propose an effective MSI denoising approach by combinatorially considering two intrinsic characteristics underlying an MSI: the nonlocal similarity over space and the global correlation across spectrum. In specific, by explicitly considering spatial selfsimilarity of an MSI we construct a nonlocal tensor dictionary learning model with a groupblocksparsity constraint, which makes similar fullband patches (FBP) share the same atoms from the spatial and spectral dictionaries. Furthermore, through exploiting spectral correlation of an MSI and assuming overredundancy of dictionaries, the constrained nonlocal MSI dictionary learning model can be decomposed into a series of unconstrained lowrank tensor approximation problems, which can be readily solved by offtheshelf higher order statistics. Experimental results show that our method outperforms all stateoftheart MSI denoising methods under comprehensive quantitative performance measures.
Wangmeng Zuo, Deyu Meng, Lei Zhang, Xiangchu Feng, David Zhang. A Generalized Iterated Shrinkage Algorithm for Nonconvex Sparse Coding. ICCV, 2013.(The corrected solution of nonconvex sparse coding by iterated thresholding) Supplementary material, Matlab Code. Introduction: In many sparse coding based image restoration and image classification problems, using nonconvex ℓpnorm minimization (0 ≤ p < 1) can often obtain better results than the convex l1norm minimization. A number of algorithms, e.g., iteratively reweighted least squares (IRLS), iteratively thresholding method (ITMlp), and lookup table (LUT), have been proposed for nonconvex ℓpnorm sparse coding, while some analytic solutions have been suggested for some specific values of p. In this paper, by extending the popular softthresholding operator, we propose a generalized iterated shrinkage algorithm (GISA) for lpnorm nonconvex sparse coding. Unlike the analytic solutions, the proposed GISA algorithm is easy to implement, and can be adopted for solving nonconvex sparse coding problems with arbitrary p values. Compared with LUT, GISA is more general and does not need to compute and store the lookup tables. Compared with IRLS and ITMlp, GISA is theoretically more solid and can achieve more accurate solutions. Experiments on image restoration and sparse coding based face recognition are conducted to validate the performance of GISA.
Lu Jiang, Wei Tong, Deyu Meng, Alexander G. Hauptmann.Towards Efficient Learning of Optimal Spatial BagofWords Representations. ICMR, 2014 (Best paper runner up). Slides. Please download our code in JS Tiling webpage. Introduction: Spatial Pyramid Matching (SPM) assumes that the spatial BagofWords (BoW) representation is independent of data. However, evidence has shown that the assumption usually leads to a suboptimal representation. In this paper, we propose a novel method called JensenShannon (JS) Tiling to learn the BoW representation from data directly at the BoW level. The proposed JS Tiling is especially appropriate for largescale datasets as it is orders of magnitude faster than existing methods, but with comparable or even better classification precision. Specifically, JS Tiling systematically generates all possible spatial BoW representations called tilings, which are then evaluated using the computationally inexpensive metric based on the JS divergence. Experimental results on four benchmarks including two TRECVID12 datasets validate that JS Tiling outperforms the SPM and the stateoftheart methods. The runtime comparison demonstrates that selecting BoW representations by JS Tiling is more than 1,000 times faster than running classifiers.
Deyu Meng, Hengbin Cui, Zongben Xu, Kaili Jing. Following the Entire Solution Path of Sparse Principal Component Analysis by CoordinatePairwise Algorithm. Data & Knowledge Engineering, accepted, 2013. PDFMatlab Code Introduction: In this paper we derive an algorithm to follow the entire solution path of
Yee Leung, Deyu Meng, Zongben Xu. Evaluation of a spatial relationship by the concept of intrinsic spatial distance. Geograhpical Analysis, 45(4):380400, 2013. PDF Matlab code Introduction: We propose the concept of intrinsic spatial distance (ISD) for the study of a spatial relationship between any two points in space. The ISD is a distance measure that takes into account the separation of two points with respect to their physical and attribute closeness. We construct an algorithm to implement this concept as an ISD measurement. Based on the ISD concept, two points in space are related through a transitional path linking one to the other. As an ISD measurement decreases, the spatial relationship between two points becomes increasingly stronger. We argue theoretically and demonstrate empirically that the ISD concept is not predisposed in favor of the first law of geography, but directly considers variance of nearness in physical distance and attribute distance to derive the extent to which two points are spatially associated. Specifically, in single attribute cases, the information uncovered by an ISD measurement is more elaborate than that
Deyu Meng, Zongben Xu, Lei Zhang, Ji Zhao. A cyclic weighted median method for L1 lowrank matrix factorization with missing entries. AAAI, 2013. PDF Matlab code (A very simple but very efficient and effective L1 matrix factorization algorithm) Introduction: In this work we propose a novel cyclic weighted median (CWM) method, which is intrinsically a coordinate decent algorithm, for L1norm LRMF. The CWM method minimizes the objective by solving a sequence of scalar minimization subproblems, each of which is convex and can be easily solved by the weighted median filter. The extensive experimental results validate that the CWM method outperforms stateofthearts in terms of both accuracy and computational efficiency.
Qian Zhao, Deyu Meng, Zongben Xu. A recursive divideandconquer approach for sparse principal component analysis. arXiv:1211.7219, 2013.PDF Matlab code (Our method performs better than most of the stateoftheart algorithms for sparse PCA) Introduction: We propose a new method for sparse PCA based on the recursive divideandconquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler subproblems, each having a closedform solution. By recursively solving these subproblems in an analytical way, an efficient algorithm is constructed to solve the sparse PCA problem. The algorithm only involves simple computations and is thus easy to implement. The proposed method can also be very easily extended to other sparse PCA problems with certain constraints, such as the nonnegative sparse PCA problem. Furthermore, we have shown that the proposed algorithm converges to a stationary point of the problem, and its computational complexity is approximately linear in both data size and dimensionality.
Deyu Meng, Qian Zhao, Zongben Xu. Improve robustness of sparse PCA by L1norm maximization. Pattern Recognition. 2012, 45(1) 487497. PDF Matlab Code Introduction: A new sparse PCA method is proposed. Instead of maximizing the L2norm variance of the input data as the conventional sparse PCA methods, the new method attempts to capture the maximal L1norm variance of the data, which is intrinsically less sensitive to noises and outliers. A simple algorithm for the method is specifically designed, which is easy to be implemented and converges to a local optimum of the problem.
Zongben Xu, Mingwei Dai, Deyu Meng. Fast and efficient strategies for model selection of Gaussian support vector machines. IEEE Transactions on Systems, Man and Cybernetics, Part B. 2009, 39(5) 12921307. PDF Matlab Code (Our method can very effectively find a good σ for Gaussian kernel) Introduction: How to select the kernel parameter (σ) and the penalty coefficient (C) of Gaussian support vector machines (SVMs) are suggested in this paper. Based on viewing the model parameter selection problem as a recognition problem in visual systems, a direct parameter setting formula for the kernel parameter is derived through finding a visual scale at which the global and local structures of the given data set can be preserved in the feature space, and the difference between the two structures can be maximized. In addition, we propose a heuristic algorithm for the selection of the penalty coefficient through identifying the classification extent of a training datum in the implementation process of the sequential minimal optimization (SMO) procedure, which is a welldeveloped and commonly used algorithm in SVM training.
Deyu Meng, Yee Leung, Zongben Xu. Evaluating nonlinear dimensionality reduction based on its local and global quality assessments, Neurocomputing, 2011, 74(6): 941948. PDF Matlab code Introduction: We present a new quality assessment criterion for evaluating the performance of the nonlinear dimensionality reduction (NLDR) methods. Differing from the current quality assessment criteria focusing on the localneighborhoodpreserving performance of the NLDR methods, the proposed criterion capitalizes on a new aspect, the globalstructureholding performance, of the NLDR methods. By taking both properties into consideration, the intrinsic capability of the NLDR methods can be more faithfully reflected, and hence more rational measurement for the proper selection of NLDR methods in reallife applications can be offered.
