Please use this identifier to cite or link to this item:
|Title:||MPGL: An efficient matching pursuit method for generalized LASSO|
Van Den Hengel, A.
|Citation:||Proceedings of the 31st AAAI Conference on Artificial Intelligence, AAAI 2017, 2017 / pp.1934-1940|
|Conference Name:||31st AAAI Conference on Artificial Intelligence (AAAI-17) (04 Feb 2017 - 09 Feb 2017 : San Francisco)|
|Dong Gong, Mingkui Tan, Yanning Zhang, Anton van den Hengel, Qinfeng Shi|
|Abstract:||Unlike traditional LASSO enforcing sparsity on the variables, Generalized LASSO (GL) enforces sparsity on a linear transformation of the variables, gaining flexibility and success in many applications. However, many existing GL algorithms do not scale up to high-dimensional problems, and/or only work well for a specific choice of the transformation. We propose an efficient Matching Pursuit Generalized LASSO (MPGL) method, which overcomes these issues, and is guaranteed to converge to a global optimum. We formulate the GL problem as a convex quadratic constrained linear programming (QCLP) problem and tailor-make a cutting plane method. More specifically, our MPGL iteratively activates a subset of nonzero elements of the transformed variables, and solves a subproblem involving only the activated elements thus gaining significant speed-up. Moreover, MPGL is less sensitive to the choice of the trade-off hyper-parameter between data fitting and regularization, and mitigates the long-standing hyper-parameter tuning issue in many existing methods. Experiments demonstrate the superior efficiency and accuracy of the proposed method over the state-of-the-arts in both classification and image processing tasks.|
|Rights:||Copyright © 2017, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.|
|Appears in Collections:||Australian Institute for Machine Learning publications|
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.