Accession Number:

ADA585746

Title:

Group Sparse Optimization by Alternating Direction Method

Descriptive Note:

Technical rept.

Corporate Author:

RICE UNIV HOUSTON TX DEPT OF COMPUTATIONAL AND APPLIED MATHEMATICS

Personal Author(s):

Report Date:

2012-11-22

Pagination or Media Count:

20.0

Abstract:

This paper proposes efficient algorithms for group sparse optimization with mixed 12,1-regularization, which arises from the reconstruction of group sparse signals in compressive sensing, and the group Lasso problem in statistics and machine learning. It is known that encoding the group information in addition to sparsity will lead to better signal recoveryfeature selection. The 12,1-regularization promotes group sparsity, but the resulting problem, due to the mixed-norm structure and possible grouping irregularity, is considered more difficult to solve than the conventional 11-regularized problem. Our approach is based on a variable splitting strategy and the classic alternating direction method ADM. Two algorithms are presented, one derived from the primal and the other from the dual of the 12,1-regularized problem. The convergence of the proposed algorithms is guaranteed by the existing ADM theory. General group configurations such as overlapping groups and incomplete covers can be easily handled by our approach. Computational results show that on random problems the proposed ADM algorithms exhibit good efficiency, and strong stability and robustness.

Subject Categories:

  • Numerical Mathematics
  • Statistics and Probability
  • Operations Research
  • Cybernetics
  • Manufacturing and Industrial Engineering and Control of Production Systems

Distribution Statement:

APPROVED FOR PUBLIC RELEASE