brendt.wohlberg.net
HomePublications
› Publications
› Software

Cite Details

Youzuo Lin, Brendt Wohlberg and Velimir Vesselinov, "ADMM Penalty Parameter Selection with Krylov Subspace Recycling Technique for Sparse Coding", in Proceedings of IEEE International Conference on Image Processing (ICIP), (Beijing, China), doi:10.1109/ICIP.2017.8296621, pp. 1945--1949, Sep 2017

Abstract

Sparse representations are widely used in a broad variety of fields. A number of different methods have been proposed to solve the sparse coding problem, of which the alternating direction method of multipliers (ADMM) is one of the most popular. One of the disadvantages of this method, however, is the need to select an algorithm parameter, the penalty parameter, that has a significant effect on th e rate of convergence of the algorithm. Although a number of heuristic methods have been proposed, as yet there is no general theory providing a good choice of this parameter for all problems. One obvious approach would be to try a number of different parameters at each iteration, proceeding further with the one that delivers the best reduction in functional value, but this would involve a substantial increase in computational cost. We show that, when solving the sparse coding problem for a dictionary corresponding to an operator with a fast transform, requiring iterative methods to solve the main linear system arising in the ADMM solution, it is possible to explore a large range of parameters at marginal additional cost, thus greatly improving the robustness of the method to the choice of penalty parameter.

BibTeX Entry

@inproceedings{lin-2017-admm,
author = {Youzuo Lin and Brendt Wohlberg and Velimir Vesselinov},
title = {{ADMM} Penalty Parameter Selection with {K}rylov Subspace Recycling Technique for Sparse Coding},
year = {2017},
month = Sep,
urlpdf = {http://brendt.wohlberg.net/publications/pdf/lin-2017-admm.pdf},
booktitle = {Proceedings of IEEE International Conference on Image Processing (ICIP)},
address = {Beijing, China},
doi = {10.1109/ICIP.2017.8296621},
pages = {1945--1949}
}