scholarly journals Proximal Alternating Direction Method with Relaxed Proximal Parameters for the Least Squares Covariance Adjustment Problem

2014 ◽  
Vol 2014 ◽  
pp. 1-10
Author(s):  
Minghua Xu ◽  
Yong Zhang ◽  
Qinglong Huang ◽  
Zhenhua Yang
Keyword(s):  
Optimization Problems ◽  
Positive Semidefinite ◽  
Numerical Linear Algebra ◽  
Alternating Direction Method ◽  
Matrix Optimization ◽  
Finance Industry ◽  
Alternating Direction ◽  
Closed Convex Set ◽  
Semidefinite Matrix ◽  
Proximal Alternating Direction Method

We consider the problem of seeking a symmetric positive semidefinite matrix in a closed convex set to approximate a given matrix. This problem may arise in several areas of numerical linear algebra or come from finance industry or statistics and thus has many applications. For solving this class of matrix optimization problems, many methods have been proposed in the literature. The proximal alternating direction method is one of those methods which can be easily applied to solve these matrix optimization problems. Generally, the proximal parameters of the proximal alternating direction method are greater than zero. In this paper, we conclude that the restriction on the proximal parameters can be relaxed for solving this kind of matrix optimization problems. Numerical experiments also show that the proximal alternating direction method with the relaxed proximal parameters is convergent and generally has a better performance than the classical proximal alternating direction method.

scholarly journals A New Algorithm for Positive Semidefinite Matrix Completion

2016 ◽  
Vol 2016 ◽  
pp. 1-5 ◽  
Author(s):  
Fangfang Xu ◽  
Peng Pan
Keyword(s):  
Matrix Completion ◽  
Positive Semidefinite ◽  
Alternating Direction Method ◽  
Low Rank ◽  
System Control ◽  
Positive Semidefinite Matrix ◽  
Linear Least Squares ◽  
Alternating Direction ◽  
Semidefinite Matrix Completion ◽  
Semidefinite Matrix

Positive semidefinite matrix completion (PSDMC) aims to recover positive semidefinite and low-rank matrices from a subset of entries of a matrix. It is widely applicable in many fields, such as statistic analysis and system control. This task can be conducted by solving the nuclear norm regularized linear least squares model with positive semidefinite constraints. We apply the widely used alternating direction method of multipliers to solve the model and get a novel algorithm. The applicability and efficiency of the new algorithm are demonstrated in numerical experiments. Recovery results show that our algorithm is helpful.

scholarly journals Some algorithms for maximum volume and cross approximation of symmetric semidefinite matrices

2021 ◽  
Author(s):  
Stefano Massei
Keyword(s):  
Computer Science ◽  
Recent Work ◽  
Linear Algebra ◽  
Optimization Problems ◽  
Approximation Error ◽  
Positive Semidefinite ◽  
Numerical Linear Algebra ◽  
Maximum Volume ◽  
Deterministic Algorithms ◽  
Principal Submatrix

AbstractVarious applications in numerical linear algebra and computer science are related to selecting the $$r\times r$$ r × r submatrix of maximum volume contained in a given matrix $$A\in \mathbb R^{n\times n}$$ A ∈ R n × n . We propose a new greedy algorithm of cost $$\mathcal O(n)$$ O ( n ) , for the case A symmetric positive semidefinite (SPSD) and we discuss its extension to related optimization problems such as the maximum ratio of volumes. In the second part of the paper we prove that any SPSD matrix admits a cross approximation built on a principal submatrix whose approximation error is bounded by $$(r+1)$$ ( r + 1 ) times the error of the best rank r approximation in the nuclear norm. In the spirit of recent work by Cortinovis and Kressner we derive some deterministic algorithms, which are capable to retrieve a quasi optimal cross approximation with cost $$\mathcal O(n^3)$$ O ( n 3 ) .

scholarly journals Managing randomization in the multi-block alternating direction method of multipliers for quadratic optimization

2020 ◽  
Author(s):  
Krešimir Mihić ◽  
Mingxi Zhu ◽  
Yinyu Ye
Keyword(s):  
Quadratic Programming ◽  
Large Scale ◽  
Optimization Problems ◽  
Quadratic Optimization ◽  
Alternating Direction Method ◽  
Convex Quadratic Programming ◽  
Method Of Multipliers ◽  
Numerical Tests ◽  
Alternating Direction ◽  
Decision Variables

Abstract The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical computational efficiency of the method, because one big matrix factorization is needed at least once even for linear and convex quadratic programming. This drawback may be overcome by enforcing a multi-block structure of the decision variables in the original optimization problem. Unfortunately, the multi-block ADMM, with more than two blocks, is not guaranteed to be convergent. On the other hand, two positive developments have been made: first, if in each cyclic loop one randomly permutes the updating order of the multiple blocks, then the method converges in expectation for solving any system of linear equations with any number of blocks. Secondly, such a randomly permuted ADMM also works for equality-constrained convex quadratic programming even when the objective function is not separable. The goal of this paper is twofold. First, we add more randomness into the ADMM by developing a randomly assembled cyclic ADMM (RAC-ADMM) where the decision variables in each block are randomly assembled. We discuss the theoretical properties of RAC-ADMM and show when random assembling helps and when it hurts, and develop a criterion to guarantee that it converges almost surely. Secondly, using the theoretical guidance on RAC-ADMM, we conduct multiple numerical tests on solving both randomly generated and large-scale benchmark quadratic optimization problems, which include continuous, and binary graph-partition and quadratic assignment, and selected machine learning problems. Our numerical tests show that the RAC-ADMM, with a variable-grouping strategy, could significantly improve the computation efficiency on solving most quadratic optimization problems.

Sign in / Sign up

Export Citation Format

Share Document