A framework of constraint preserving update schemes for optimization on Stiefel manifold

B Jiang, YH Dai - Mathematical Programming, 2015 - Springer
Mathematical Programming, 2015Springer
This paper considers optimization problems on the Stiefel manifold X^ TX= I_p XTX= I p,
where X ∈ R^ n * p X∈ R n× p is the variable and I_p I p is the p p-by-p p identity matrix. A
framework of constraint preserving update schemes is proposed by decomposing each
feasible point into the range space of XX and the null space of X^ T XT. While this general
framework can unify many existing schemes, a new update scheme with low complexity cost
is also discovered. Then we study a feasible Barzilai–Borwein-like method under the new …
Abstract
This paper considers optimization problems on the Stiefel manifold , where is the variable and is the -by- identity matrix. A framework of constraint preserving update schemes is proposed by decomposing each feasible point into the range space of and the null space of . While this general framework can unify many existing schemes, a new update scheme with low complexity cost is also discovered. Then we study a feasible Barzilai–Borwein-like method under the new update scheme. The global convergence of the method is established with an adaptive nonmonotone line search. The numerical tests on the nearest low-rank correlation matrix problem, the Kohn–Sham total energy minimization and a specific problem from statistics demonstrate the efficiency of the new method. In particular, the new method performs remarkably well for the nearest low-rank correlation matrix problem in terms of speed and solution quality and is considerably competitive with the widely used SCF iteration for the Kohn–Sham total energy minimization.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果