scholarly journals The infinite dimensional Lagrange multiplier rule for convex optimization problems

2011 ◽  
Vol 261 (8) ◽  
pp. 2083-2093 ◽  
Author(s):  
Maria Bernadette Donato
Author(s):  
Kung-Fu Ng ◽  
David Yost

AbstractThe notion of quasi-regularity, defined for optimization problems in Rn, is extended to the Banach space setting. Examples are given to show that our definition of quasi-regularity is more natural than several other possibilities in the general situation. An infinite dimensional version of the Lagrange multiplier rule is established.


2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Darina Dvinskikh ◽  
Alexander Gasnikov

Abstract We introduce primal and dual stochastic gradient oracle methods for decentralized convex optimization problems. Both for primal and dual oracles, the proposed methods are optimal in terms of the number of communication steps. However, for all classes of the objective, the optimality in terms of the number of oracle calls per node takes place only up to a logarithmic factor and the notion of smoothness. By using mini-batching technique, we show that the proposed methods with stochastic oracle can be additionally parallelized at each node. The considered algorithms can be applied to many data science problems and inverse problems.


Sign in / Sign up

Export Citation Format

Share Document