Generalized bregman envelopes and proximity operators
- Authors: Burachik, Regina , Dao, Minh , Lindstrom, Scott
- Date: 2021
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 190, no. 3 (2021), p. 744-778
- Full Text:
- Reviewed:
- Description: Every maximally monotone operator can be associated with a family of convex functions, called the Fitzpatrick family or family of representative functions. Surprisingly, in 2017, Burachik and Martínez-Legaz showed that the well-known Bregman distance is a particular case of a general family of distances, each one induced by a specific maximally monotone operator and a specific choice of one of its representative functions. For the family of generalized Bregman distances, sufficient conditions for convexity, coercivity, and supercoercivity have recently been furnished. Motivated by these advances, we introduce in the present paper the generalized left and right envelopes and proximity operators, and we provide asymptotic results for parameters. Certain results extend readily from the more specific Bregman context, while others only extend for certain generalized cases. To illustrate, we construct examples from the Bregman generalizing case, together with the natural “extreme” cases that highlight the importance of which generalized Bregman distance is chosen. © 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
Incremental DC optimization algorithm for large-scale clusterwise linear regression
- Authors: Bagirov, Adil , Taheri, Sona , Cimen, Emre
- Date: 2021
- Type: Text , Journal article
- Relation: Journal of Computational and Applied Mathematics Vol. 389, no. (2021), p. 1-17
- Relation: https://purl.org/au-research/grants/arc/DP190100580
- Full Text: false
- Reviewed:
- Description: The objective function in the nonsmooth optimization model of the clusterwise linear regression (CLR) problem with the squared regression error is represented as a difference of two convex functions. Then using the difference of convex algorithm (DCA) approach the CLR problem is replaced by the sequence of smooth unconstrained optimization subproblems. A new algorithm based on the DCA and the incremental approach is designed to solve the CLR problem. We apply the Quasi-Newton method to solve the subproblems. The proposed algorithm is evaluated using several synthetic and real-world data sets for regression and compared with other algorithms for CLR. Results demonstrate that the DCA based algorithm is efficient for solving CLR problems with the large number of data points and in particular, outperforms other algorithms when the number of input variables is small. © 2020 Elsevier B.V.
An existence result for quasi-equilibrium problems via Ekeland’s variational principle
- Authors: Cotrina, John , Théra, Michel , Zúñiga, Javier
- Date: 2020
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 187, no. 2 (2020), p. 336-355
- Full Text:
- Reviewed:
- Description: This paper deals with the existence of solutions to equilibrium and quasi-equilibrium problems without any convexity assumption. Coverage includes some equivalences to the Ekeland variational principle for bifunctions and basic facts about transfer lower continuity. An application is given to systems of quasi-equilibrium problems. © 2020, Springer Science+Business Media, LLC, part of Springer Nature.
- Description: Research of M. Théra is supported by the Australian Research Council (ARC) Grant DP160100854 and benefited from the support of the FMJH Program PGMO and from the support of EDF. http://purl.org/au-research/grants/arc/DP160100854
Characterizations of nonsmooth robustly quasiconvex functions
- Authors: Bui, Hoa , Khanh, Pham , Tran, Thi
- Date: 2019
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 180, no. 3 (2019), p. 775-786
- Full Text:
- Reviewed:
- Description: Two criteria for the robust quasiconvexity of lower semicontinuous functions are established in terms of Fréchet subdifferentials in Asplund spaces. The first criterion extends to such spaces a result established by Barron et al. (Discrete Contin Dyn Syst Ser B 17:1693–1706, 2012). The second criterion is totally new even if it is applied to lower semicontinuous functions on finite-dimensional spaces. © 2018, Springer Science+Business Media, LLC, part of Springer Nature.
Extremality, stationarity and generalized separation of collections of sets
- Authors: Bui, Hoa , Kruger, Alexander
- Date: 2019
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 182, no. 1 (2019), p. 211-264
- Full Text:
- Reviewed:
- Description: The core arguments used in various proofs of the extremal principle and its extensions as well as in primal and dual characterizations of approximate stationarity and transversality of collections of sets are exposed, analysed and refined, leading to a unifying theory, encompassing all existing approaches to obtaining ‘extremal’ statements. For that, we examine and clarify quantitative relationships between the parameters involved in the respective definitions and statements. Some new characterizations of extremality properties are obtained.
New Farkas-type results for vector-valued functions : A non-abstract approach
- Authors: Dinh, Nguyen , Goberna, Miguel , Long, Dang , Lopez-Cerda, Marco
- Date: 2019
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 182, no. 1 (2019), p. 4-29
- Full Text:
- Reviewed:
- Description: This paper provides new Farkas-type results characterizing the inclusion of a given set, called contained set, into a second given set, called container set, both of them are subsets of some locally convex space, called decision space. The contained and the container sets are described here by means of vector functions from the decision space to other two locally convex spaces which are equipped with the partial ordering associated with given convex cones. These new Farkas lemmas are obtained via the complete characterization of the conic epigraphs of certain conjugate mappings which constitute the core of our approach. In contrast with a previous paper of three of the authors (Dinh et al. in J Optim Theory Appl 173:357-390, 2017), the aimed characterizations of the containment are expressed here in terms of the data.
Variational analysis Down Under open problem session
- Authors: Bui, Hoa , Lindstrom, Scott , Roshchina, Vera
- Date: 2019
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 182, no. 1 (2019), p. 430-437
- Full Text:
- Reviewed:
- Description: We state the problems discussed in the open problem session at Variational Analysis Down Under conference held in honour of Prof. Asen Dontchev on 19-21 February 2018 at Federation University Australia.
A unifying approach to robust convex infinite optimization duality
- Authors: Dinh, Nguyen , Goberna, Miguel , López, Marco , Volle, Michel
- Date: 2017
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 174, no. 3 (2017), p. 650-685
- Relation: http://purl.org/au-research/grants/arc/DP160100854
- Full Text:
- Reviewed:
- Description: This paper considers an uncertain convex optimization problem, posed in a locally convex decision space with an arbitrary number of uncertain constraints. To this problem, where the uncertainty only affects the constraints, we associate a robust (pessimistic) counterpart and several dual problems. The paper provides corresponding dual variational principles for the robust counterpart in terms of the closed convexity of different associated cones.
Characterization theorem for best polynomial spline approximation with free knots, variable degree and fixed tails
- Authors: Crouzeix, Jean-Pierre , Sukhorukova, Nadezda , Ugon, Julien
- Date: 2017
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 172, no. 3 (2017), p. 950-964
- Full Text:
- Reviewed:
- Description: In this paper, we derive a necessary condition for a best approximation by piecewise polynomial functions of varying degree from one interval to another. Based on these results, we obtain a characterization theorem for the polynomial splines with fixed tails, that is the value of the spline is fixed in one or more knots (external or internal). We apply nonsmooth nonconvex analysis to obtain this result, which is also a necessary and sufficient condition for inf-stationarity in the sense of Demyanov-Rubinov. This paper is an extension of a paper where similar conditions were obtained for free tails splines. The main results of this paper are essential for the development of a Remez-type algorithm for free knot spline approximation.
Farkas-type results for vector-valued functions with applications
- Authors: Dinh, Nguyen , Goberna, Miguel , López, Marco , Mo, T. H.
- Date: 2017
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 173, no. 2 (2017), p. 357-390
- Full Text:
- Reviewed:
- Description: The main purpose of this paper consists of providing characterizations of the inclusion of the solution set of a given conic system posed in a real locally convex topological space into a variety of subsets of the same space defined by means of vector-valued functions. These Farkas-type results are used to derive characterizations of the weak solutions of vector optimization problems (including multiobjective and scalar ones), vector variational inequalities, and vector equilibrium problems.
Chebyshev approximation by linear combinations of fixed knot polynomial splines with weighting functions
- Authors: Sukhorukova, Nadezda , Ugon, Julien
- Date: 2016
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 171, no. 2 (2016), p. 536-549
- Full Text: false
- Reviewed:
- Description: In this paper, we derive conditions for best uniform approximation by fixed knots polynomial splines with weighting functions. The theory of Chebyshev approximation for fixed knots polynomial functions is very elegant and complete. Necessary and sufficient optimality conditions have been developed leading to efficient algorithms for constructing optimal spline approximations. The optimality conditions are based on the notion of alternance (maximal deviation points with alternating deviation signs). In this paper, we extend these results to the case when the model function is a product of fixed knots polynomial splines (whose parameters are subject to optimization) and other functions (whose parameters are predefined). This problem is nonsmooth, and therefore, we make use of convex and nonsmooth analysis to solve it.
Directional Holder metric regularity
- Authors: Ngai, Huynh Van , Tron, Nguyen Huu , Thera, Michel
- Date: 2016
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 171, no. 3 (2016), p. 785-819
- Full Text:
- Reviewed:
- Description: This paper sheds new light on regularity of multifunctions through various characterizations of directional Holder/Lipschitz metric regularity, which are based on the concepts of slope and coderivative. By using these characterizations, we show that directional Holder/Lipschitz metric regularity is stable, when the multifunction under consideration is perturbed suitably. Applications of directional Holder/Lipschitz metric regularity to investigate the stability and the sensitivity analysis of parameterized optimization problems are also discussed.
Nonlinear metric subregularity
- Authors: Kruger, Alexander
- Date: 2016
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 171, no. 3 (2016), p. 820-855
- Relation: http://purl.org/au-research/grants/arc/DP110102011
- Full Text:
- Reviewed:
- Description: In this article, we investigate nonlinear metric subregularity properties of set-valued mappings between general metric or Banach spaces. We demonstrate that these properties can be treated in the framework of the theory of (linear) error bounds for extended real-valued functions of two variables developed in Kruger (Error bounds and metric subregularity. Optimization 64(1):49-79, 2015). Several primal and dual space local quantitative and qualitative criteria of nonlinear metric subregularity are formulated. The relationships between the criteria are established and illustrated.
A BMI approach to guaranteed cost control of discrete-time uncertain system with both state and input delays
- Authors: Zhou, Xiaojun , Dong, Tianxue , Tang, Xiaolin , Yang, Chunhua , Gui, Weihua
- Date: 2015
- Type: Text , Journal article
- Relation: Optimal Control Applications and Methods Vol. 36, no. 6 (2015), p. 844-852
- Full Text: false
- Reviewed:
- Description: In this study, the guaranteed cost control of discrete time uncertain system with both state and input delays is considered. Sufficient conditions for the existence of a memoryless state feedback guaranteed cost control law are given in the bilinear matrix inequality form, which needs much less auxiliary matrix variables and storage space. Furthermore, the design of guaranteed cost controller is reformulated as an optimization problem with a linear objective function, bilinear, and linear matrix inequalities constraints. A nonlinear semi-definite optimization solver - PENLAB is used as a solution technique. A numerical example is given to demonstrate the effectiveness of the proposed method. Copyright © 2014 John Wiley & Sons, Ltd.
Nonsmooth optimization algorithm for solving clusterwise linear regression problems
- Authors: Bagirov, Adil , Ugon, Julien , Mirzayeva, Hijran
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 164, no. 3 (2015), p. 755-780
- Relation: http://purl.org/au-research/grants/arc/DP140103213
- Full Text: false
- Reviewed:
- Description: Clusterwise linear regression consists of finding a number of linear regression functions each approximating a subset of the data. In this paper, the clusterwise linear regression problem is formulated as a nonsmooth nonconvex optimization problem and an algorithm based on an incremental approach and on the discrete gradient method of nonsmooth optimization is designed to solve it. This algorithm incrementally divides the whole dataset into groups which can be easily approximated by one linear regression function. A special procedure is introduced to generate good starting points for solving global optimization problems at each iteration of the incremental algorithm. The algorithm is compared with the multi-start Spath and the incremental algorithms on several publicly available datasets for regression analysis.
On local coincidence of a convex set and its tangent cone
- Authors: Meng, Kaiwen , Roshchina, Vera , Yang, Xiaoqi
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 164, no. 1 (2015), p. 123-137
- Full Text: false
- Reviewed:
- Description: In this paper, we introduce the exact tangent approximation property for a convex set and provide its characterizations, including the nonzero extent of a convex set. We obtain necessary and sufficient conditions for the closedness of the positive hull of a convex set via a limit set defined by truncated upper level sets of the gauge function. We also apply the exact tangent approximation property to study the existence of a global error bound for a proper, lower semicontinuous and positively homogeneous function.
Quantitative characterizations of regularity properties of collections of sets
- Authors: Kruger, Alexander , Thao, Nguyen
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 164, no. 1 (2015), p. 41-67
- Relation: http://purl.org/au-research/grants/arc/DP110102011
- Full Text:
- Reviewed:
- Description: Several primal and dual quantitative characterizations of regularity properties of collections of sets in normed linear spaces are discussed. Relationships between regularity properties of collections of sets and those of set-valued mappings are provided.
Aggregate codifferential method for nonsmooth DC optimization
- Authors: Tor, Ali , Bagirov, Adil , Karasozen, Bulent
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Computational and Applied Mathematics Vol. 259, no. Part B (2014), p. 851-867
- Full Text: false
- Reviewed:
- Description: A new algorithm is developed based on the concept of codifferential for minimizing the difference of convex nonsmooth functions. Since the computation of the whole codifferential is not always possible, we use a fixed number of elements from the codifferential to compute the search directions. The convergence of the proposed algorithm is proved. The efficiency of the algorithm is demonstrated by comparing it with the subgradient, the truncated codifferential and the proximal bundle methods using nonsmooth optimization test problems.
Metric Regularity of the Sum of Multifunctions and Applications
- Authors: Van Ngai, Huynh , Tron, Nguyen Tron , Thera, Michel
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 160, no. 2 (2014), p. 355-390
- Relation: http://purl.org/au-research/grants/arc/DP110102011
- Full Text: false
- Reviewed:
- Description: The metric regularity of multifunctions plays a crucial role in modern variational analysis and optimization. This property is a key to study the stability of solutions of generalized equations. Many practical problems lead to generalized equations associated to the sum of multifunctions. This paper is devoted to study the metric regularity of the sum of multifunctions. As the sum of closed multifunctions is not necessarily closed, almost all known results in the literature on the metric regularity for one multifunction (which is assumed usually to be closed) fail to imply regularity properties of the sum of multifunctions. To avoid this difficulty, we use an approach based on the metric regularity of so-called epigraphical multifunctions and the theory of error bounds to study the metric regularity of the sum of two multifunctions, as well as some related important properties of variational systems. Firstly, we establish the metric regularity of the sum of a regular multifunction and a pseudo-Lipschitz multifunction with a suitable Lipschitz modulus. These results subsume some recent results by Durea and Strugariu. Secondly, we derive coderivative characterizations of the metric regularity of epigraphical multifunctions associated with the sum of multifunctions. Applications to the study of the behavior of solutions of variational systems are reported. © 2013 Springer Science+Business Media New York.
Spline regression models for complex multi-modal regulatory networks
- Authors: Ozmen, Ayse , Kropat, Erik , Weber, Gerhard-Wilhelm
- Date: 2014
- Type: Text , Journal article
- Relation: Optimization Methods and Software Vol. 29, no. 3 (2014), p. 515-534
- Full Text: false
- Reviewed:
- Description: Complex regulatory networks often have to be further expanded and improved with regard to the unknown effects of additional parameters and factors that can emit a disturbing influence on the key variables under consideration. The concept of target-environment (TE) networks provides a holistic framework for the analysis of such parameter-dependent multi-modal systems. In this study, we consider time-discrete TE regulatory systems with spline entries. We introduce a new regression model for these particular two-modal systems that allows us to determine the unknown system parameters by applying the multivariate adaptive regression spline (MARS) technique and the newly developed conic multivariate adaptive regression spline (CMARS) method. We obtain a relaxation by means of continuous optimization, especially, conic quadratic programming (CQP) that could be conducted by interior point methods. Finally, a numerical example demonstrates the efficiency of the spline-based approach.