Description:
This paper is a kind of biased survey of the most representative and recent results on stability for the linear optimization problem. Qualitative and quantitative approaches are considered in this survey, and some infinite-dimensional extensions of the main results to more general problems are also included. In particular the paper deals with the lower/upper semicontinuity of the feasible/optimal set mappings, different types of ill-posedness, distance to ill-posedness, Lipschitz properties of these mappings under different types of perturbations, and estimates of the associated Lipschitz bounds.
Description:
We give a formula for the subdifferential of the sum of two convex functions where one of them is the supremum of an arbitrary family of convex functions. This is carried out under a weak assumption expressing a natural relationship between the lower semicontinuous envelopes of the data functions in the domain of the sum function. We also provide a new rule for the subdifferential of the sum of two convex functions, which uses a strategy of augmenting the involved functions. The main feature of our analysis is that no continuity-type condition is required. Our approach allows us to unify, recover, and extend different results in the recent literature.
Description:
We give a formula for the subdifferential of the sum of two convex functions where one of them is the supremum of an arbitrary family of convex functions. This is carried out under a weak assumption expressing a natural relationship between the lower semicontinuous envelopes of the data functions in the domain of the sum function. We also provide a new rule for the subdifferential of the sum of two convex functions, which uses a strategy of augmenting the involved functions. The main feature of our analysis is that no continuity-type condition is required. Our approach allows us to unify, recover, and extend different results in the recent literature.
Description:
In this paper, we study the problem of best Chebyshev approximation by linear splines. We construct linear splines as a max - min of linear functions. Then we apply nonsmooth optimisation techniques to analyse and solve the corresponding optimisation problems. This approach allows us to identify and introduce a new important property of linear spline knots (regular and irregular). Using this property, we derive a necessary optimality condition for the case of regular knots. This condition is stronger than those existing in the literature. We also present a numerical example which demonstrates the difference between the old and the new optimality conditions.
Description:
The original motivation for this paper was to provide an efficient quantitative analysis of convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional (resp. finite-dimensional) Banach spaces and that are indexed by an arbitrary fixed set J. Parameter perturbations on the right-hand side of the inequalities are required to be merely bounded, and thus the natural parameter space is l∞(J). Our basic strategy consists of linearizing the parameterized convex system via splitting convex inequalities into linear ones by using the Fenchel-Legendre conjugate. This approach yields that arbitrary bounded right-hand side perturbations of the convex system turn on constant-by-blocks perturbations in the linearized system. Based on advanced variational analysis, we derive a precise formula for computing the exact Lipschitzian bound of the feasible solution map of block-perturbed linear systems, which involves only the system's data, and then show that this exact bound agrees with the coderivative norm of the aforementioned mapping. In this way we extend to the convex setting the results of Cánovas et al. (SIAM J. Optim. 20, 1504-1526, 2009) developed for arbitrary perturbations with no block structure in the linear framework under the boundedness assumption on the system's coefficients. The latter boundedness assumption is removed in this paper when the decision space is reflexive. The last section provides the aimed application to the convex case.
Description:
The original motivation for this paper was to provide an efficient quantitative analysis of convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional (resp. finite-dimensional) Banach spaces and that are indexed by an arbitrary fixed set J. Parameter perturbations on the right-hand side of the inequalities are required to be merely bounded, and thus the natural parameter space is l∞(J). Our basic strategy consists of linearizing the parameterized convex system via splitting convex inequalities into linear ones by using the Fenchel-Legendre conjugate. This approach yields that arbitrary bounded right-hand side perturbations of the convex system turn on constant-by-blocks perturbations in the linearized system. Based on advanced variational analysis, we derive a precise formula for computing the exact Lipschitzian bound of the feasible solution map of block-perturbed linear systems, which involves only the system's data, and then show that this exact bound agrees with the coderivative norm of the aforementioned mapping. In this way we extend to the convex setting the results of Cánovas et al. (SIAM J. Optim. 20, 1504-1526, 2009) developed for arbitrary perturbations with no block structure in the linear framework under the boundedness assumption on the system's coefficients. The latter boundedness assumption is removed in this paper when the decision space is reflexive. The last section provides the aimed application to the convex case.
Description:
In this paper, we propose a new algorithm for global minimization of functions represented as a difference of two convex functions. The proposed method is a derivative free method and it is designed by adapting the extended cutting angle method. We present preliminary results of numerical experiments using test problems with difference of convex objective functions and box-constraints. We also compare the proposed algorithm with a classical one that uses prismatical subdivisions.
Description:
Clusterwise linear regression consists of finding a number of linear regression functions each approximating a subset of the data. In this paper, the clusterwise linear regression problem is formulated as a nonsmooth nonconvex optimization problem and an algorithm based on an incremental approach and on the discrete gradient method of nonsmooth optimization is designed to solve it. This algorithm incrementally divides the whole dataset into groups which can be easily approximated by one linear regression function. A special procedure is introduced to generate good starting points for solving global optimization problems at each iteration of the incremental algorithm. The algorithm is compared with the multi-start Spath and the incremental algorithms on several publicly available datasets for regression analysis.
Description:
This paper presents some applications of the canonical dual theory in optimal control problems. The analytic solutions of several nonlinear and nonconvex problems are investigated by global optimizations. It turns out that the backward differential flow defined by the KKT equation may reach the globally optimal solution. The analytic solution to an optimal control problem is obtained via the expression of the co-state. Some examples are illustrated.
Description:
This research was supported by the Australian Research Council (ARC), Solving hard Chebyshev approximation problems through nonsmooth analysis (Discovery Project DP180100602 ). This research was partially sponsored by Tel Aviv-Swinburne Research Collaboration Grant (2019).
Description:
A special type of multi-variate polynomial of degree 4, called the double well potential function, is studied. It is derived from a discrete approx imation of the generalized Ginzburg-Landau functional, and we are interested in understanding its global minimum solution and all local non-global points. The main difficulty for the model is due to its non-convexity. In Part I of the paper, we first characterize the global minimum solution set, whereas the study for local non-global optimal solutions is left for Part II. We show that, the dual of the Lagrange dual of the double well potential problem is a linearly constrained convex minimization problem, which, under a designated nonlin ear transformation, can be equivalently mapped to a portion of the original double well potential function containing the global minimum. In other words, solving the global minimum of the double well potential function is essentially a convex minimization problem, despite of its non-convex nature. Numerical examples are provided to illustrate the important features of the problem and the mapping in between.
Description:
We introduce and analyse outer approximation schemes for solving variational inequality problems in which the constraint set is as in generalized semi-infinite programming. We call these problems generalized semi-infinite variational inequality problems. First, we establish convergence results of our method under standard boundedness assumptions. Second, we use suitable Tikhonov-like regularizations for establishing convergence in the unbounded case.
Description:
The paper presents a generalization of a known density theorem of Arrow, Barankin, and Blackwell for properly efficient points defined as support points of sets with respect to monotonically increasing sublinear functions. This result is shown to hold for nonconvex sets of a partially ordered reflexive Banach space.
Description:
The paper presents a generalization of a known density theorem of Arrow, Barankin, and Blackwell for properly efficient points defined as support points of sets with respect to monotonically increasing sublinear functions. This result is shown to hold for nonconvex sets of a partially ordered reflexive Banach space.