Description:
In this paper, we present a new global optimization method to solve nonlinear systems of equations. We reformulate given system of nonlinear equations as a global optimization problem and then give a new auxiliary function method to solve the reformulated global optimization problem. The new auxiliary function proposed in this paper can be a filled function, a quasifilled function or a strict filled function with appropriately chosen parameters. Several numerical examples are presented to illustrate the effciency of the present approach.
Description:
In this paper we establish conditions which ensure that a feasible point is a global minimizer of a quadratic minimization problem subject to box constraints or binary constraints. In particular, we show that our conditions provide a complete characterization of global optimality for non-convex weighted least squares minimization problems. We present a new approach which makes use of a global subdifferential. It is formed by a set of functions which are not necessarily linear functions, and it enjoys explicit descriptions for quadratic functions. We also provide numerical examples to illustrate our optimality conditions.
Description:
In this paper, we consider a distributed nonsmooth optimization problem over a computational multi-agent network. We first extend the (centralized) Nesterov’s random gradient-free algorithm and Gaussian smoothing technique to the distributed case. Then, the convergence of the algorithm is proved. Furthermore, an explicit convergence rate is given in terms of the network size and topology. Our proposed method is free of gradient, which may be preferred by practical engineers. Since only the cost function value is required, our method may suffer a factor up to d (the dimension of the agent) in convergence rate over that of the distributed subgradient-based methods in theory. However, our numerical simulations show that for some nonsmooth problems, our method can even achieve better performance than that of subgradient-based methods, which may be caused by the slow convergence in the presence of subgradient.
Description:
In this paper, we consider a distributed nonsmooth optimization problem over a computational multi-agent network. We first extend the (centralized) Nesterov’s random gradient-free algorithm and Gaussian smoothing technique to the distributed case. Then, the convergence of the algorithm is proved. Furthermore, an explicit convergence rate is given in terms of the network size and topology. Our proposed method is free of gradient, which may be preferred by practical engineers. Since only the cost function value is required, our method may suffer a factor up to d (the dimension of the agent) in convergence rate over that of the distributed subgradient-based methods in theory. However, our numerical simulations show that for some nonsmooth problems, our method can even achieve better performance than that of subgradient-based methods, which may be caused by the slow convergence in the presence of subgradient.
Description:
In this paper, we propose an auxiliary function method to solve constrained systems of nonlinear equations. By introducing an auxiliary function, an unconstrained (box-constrained) optimization problem is constructed for a given constrained system of nonlinear equations. It is shown that any local minimizer of the constructed unconstrained optimization problem is an approximate solution to the given constrained system when parameters are appropriately chosen, and the precision for approximation can be preset. It is also shown that any accumulation point of the local minimizers of the constructed unconstrained optimization problems with a sequence of parameters tending to zero is a solution to the given constrained system of nonlinear equations.
Description:
Close form analytical techniques for the design of a certain class of recursive digital filters such as the elliptic filter have appeared. Such close form analytical techniques are suitable for designing filters with piece-wise constant magnitude response. The design of recursive digital filters with arbitrary frequency response is a nonlinear optimization problem. Specifically, it belongs to the class of global bi-lever programming problem. Optimal solution for a global bi-lever programming problem is notoriously difficult to obtain. In this paper, the bi-lever programming problem is first converted into a differentiate one-lever problem. Consequently we not only prove that the global minimizer of the converted one-lever problem is an approximate global minimizer of the original bi-lever problem, but also a novel filled function method for the design of recursive digital filters meeting arbitrary frequency response specifications is proposed. Several design examples are presented to illustrate our new technique
Description:
In this paper, a feedback neural network model is proposed for solving a class of convex quadratic bi-level programming problems based on the idea of successive approximation. Differing from existing neural network models, the proposed neural network has the least number of state variables and simple structure. Based on Lyapunov theories, we prove that the equilibrium point sequence of the feedback neural network can approximately converge to an optimal solution of the convex quadratic bi-level problem under certain conditions, and the corresponding sequence of the function value approximately converges to the optimal value of the convex quadratic bi-level problem. Simulation experiments on three numerical examples and a portfolio selection problem are provided to show the effi- ciency and performance of the proposed neural network approach.
Description:
In this paper, we consider a class of mixed integer weakly concave programming problems (MIWCPP) consisting of minimizing a difference of a quadratic function and a convex function. A new necessary global optimality conditions for MIWCPP is presented in this paper. A new local optimization method for MIWCPP is designed based on the necessary global optimality conditions, which is different from the traditional local optimization method. A global optimization method is proposed by combining some auxiliary functions and the new local optimization method. Furthermore, numerical examples are also presented to show that the proposed global optimization method for MIWCPP is efficient.
Description:
In this article, we first introduce a definition of a local minimizer for the quadratic programs with {-1, 1} constraints and show that the existing necessary condition of global optimality in some recent literature is in fact the necessary and sufficient condition of local optimality under the present definition. A filled function and the corresponding filled function algorithm then are proposed to get the global minimizer of the concerned minimization problem. The existing sufficient condition of global optimality is employed to form one of the termination rules of the algorithm. Several numerical examples are reported to show the efficiency of the present method for solving quadratic programs with binary constraints.
Description:
In this article, we present some global optimality conditions for mixed quadratic programming problems. Our approach is based on a L-subdifferential and an associated L-normal cone. Unlike most subdifferentials, the L-subdifferential is formed by functions that are not necessarily linear functions. We derive some sufficient and necessary global optimality conditions for mixed quadratic programs with box constraints and binary constraints.
Description:
A smooth convex penalty function method for solving a semi-infinite convex programming problem is proposed in this paper. The semi-finite convex programming problem can be successively solved by a sequence of smooth unconstrained convex programming problems, whose optimal solutions are convergent to the optimal set of the original problem. Some other convegence results are also established in this paper, and several numerical examples are included to illustrate our approach.
Description:
The conjugate duality, which states that infx∈X φ(x, 0) = maxv∈Y ' −φ∗(0,v), whenever a regularity condition on φ is satisfied, is a key result in convex anal¬ysis and optimization, where φ : X × Y → IR ∪{+∞} is a convex function, X and Y are Banach spaces, Y ' is the continuous dual space of Y and φ∗ is the Fenchel-Moreau conjugate of φ. In this paper, we establish a necessary and sufficient condition for the stable conjugate duality, ∗ ∗ ∈ X' inf {φ(x, 0) + x ∗(x)} = max {−φ ∗(−x ,v)}, ∀x, x∈Xv∈Y ' and obtain a new global dual regularity condition, which is much more general than the popularly known interior-point type conditions, for the conjugate duality. As a consequence we present an epigraph closure condition which is necessary and sufficient for a stable Fenchel-Rockafellar duality theorem. In the case where one of the functions involved in the duality is a polyhedral convex function, we also provide generalized interior-point conditions for the epigraph closure condition. Moreover, we show that a stable Fenchel’s duality for sublinear functions holds whenever a subdifferential sum formula for the functions holds. As applications, we give general sufficient conditions for a minimax theorem, a subdifferential composition formula and for duality results of convex programming problems.
Description:
The conjugate duality, which states that infx∈X φ(x, 0) = maxv∈Y ' −φ∗(0,v), whenever a regularity condition on φ is satisfied, is a key result in convex anal¬ysis and optimization, where φ : X × Y → IR ∪{+∞} is a convex function, X and Y are Banach spaces, Y ' is the continuous dual space of Y and φ∗ is the Fenchel-Moreau conjugate of φ. In this paper, we establish a necessary and sufficient condition for the stable conjugate duality, ∗ ∗ ∈ X' inf {φ(x, 0) + x ∗(x)} = max {−φ ∗(−x ,v)}, ∀x, x∈Xv∈Y ' and obtain a new global dual regularity condition, which is much more general than the popularly known interior-point type conditions, for the conjugate duality. As a consequence we present an epigraph closure condition which is necessary and sufficient for a stable Fenchel-Rockafellar duality theorem. In the case where one of the functions involved in the duality is a polyhedral convex function, we also provide generalized interior-point conditions for the epigraph closure condition. Moreover, we show that a stable Fenchel’s duality for sublinear functions holds whenever a subdifferential sum formula for the functions holds. As applications, we give general sufficient conditions for a minimax theorem, a subdifferential composition formula and for duality results of convex programming problems.