Comparative study of RPSALG algorithm for convex semi-infinite programming
- Authors: Auslender, Alfred , Ferrer, Albert , Goberna, Miguel , López, Marco
- Date: 2014
- Type: Text , Journal article
- Relation: Computational Optimization and Applications Vol. 60, no. 1 (2014), p. 59-87
- Full Text: false
- Reviewed:
- Description: The Remez penalty and smoothing algorithm (RPSALG) is a unified framework for penalty and smoothing methods for solving min-max convex semi-infinite programing problems, whose convergence was analyzed in a previous paper of three of the authors. In this paper we consider a partial implementation of RPSALG for solving ordinary convex semi-infinite programming problems. Each iteration of RPSALG involves two types of auxiliary optimization problems: the first one consists of obtaining an approximate solution of some discretized convex problem, while the second one requires to solve a non-convex optimization problem involving the parametric constraints as objective function with the parameter as variable. In this paper we tackle the latter problem with a variant of the cutting angle method called ECAM, a global optimization procedure for solving Lipschitz programming problems. We implement different variants of RPSALG which are compared with the unique publicly available SIP solver, NSIPS, on a battery of test problems.
A global optimization approach to classification
- Authors: Bagirov, Adil , Rubinov, Alex , Yearwood, John
- Date: 2002
- Type: Text , Journal article
- Relation: Optimization and Engineering Vol. 9, no. 7 (2002), p. 129-155
- Full Text: false
- Reviewed:
- Description: In this paper is presented an hybrid algorithm for finding the absolute extreme point of a multimodal scalar function of many variables. The algorithm is suitable when the objective function is expensive to compute, the computation can be affected by noise and/or partial derivatives cannot be calculated. The method used is a genetic modification of a previous algorithm based on the Prices method. All information about behavior of objective function collected on previous iterates are used to chose new evaluation points. The genetic part of the algorithm is very effective to escape from local attractors of the algorithm and assures convergence in probability to the global optimum. The proposed algorithm has been tested on a large set of multimodal test problems outperforming both the modified Prices algorithm and classical genetic approach.
- Description: C1
- Description: 2003000061
Local optimization method with global multidimensional search
- Authors: Bagirov, Adil , Rubinov, Alex , Zhang, Jiapu
- Date: 2005
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 32, no. 2 (2005), p. 161-179
- Full Text:
- Reviewed:
- Description: This paper presents a new method for solving global optimization problems. We use a local technique based on the notion of discrete gradients for finding a cone of descent directions and then we use a global cutting angle algorithm for finding global minimum within the intersection of the cone and the feasible region. We present results of numerical experiments with well-known test problems and with the so-called cluster function. These results confirm that the proposed algorithms allows one to find a global minimizer or at least a deep local minimizer of a function with a huge amount of shallow local minima. © Springer 2005.
- Description: C1
- Description: 2003001351
Implementation of novel methods of global and nonsmooth optimization : GANSO programming library
- Authors: Beliakov, Gleb , Ugon, Julien
- Date: 2007
- Type: Text , Journal article
- Relation: Optimization Vol. 56, no. 5-6 (2007), p. 543-546
- Full Text:
- Reviewed:
- Description: We discuss the implementation of a number of modern methods of global and nonsmooth continuous optimization, based on the ideas of Rubinov, in a programming library GANSO. GANSO implements the derivative-free bundle method, the extended cutting angle method, dynamical system-based optimization and their various combinations and heuristics. We outline the main ideas behind each method, and report on the interfacing with Matlab and Maple packages.
- Description: C1
- Description: 2003004865
Global solutions to nonconvex optimization of 4th-order polynomial and log-sum-exp functions
- Authors: Chen, Yi , Gao, David
- Date: 2016
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 64, no. 3 (2016), p. 417-431
- Full Text:
- Reviewed:
- Description: This paper presents a canonical dual approach for solving a nonconvex global optimization problem governed by a sum of 4th-order polynomial and a log-sum-exp function. Such a problem arises extensively in engineering and sciences. Based on the canonical duality–triality theory, this nonconvex problem is transformed to an equivalent dual problem, which can be solved easily under certain conditions. We proved that both global minimizer and the biggest local extrema of the primal problem can be obtained analytically from the canonical dual solutions. As two special cases, a quartic polynomial minimization and a minimax problem are discussed. Existence conditions are derived, which can be used to classify easy and relative hard instances. Applications are illustrated by several nonconvex and nonsmooth examples. © 2014, Springer Science+Business Media New York.
Solving the canonical dual of box-and integer-constrained nonconvex quadratic programs via a deterministic direct search algorithm
- Authors: Gao, David , Watson, Layne , Easterling, David , Thacker, William , Billups, Stephen
- Date: 2013
- Type: Text , Journal article
- Relation: Optimization Methods and Software Vol. 28, no. 2 (2013), p. 313-326
- Full Text: false
- Reviewed:
- Description: This paper presents a massively parallel global deterministic direct search method (VTDIRECT) for solving nonconvex quadratic minimization problems with either box or1 integer constraints. Using the canonical dual transformation, these well-known NP-hard problems can be reformulated as perfect dual stationary problems (with zero duality gap). Under certain conditions, these dual problems are equivalent to smooth concave maximization over a convex feasible space. Based on a perturbation method proposed by Gao, the integer programming problem is shown to be equivalent to a continuous unconstrained Lipschitzian global optimization problem. The parallel algorithm VTDIRECT is then applied to solve these dual problems to obtain global minimizers. Parallel performance results for several nonconvex quadratic integer programming problems are reported. © 2013 Copyright Taylor and Francis Group, LLC.
- Description: 2003010580
On modeling and global solutions for d.c. optimization problems by canonical duality theory
- Authors: Jin, Zhong , Gao, David
- Date: 2017
- Type: Text , Journal article
- Relation: Applied Mathematics and Computation Vol. 296, no. (2017), p. 168-181
- Full Text:
- Reviewed:
- Description: This paper presents a canonical d.c. (difference of canonical and convex functions) programming problem, which can be used to model general global optimization problems in complex systems. It shows that by using the canonical duality theory, a large class of nonconvex minimization problems can be equivalently converted to a unified concave maximization problem over a convex domain, which can be solved easily under certain conditions. Additionally, a detailed proof for triality theory is provided, which can be used to identify local extremal solutions. Applications are illustrated and open problems are presented.
- Description: This paper presents a canonical d.c. (difference of canonical and convex functions) programming problem, which can be used to model general global optimization problems in complex systems. It shows that by using the canonical duality theory, a large class of nonconvex minimization problems can be equivalently converted to a unified concave maximization problem over a convex domain, which can be solved easily under certain conditions. Additionally, a detailed proof for triality theory is provided, which can be used to identify local extremal solutions. Applications are illustrated and open problems are presented. © 2016 Elsevier Inc.
Canonical duality for solving general nonconvex constrained problems
- Authors: Latorre, Vittorio , Gao, David
- Date: 2016
- Type: Text , Journal article
- Relation: Optimization Letters Vol. 10, no. 8 (2016), p. 1763-1779
- Full Text:
- Reviewed:
- Description: This paper presents a canonical duality theory for solving a general nonconvex constrained optimization problem within a unified framework to cover Lagrange multiplier method and KKT theory. It is proved that if both target function and constraints possess certain patterns necessary for modeling real systems, a perfect dual problem (without duality gap) can be obtained in a unified form with global optimality conditions provided.While the popular augmented Lagrangian method may produce more difficult nonconvex problems due to the nonlinearity of constraints. Some fundamental concepts such as the objectivity and Lagrangian in nonlinear programming are addressed.
Global optimal trajectory in Chaos and NP-Hardness
- Authors: Latorre, Vittorio , Gao, David
- Date: 2016
- Type: Text , Journal article
- Relation: International Journal of Bifurcation and Chaos Vol. 26, no. 8 (2016), p. 1-14
- Full Text:
- Reviewed:
- Description: This paper presents an unconventional theory and method for solving general nonlinear dynamical systems. Instead of the direct iterative methods, the discretized nonlinear system is first formulated as a global optimization problem via the least squares method. A newly developed canonical duality theory shows that this nonconvex minimization problem can be solved deterministically in polynomial time if a global optimality condition is satisfied. The so-called pseudo-chaos produced by linear iterative methods are mainly due to the intrinsic numerical error accumulations. Otherwise, the global optimization problem could be NP-hard and the nonlinear system can be really chaotic. A conjecture is proposed, which reveals the connection between chaos in nonlinear dynamics and NP-hardness in computer science. The methodology and the conjecture are verified by applications to the well-known logistic equation, a forced memristive circuit and the Lorenz system. Computational results show that the canonical duality theory can be used to identify chaotic systems and to obtain realistic global optimal solutions in nonlinear dynamical systems. The method and results presented in this paper should bring some new insights into nonlinear dynamical systems and NP-hardness in computational complexity theory. © 2016 World Scientific Publishing Company.
H-infinity via a nonsmooth, nonconvex optimization approach
- Authors: Mammadov, Musa , Orsi, Robert
- Date: 2005
- Type: Text , Journal article
- Relation: Pacific Journal of Optimization Vol. 1, no. 2 (2005), p. 405-420
- Full Text: false
- Reviewed:
- Description: A numerical method for solving the H-infinity synthesis problem is presented. The problem is posed as an unconstrained, nonsmooth, nonconvex minimization problem. The optimization variables consist solely of the entries of the output feedback matrix. No additional variables, such as Lyapunov variables, need to be introduced. The main part of the optimization procedure uses a line search mechanism where the descent direction is defined by a recently introduced dynamical systems approach. Numerical results for various benchmark problems are included in the paper. In addition, the effectiveness of a preliminary part of the algorithm for successfully and quickly finding stabilizing controllers is also demonstrated.
- Description: C1
- Description: 2003001382
Complete solutions and triality theory to a nonconvex optimization problem with double-well potential in Rn
- Authors: Morales-Silva, Daniel , Gao, David
- Date: 2013
- Type: Text , Journal article
- Relation: Numerical Algebra, Control and Optimization Vol. 3, no. 2 (2013), p. 271-282
- Full Text:
- Reviewed:
- Description: The main purpose of this research note is to show that the triality theory can always be used to identify both global minimizer and the biggest local maximizer in global optimization. An open problem left on the double- min duality is solved for a nonconvex optimization problem with double-well potential in ℝn, which leads to a complete set of analytical solutions. Also a convergency theorem is proved for linear perturbation canonical dual method, which can be used for solving global optimization problems with multiple so- lutions. The methods and results presented in this note pave the way towards the proof of the triality theory in general cases.
A heuristic algorithm for solving the minimum sum-of-squares clustering problems
- Authors: Ordin, Burak , Bagirov, Adil
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 61, no. 2 (2015), p. 341-361
- Relation: http://purl.org/au-research/grants/arc/DP140103213
- Full Text: false
- Reviewed:
- Description: Clustering is an important task in data mining. It can be formulated as a global optimization problem which is challenging for existing global optimization techniques even in medium size data sets. Various heuristics were developed to solve the clustering problem. The global k-means and modified global k-means are among most efficient heuristics for solving the minimum sum-of-squares clustering problem. However, these algorithms are not always accurate in finding global or near global solutions to the clustering problem. In this paper, we introduce a new algorithm to improve the accuracy of the modified global k-means algorithm in finding global solutions. We use an auxiliary cluster problem to generate a set of initial points and apply the k-means algorithm starting from these points to find the global solution to the clustering problems. Numerical results on 16 real-world data sets clearly demonstrate the superiority of the proposed algorithm over the global and modified global k-means algorithms in finding global solutions to clustering problems.
Canonical dual least square method for solving general nonlinear systems of quadratic equations
- Authors: Ruan, Ning , Gao, David
- Date: 2010
- Type: Text , Journal article
- Relation: Computational Optimization and Applications Vol. 47, no. (2010), p. 335-347
- Full Text: false
- Reviewed:
- Description: This paper presents a canonical dual approach for solving general non- linear algebraic systems. By using least square method, the nonlinear system of m -quadratic equations in n -dimensional space is first formulated as a nonconvex opti- mization problem. We then proved that, by the canonical duality theory developed by the second author, this nonconvex problem is equivalent to a concave maximization problem in R, which can be solved easily by well-developed convex optimization techniques. Both existence and uniqueness of global optimal solutions are discussed, and several illustrative examples are presented.
- Description: C1
Global solutions to fractional programming problem with ratio of nonconvex functions
- Authors: Ruan, Ning , Gao, David
- Date: 2015
- Type: Text , Journal article
- Relation: Applied Mathematics and Computation Vol. 255, no. (2015), p. 66-72
- Full Text: false
- Reviewed:
- Description: This paper presents a canonical dual approach for minimizing a sum of quadratic function and a ratio of nonconvex functions in Rn. By introducing a parameter, the problem is first equivalently reformed as a nonconvex polynomial minimization with elliptic constraint. It is proved that under certain conditions, the canonical dual is a concave maximization problem in R2 that exhibits no duality gap. Therefore, the global optimal solution of the primal problem can be obtained by solving the canonical dual problem. © 2014 Elsevier Inc. All rights reserved.
Methods for global optimization of nonsmooth functions with applications
- Authors: Rubinov, Alex
- Date: 2006
- Type: Text , Journal article
- Relation: Applied and Computational Mathematics Vol. 5, no. 1 (2006), p. 3-15
- Full Text: false
- Reviewed:
- Description: In this survey paper we present some results obtained in the Centre for Informatics and Applied Optimization (CIAO) at University of Ballarat, Australia, in the area of numerical global optimization. We describe a conceptual scheme of two methods developed in CIAO and present results of numerical experiments with some real world problems. The paper is based on a plenary lecture given by the author at the First International Conference on Control and Optimization with Industrial Applications, Baku, Azerbaijan, 2005.
- Description: C1
- Description: 2003001547
Optimization solvers and problem formulations for solving data clustering problems
- Authors: Ugon, Julien
- Date: 2007
- Type: Text , Journal article
- Relation: Pacific Journal of Optimization Vol. 3, no. 2 (2007), p. 387-397
- Full Text: false
- Reviewed:
- Description: A popular apprach for solving complex optimization problems is through relaxation: some constraints are removed in order to have a convex problem approximating the original problem. On the other hand, direct approaches for solving such problems are becoming increasingly powerful. This paper examines two cases drawn from data analysis, in order to compare the two techniques.
- Description: C1
- Description: 2003004937
Global optimality conditions for some classes of optimization problems
- Authors: Wu, Zhiyou , Rubinov, Alex
- Date: 2009
- Type: Text , Journal article
- Relation: Journal of Optimization Theory and Applications Vol. 145, no. 1 (2009), p. 164-185
- Full Text: false
- Reviewed:
- Description: We establish new necessary and sufficient optimality conditions for global optimization problems. In particular, we establish tractable optimality conditions for the problems of minimizing a weakly convex or concave function subject to standard constraints, such as box constraints, binary constraints, and simplex constraints. We also derive some new necessary and sufficient optimality conditions for quadratic optimization. Our main theoretical tool for establishing these optimality conditions is abstract convexity. © 2009 Springer Science+Business Media, LLC.
Global descent methods for unconstrained global optimization
- Authors: Wu, Zhiyou , Li, Duan , Zhang, Lian-Sheng
- Date: 2011
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 50, no. 3 (2011), p. 379-3976
- Full Text: false
- Reviewed:
- Description: We propose in this paper novel global descent methods for unconstrained global optimization problems to attain the global optimality by carrying out a series of local minimization. More specifically, the solution framework consists of a two-phase cycle of local minimization: the first phase implements local search of the original objective function, while the second phase assures a global descent of the original objective function in the steepest descent direction of a (quasi) global descent function. The key element of global descent methods is the construction of the (quasi) global descent functions which possess prominent features in guaranteeing a global descent. © 2010 Springer Science+Business Media, LLC.
An integral function and vector sequence method for unconstrained global optimization
- Authors: Yang, Yongjian , Bai, Fusheng
- Date: 2011
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 50, no. 2 (2011), p. 293-311
- Full Text: false
- Reviewed:
- Description: An integral function and a vector sequence are constructed in this paper. Their theoretical and numerical properties are investigated. Based on the integral function and the vector sequence, an algorithm is proposed for solving a class of unconstrained global optimization problems. For the algorithm, convergence to a global minimizer is discussed under some conditions. Some typical examples are tested to illustrate the efficiency of the algorithm. © Springer Science+Business Media, LLC. 2010.
Global optimal solutions to a class of quadrinomial minimization problems with one quadratic constraint
- Authors: Yuan, Y. B. , Fang, Shucherng , Gao, David
- Date: 2012
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 52, no. 2 (2012), p. 195-209
- Full Text: false
- Reviewed:
- Description: This paper studies the canonical duality theory for solving a class of quadri- nomial minimization problems subject to one general quadratic constraint. It is shown that the nonconvex primal problem in Rn can be converted into a concave maximization dual problem over a convex set in R2 , such that the problem can be solved more efficiently. The existence and uniqueness theorems of global minimizers are provided using the triality theory. Examples are given to illustrate the results obtained. © 2011 Springer Science+Business Media, LLC.