A heuristic algorithm for solving the minimum sum-of-squares clustering problems
- Authors: Ordin, Burak , Bagirov, Adil
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 61, no. 2 (2015), p. 341-361
- Relation: http://purl.org/au-research/grants/arc/DP140103213
- Full Text: false
- Reviewed:
- Description: Clustering is an important task in data mining. It can be formulated as a global optimization problem which is challenging for existing global optimization techniques even in medium size data sets. Various heuristics were developed to solve the clustering problem. The global k-means and modified global k-means are among most efficient heuristics for solving the minimum sum-of-squares clustering problem. However, these algorithms are not always accurate in finding global or near global solutions to the clustering problem. In this paper, we introduce a new algorithm to improve the accuracy of the modified global k-means algorithm in finding global solutions. We use an auxiliary cluster problem to generate a set of initial points and apply the k-means algorithm starting from these points to find the global solution to the clustering problems. Numerical results on 16 real-world data sets clearly demonstrate the superiority of the proposed algorithm over the global and modified global k-means algorithms in finding global solutions to clustering problems.
Comparative study of RPSALG algorithm for convex semi-infinite programming
- Authors: Auslender, Alfred , Ferrer, Albert , Goberna, Miguel , López, Marco
- Date: 2014
- Type: Text , Journal article
- Relation: Computational Optimization and Applications Vol. 60, no. 1 (2014), p. 59-87
- Full Text: false
- Reviewed:
- Description: The Remez penalty and smoothing algorithm (RPSALG) is a unified framework for penalty and smoothing methods for solving min-max convex semi-infinite programing problems, whose convergence was analyzed in a previous paper of three of the authors. In this paper we consider a partial implementation of RPSALG for solving ordinary convex semi-infinite programming problems. Each iteration of RPSALG involves two types of auxiliary optimization problems: the first one consists of obtaining an approximate solution of some discretized convex problem, while the second one requires to solve a non-convex optimization problem involving the parametric constraints as objective function with the parameter as variable. In this paper we tackle the latter problem with a variant of the cutting angle method called ECAM, a global optimization procedure for solving Lipschitz programming problems. We implement different variants of RPSALG which are compared with the unique publicly available SIP solver, NSIPS, on a battery of test problems.
Solving the canonical dual of box-and integer-constrained nonconvex quadratic programs via a deterministic direct search algorithm
- Authors: Gao, David , Watson, Layne , Easterling, David , Thacker, William , Billups, Stephen
- Date: 2013
- Type: Text , Journal article
- Relation: Optimization Methods and Software Vol. 28, no. 2 (2013), p. 313-326
- Full Text: false
- Reviewed:
- Description: This paper presents a massively parallel global deterministic direct search method (VTDIRECT) for solving nonconvex quadratic minimization problems with either box or1 integer constraints. Using the canonical dual transformation, these well-known NP-hard problems can be reformulated as perfect dual stationary problems (with zero duality gap). Under certain conditions, these dual problems are equivalent to smooth concave maximization over a convex feasible space. Based on a perturbation method proposed by Gao, the integer programming problem is shown to be equivalent to a continuous unconstrained Lipschitzian global optimization problem. The parallel algorithm VTDIRECT is then applied to solve these dual problems to obtain global minimizers. Parallel performance results for several nonconvex quadratic integer programming problems are reported. © 2013 Copyright Taylor and Francis Group, LLC.
- Description: 2003010580
Vector optimization problems with nonconvex preferences
- Authors: Huang, N. J. , Rubinov, Alex , Yang, Xiao
- Date: 2008
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 40, no. 4 (2008), p. 765-777
- Full Text: false
- Reviewed:
- Description: In this paper, some vector optimization problems are considered where pseudo-ordering relations are determined by nonconvex cones in Banach spaces. We give some characterizations of solution sets for vector complementarity problems and vector variational inequalities. When the nonconvex cone is the union of some convex cones, it is shown that the solution set of these problems is either an intersection or an union of the solution sets of all subproblems corresponding to each of these convex cones depending on whether these problems are defined by the nonconvex cone itself or its complement. Moreover, some relations of vector complementarity problems, vector variational inequalities, and minimal element problems are also given. © 2007 Springer Science+Business Media, Inc.
- Description: C1
Local optimization method with global multidimensional search
- Authors: Bagirov, Adil , Rubinov, Alex , Zhang, Jiapu
- Date: 2005
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 32, no. 2 (2005), p. 161-179
- Full Text:
- Reviewed:
- Description: This paper presents a new method for solving global optimization problems. We use a local technique based on the notion of discrete gradients for finding a cone of descent directions and then we use a global cutting angle algorithm for finding global minimum within the intersection of the cone and the feasible region. We present results of numerical experiments with well-known test problems and with the so-called cluster function. These results confirm that the proposed algorithms allows one to find a global minimizer or at least a deep local minimizer of a function with a huge amount of shallow local minima. © Springer 2005.
- Description: C1
- Description: 2003001351
On augmented lagrangians for optimization problems with a single constraint
- Authors: Gasimov, Rafail , Rubinov, Alex
- Date: 2004
- Type: Text , Journal article
- Relation: Journal of Global Optimization Vol. 28, no. 2 (2004), p. 153-173
- Full Text: false
- Reviewed:
- Description: We examine augmented Lagrangians for optimization problems with a single (either inequality or equality) constraint. We establish some links between augmented Lagrangians and Lagrange-type functions and propose a new kind of Lagrange-type functions for a problem with a single inequality constraint. Finally, we discuss a supergradient algorithm for calculating optimal values of dual problems corresponding to some class of augmented Lagrangians.
- Description: C1
- Description: 2003000929
General lagrange-type functions in constrained global optimization part II : Exact auxiliary functions
- Authors: Evtushenko, Yu G. , Rubinov, Alex , Zhadan, V. G.
- Date: 2001
- Type: Text , Journal article
- Relation: Optimization Methods and Software Vol. 16, no. 1-4 (2001), p. 231-256
- Full Text: false
- Reviewed:
- Description: This paper is a continuation of [13]. For each constrained optimization problem we consider certain unconstrained problems, which are constructed by means of auxiliary (Lagrange-type) functions. We study only exact auxiliary functions, it means that the set of their global minimizers coincides with the solution set of the primal constrained optimization problem. Sufficient conditions for the exactness of an auxiliary function are given. These conditions are obtained without assumption that the Lagrange function has a saddle point. Some examples of exact auxiliary functions are given. © 2001 OPA (Overseas Publishers Association) N.V. Published by license under the Gordon and Breach Science Publishers imprint, a member of the Taylor & Francis Group.