A formula for multiple classifiers in data mining based on Brandt semigroups
- Authors: Kelarev, Andrei , Yearwood, John , Mammadov, Musa
- Date: 2009
- Type: Text , Journal article
- Relation: Semigroup Forum Vol. 78, no. 2 (2009), p. 293-309
- Full Text:
- Reviewed:
- Description: A general approach to designing multiple classifiers represents them as a combination of several binary classifiers in order to enable correction of classification errors and increase reliability. This method is explained, for example, in Witten and Frank (Data Mining: Practical Machine Learning Tools and Techniques, 2005, Sect. 7.5). The aim of this paper is to investigate representations of this sort based on Brandt semigroups. We give a formula for the maximum number of errors of binary classifiers, which can be corrected by a multiple classifier of this type. Examples show that our formula does not carry over to larger classes of semigroups. © 2008 Springer Science+Business Media, LLC.
A fuzzy derivative and dynamical systems
- Authors: Mammadov, Musa
- Date: 2002
- Type: Text , Thesis , PhD
- Full Text:
- Description: "The purpose of this thesis is to develop and study new techniques for the mathematical modeling of dynamical systems and to apply these techniques to data classification problems. This approach is based on the notion of a fuzzy derivative. The main aim of the thesis is to examine this notion in data classification."
- Description: Doctor of Philosophy
A generalization of a theorem of Arrow, Barankin and Blackwell to a nonconvex case
- Authors: Kasimbeyli, Nergiz , Kasimbeyli, Refail , Mammadov, Musa
- Date: 2016
- Type: Text , Journal article
- Relation: Optimization Vol. 65, no. 5 (May 2016), p. 937-945
- Full Text:
- Reviewed:
- Description: The paper presents a generalization of a known density theorem of Arrow, Barankin, and Blackwell for properly efficient points defined as support points of sets with respect to monotonically increasing sublinear functions. This result is shown to hold for nonconvex sets of a partially ordered reflexive Banach space.
A new auxiliary function method for general constrained global optimization
- Authors: Wu, Zhiyou , Bai, Fusheng , Yang, Yongjian , Mammadov, Musa
- Date: 2013
- Type: Text , Journal article
- Relation: Optimization Vol. 62, no. 2 (2013), p. 193-210
- Full Text:
- Reviewed:
- Description: In this article, we first propose a method to obtain an approximate feasible point for general constrained global optimization problems (with both inequality and equality constraints). Then we propose an auxiliary function method to obtain a global minimizer or an approximate global minimizer with a required precision for general global optimization problems by locally solving some unconstrained programming problems. Some numerical examples are reported to demonstrate the efficiency of the present optimization method. © 2013 Taylor & Francis.
- Description: 2003011103
A new method for solving linear ill-posed problems
- Authors: Zhang, Jianjun , Mammadov, Musa
- Date: 2012
- Type: Text , Journal article
- Relation: Applied Mathematics and Computation Vol. 218, no. 20 (2012), p.10180-10187
- Full Text:
- Reviewed:
- Description: In this paper, we propose a new method for solving large-scale ill-posed problems. This method is based on the Karush-Kuhn-Tucker conditions, Fisher-Burmeister function and the discrepancy principle. The main difference from the majority of existing methods for solving ill-posed problems is that, we do not need to choose a regularization parameter in advance. Experimental results show that the proposed method is effective and promising for many practical problems. © 2012.
A new supervised term ranking method for text categorization
- Authors: Mammadov, Musa , Yearwood, John , Zhao, Lei
- Date: 2010
- Type: Text , Conference paper
- Relation: Paper presented at 23rd Australasian Joint Conference on Artificial Intelligence, AI 2010 Vol. 6464 LNAI, p. 102-111
- Full Text:
- Reviewed:
- Description: In text categorization, different supervised term weighting methods have been applied to improve classification performance by weighting terms with respect to different categories, for example, Information Gain, χ2 statistic, and Odds Ratio. From the literature there are three term ranking methods to summarize term weights of different categories for multi-class text categorization. They are Summation, Average, and Maximum methods. In this paper we present a new term ranking method to summarize term weights, i.e. Maximum Gap. Using two different methods of information gain and χ2 statistic, we setup controlled experiments for different term ranking methods. Reuter-21578 text corpus is used as the dataset. Two popular classification algorithms SVM and Boostexter are adopted to evaluate the performance of different term ranking methods. Experimental results show that the new term ranking method performs better. © 2010 Springer-Verlag.
An inexact modified subgradient algorithm for nonconvex optimization
- Authors: Burachik, Regina , Kaya, Yalcin , Mammadov, Musa
- Date: 2008
- Type: Text , Journal article
- Relation: Computational Optimization and Applications Vol. , no. (2008), p. 1-24
- Full Text:
- Reviewed:
- Description: We propose and analyze an inexact version of the modified subgradient (MSG) algorithm, which we call the IMSG algorithm, for nonsmooth and nonconvex optimization over a compact set. We prove that under an approximate, i.e. inexact, minimization of the sharp augmented Lagrangian, the main convergence properties of the MSG algorithm are preserved for the IMSG algorithm. Inexact minimization may allow to solve problems with less computational effort. We illustrate this through test problems, including an optimal bang-bang control problem, under several different inexactness schemes. © 2008 Springer Science+Business Media, LLC.
- Description: C1
An optimization approach to the study of drug-drug interactions
- Authors: Mammadov, Musa , Banerjee, Arunava
- Date: 2005
- Type: Text , Conference paper
- Relation: Paper pesented at Sixteenth Australasian Workshop on Combinatorial Algorithms, AWOCA 2005, Ballarat, Victoria : 18th-21st September 2005 p. 201-216
- Full Text:
- Description: Drug-drug interaction is one of the important problems of Adverse Drug Reaction (ADR). In this paper we develop an optimization approach for the study of this problem. This approach is based on drug-reaction relationships represented in the form of a vector of weights, which can be defined as a solution to some global optimization problem. Although this approach can be used for solving many ADR problems, we concentrate here only on drug-drug interactions. Based on drug-reaction relationships, we formulate this problem as an optimization problem. The approach is applied to different classes of reactions from the Australian Adverse Drug Reaction Advisory Committee (ADRAC) database.
- Description: 2003001384
Application of optimisation-based data mining techniques to tobacco control dataset
- Authors: Dzalilov, Zari , Zhang, J , Bagirov, Adil , Mammadov, Musa
- Date: 2010
- Type: Text , Journal article
- Relation: International Journal of Lean Thinking Vol. 1, no. 1 (2010), p. 27-41
- Full Text: false
- Reviewed:
- Description: Tobacco smoking is one of the leading causes of death around the world. Consequently, control of tobacco use is an important global public health issue. Tobacco control may be aided by development of theoretical and methodological frameworks for describing and understanding complex tobacco control systems. Linear regression and logistic regression are currently very popular statistical techniques for modeling and analyzing complex data in tobacco control systems. However, in tobacco markets, numerous interrelated factors nontrivially interact with tobacco control policies, such that policies and control outcomes are nonlinearly related.
Attribute weighted Naive Bayes classifier using a local optimization
- Authors: Taheri, Sona , Yearwood, John , Mammadov, Musa , Seifollahi, Sattar
- Date: 2013
- Type: Text , Journal article
- Relation: Neural Computing & Applications Vol.24, no.5 (2013), p.995-1002
- Full Text:
- Reviewed:
- Description: The Naive Bayes classifier is a popular classification technique for data mining and machine learning. It has been shown to be very effective on a variety of data classification problems. However, the strong assumption that all attributes are conditionally independent given the class is often violated in real-world applications. Numerous methods have been proposed in order to improve the performance of the Naive Bayes classifier by alleviating the attribute independence assumption. However, violation of the independence assumption can increase the expected error. Another alternative is assigning the weights for attributes. In this paper, we propose a novel attribute weighted Naive Bayes classifier by considering weights to the conditional probabilities. An objective function is modeled and taken into account, which is based on the structure of the Naive Bayes classifier and the attribute weights. The optimal weights are determined by a local optimization method using the quasisecant method. In the proposed approach, the Naive Bayes classifier is taken as a starting point. We report the results of numerical experiments on several real-world data sets in binary classification, which show the efficiency of the proposed method.
Coverage in WLAN : Optimization model and algorithm
- Authors: Kouhbor, Shahnaz , Ugon, Julien , Mammadov, Musa , Rubinov, Alex , Kruger, Alexander
- Date: 2006
- Type: Text , Conference paper
- Relation: Paper presented at the First International Conference on Wireless Broadband and Ultra Wideband Communications, AusWireless 2006, Sydney : 13th March, 2006
- Full Text:
- Reviewed:
- Description: When designing wireless communication systems, it is very important to know the optimum numbers of access points (APs) in order to provide a reliable design. In this paper we describe a mathematical model developed for finding the optimal number and location of APs. A new Global Optimization Algorithm (AGOP) is used to solve the problem. Results obtained demonstrate that the model and software are able to solve optimal coverage problems for design areas with different types of obstacles and number of users.
- Description: 2003001757
Coverage in WLAN with minimum number of access points
- Authors: Kouhbor, Shahnaz , Ugon, Julien , Rubinov, Alex , Kruger, Alexander , Mammadov, Musa
- Date: 2006
- Type: Text , Conference paper
- Relation: Paper presented at VTC 2006 - Spring, 2006 IEEE 63rd Vehicular Technology Conference, Melbourne : 7th May, 2006
- Full Text:
- Reviewed:
- Description: E1
- Description: 2003001610
Effectiveness of using quantified intermarket influence for predicting trading signals of stock markets
- Authors: Tilakaratne, Chandima , Mammadov, Musa , Morris, Sidney
- Date: 2007
- Type: Text , Conference paper
- Relation: Paper presented at Data Mining and Analytics 2007: Sixth Australasian Data Mining Conference, AusDM 2007 Vol. 70, p. 171-179
- Full Text:
- Reviewed:
Facility location via continuous optimization with discontinuous objective functions
- Authors: Ugon, Julien , Kouhbor, Shahnaz , Mammadov, Musa , Rubinov, Alex , Kruger, Alexander
- Date: 2007
- Type: Text , Journal article
- Relation: ANZIAM Journal Vol. 48, no. 3 (2007), p. 315-325
- Full Text:
- Reviewed:
- Description: Facility location problems are one of the most common applications of optimization methods. Continuous formulations are usually more accurate, but often result in complex problems that cannot be solved using traditional optimization methods. This paper examines the use of a global optimization method - AGOP - for solving location problems where the objective function is discontinuous. This approach is motivated by a real-world application in wireless networks design. © Australian Mathematical Society 2007.
- Description: 2003004859
From convex to nonconvex: A loss function analysis for binary classification
- Authors: Zhao, Lei , Mammadov, Musa , Yearwood, John
- Date: 2010
- Type: Text , Conference paper
- Relation: Paper presented at10th IEEE International Conference on Data Mining Workshops, ICDMW 2010 p. 1281-1288
- Full Text:
- Reviewed:
- Description: Problems of data classification can be studied in the framework of regularization theory as ill-posed problems. In this framework, loss functions play an important role in the application of regularization theory to classification. In this paper, we review some important convex loss functions, including hinge loss, square loss, modified square loss, exponential loss, logistic regression loss, as well as some non-convex loss functions, such as sigmoid loss, ø-loss, ramp loss, normalized sigmoid loss, and the loss function of 2 layer neural network. Based on the analysis of these loss functions, we propose a new differentiable non-convex loss function, called smoothed 0-1 loss function, which is a natural approximation of the 0-1 loss function. To compare the performance of different loss functions, we propose two binary classification algorithms for binary classification, one for convex loss functions, the other for non-convex loss functions. A set of experiments are launched on several binary data sets from the UCI repository. The results show that the proposed smoothed 0-1 loss function is robust, especially for those noisy data sets with many outliers. © 2010 IEEE.
Global asymptotic stability in a class of nonlinear differential delay equations
- Authors: Ivanov, Anatoli , Mammadov, Musa
- Date: 2011
- Type: Text , Journal article
- Relation: Discrete and Continuous Dynamical Systems Vol. 2011, no. Supplement 2011 (2011), p.
- Full Text:
- Reviewed:
- Description: An essentially nonlinear dierential equation with delay serving as a mathematical model of several applied problems is considered. Sufficient conditions for the global asymptotic stability of a unique equilibrium are de- rived. An application to a physiological model by M.C. Mackey is treated in detail.
- Description: 2003009358
Global stability, periodic solutions and optimal control in a nonlinear differential delay model
- Authors: Ivanov, Anatoli , Mammadov, Musa
- Date: 2010
- Type: Text , Conference proceedings
- Relation: Eighth Mississippi State - UAB Conference on Differential Equations and Computational Simulations, 2010
- Full Text: false
- Description: A nonlinear differential equation with delay serving as a mathematical model of several applied problmes is considered. Sufficient conditions for the global asymptotic stability and for the existence of periodic solutions are given. Two particular applications are treated in detail. The first one is a blood cell production model by Mackey, for which new periodicity criteria are derived. The second application is a modified economic model with delay due to Ramsay. An optimization problem for a maximal consumption is stated and solved for the latter.
Globally convergent algorithms for solving unconstrained optimization problems
- Authors: Taheri, Sona , Mammadov, Musa , Seifollahi, Sattar
- Date: 2013
- Type: Text , Journal article
- Relation: Optimization Vol. , no. (2013), p. 1-15
- Full Text:
- Reviewed:
- Description: New algorithms for solving unconstrained optimization problems are presented based on the idea of combining two types of descent directions: the direction of anti-gradient and either the Newton or quasi-Newton directions. The use of latter directions allows one to improve the convergence rate. Global and superlinear convergence properties of these algorithms are established. Numerical experiments using some unconstrained test problems are reported. Also, the proposed algorithms are compared with some existing similar methods using results of experiments. This comparison demonstrates the efficiency of the proposed combined methods.
Improving Naive Bayes classifier using conditional probabilities
- Authors: Taheri, Sona , Mammadov, Musa , Bagirov, Adil
- Date: 2010
- Type: Text , Conference proceedings
- Full Text:
- Description: Naive Bayes classifier is the simplest among Bayesian Network classifiers. It has shown to be very efficient on a variety of data classification problems. However, the strong assumption that all features are conditionally independent given the class is often violated on many real world applications. Therefore, improvement of the Naive Bayes classifier by alleviating the feature independence assumption has attracted much attention. In this paper, we develop a new version of the Naive Bayes classifier without assuming independence of features. The proposed algorithm approximates the interactions between features by using conditional probabilities. We present results of numerical experiments on several real world data sets, where continuous features are discretized by applying two different methods. These results demonstrate that the proposed algorithm significantly improve the performance of the Naive Bayes classifier, yet at the same time maintains its robustness. © 2011, Australian Computer Society, Inc.
- Description: 2003009505
Investment decision model via an improved BP neural network
- Authors: Shen, Jihong , Zhang, Canxin , Lian, Chunbo , Hu, Hao , Mammadov, Musa
- Date: 2010
- Type: Text , Conference paper
- Relation: Paper presented at 2010 IEEE International Conference on Information and Automation, ICIA 2010, Harbin, Heilongjiang 20th-23rd June 2010 p. 2092-2096
- Full Text:
- Description: In macro investment, an investment decision model is established by using an improved back propagation (BP) artificial neural network (ANN). In this paper, the relations between elements of investment and output of products are determined, and then the optimal distribution of investment is determined by adjusting the distributions rationally. This model can reflect the highly nonlinear mapping relations among each element of investment by using nonlinear utility functions to improve the architecture of artificial neural network, which can be widely applied in investment problems. ©2010 IEEE.