- Title
- Structure learning of Bayesian Networks using global optimization with applications in data classification
- Creator
- Taheri, Sona; Mammadov, Musa
- Date
- 2014
- Type
- Text; Journal article
- Identifier
- http://researchonline.federation.edu.au/vital/access/HandleResolver/1959.17/89644
- Identifier
- vital:9301
- Identifier
-
https://doi.org/10.1007/s11590-014-0803-1
- Identifier
- ISSN:1862-4472
- Abstract
- Bayesian Networks are increasingly popular methods of modeling uncertainty in artificial intelligence and machine learning. A Bayesian Network consists of a directed acyclic graph in which each node represents a variable and each arc represents probabilistic dependency between two variables. Constructing a Bayesian Network from data is a learning process that consists of two steps: learning structure and learning parameter. Learning a network structure from data is the most difficult task in this process. This paper presents a new algorithm for constructing an optimal structure for Bayesian Networks based on optimization. The algorithm has two major parts. First, we define an optimization model to find the better network graphs. Then, we apply an optimization approach for removing possible cycles from the directed graphs obtained in the first part which is the first of its kind in the literature. The main advantage of the proposed method is that the maximal number of parents for variables is not fixed a priory and it is defined during the optimization procedure. It also considers all networks including cyclic ones and then choose a best structure by applying a global optimization method. To show the efficiency of the algorithm, several closely related algorithms including unrestricted dependency Bayesian Network algorithm, as well as, benchmarks algorithms SVM and C4.5 are employed for comparison. We apply these algorithms on data classification; data sets are taken from the UCI machine learning repository and the LIBSVM. © 2014, Springer-Verlag Berlin Heidelberg.
- Publisher
- Springer Verlag
- Relation
- Optimization Letters Vol. 9, no. 5 (2014), p. 931-948
- Rights
- Copyright © 2014, Springer-Verlag Berlin Heidelberg
- Rights
- Open Access
- Rights
- This metadata is freely available under a CCO license
- Subject
- 0102 Applied Mathematics; 0103 Numerical and Computational Mathematics; Bayesian Networks; Data classification; Algorithms; Artificial intelligence; Classification (of information); Directed graphs; Knowledge based systems; Learning systems; Shape optimization; Structural optimization; Uncertainty analysis; Directed acyclic graph (DAG); Global optimization method; Model uncertainties; Optimization approach; Optimization modeling; Optimization procedures; UCI machine learning repository
- Full Text
- Reviewed
- Hits: 7614
- Visitors: 7908
- Downloads: 469
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | SOURCE1 | Accepted version | 214 KB | Adobe Acrobat PDF | View Details Download |