- Title
- A generic ensemble approach to estimate multidimensional likelihood in Bayesian classifier learning
- Creator
- Aryal, Sunil; Ting, Kaiming
- Date
- 2016
- Type
- Text; Journal article
- Identifier
- http://researchonline.federation.edu.au/vital/access/HandleResolver/1959.17/160050
- Identifier
- vital:12083
- Identifier
-
https://doi.org/10.1111/coin.12063
- Identifier
- ISSN:0824-7935
- Abstract
- In Bayesian classifier learning, estimating the joint probability distribution (,) or the likelihood (|) directly from training data is considered to be difficult, especially in large multidimensional data sets. To circumvent this difficulty, existing Bayesian classifiers such as Naive Bayes, BayesNet, and ADE have focused on estimating simplified surrogates of (,) from different forms of one‐dimensional likelihoods. Contrary to the perceived difficulty in multidimensional likelihood estimation, we present a simple generic ensemble approach to estimate multidimensional likelihood directly from data. The idea is to aggregate (|) estimated from a random subsample of data . This article presents two ways to estimate multidimensional likelihoods using the proposed generic approach and introduces two new Bayesian classifiers called and that estimate (|) using a nearest‐neighbor density estimation and a probability estimation through feature space partitioning, respectively. Unlike the existing Bayesian classifiers, ENNBayes and MassBayes have constant training time and space complexities and they scale better than existing Bayesian classifiers in very large data sets. Our empirical evaluation shows that ENNBayes and MassBayes yield better predictive accuracy than the existing Bayesian classifiers in benchmark data sets.
- Publisher
- Wiley
- Relation
- Computational Intelligence Vol. 32, no. 3 (2016), p. 458-479
- Rights
- Copyright © 2015 Wiley Periodicals, Inc.
- Rights
- This metadata is freely available under a CCO license
- Subject
- 0801 Artificial Intelligence and Image Processing; 0802 Computation Theory and Mathematics; 0806 Information Systems; Bayesian classifiers; Multidimensional likelihood estimation; Ennbayes; Massbayes
- Reviewed
- Hits: 1775
- Visitors: 1611
- Downloads: 1
| Thumbnail | File | Description | Size | Format |
|---|