- Title
- Data-dependent dissimilarity measure : An effective alternative to geometric distance measures
- Creator
- Aryal, Sunil; Ting, Kaiming; Washio, Takashi; Haffari, Gholamreza
- Date
- 2017
- Type
- Text; Journal article
- Identifier
- http://researchonline.federation.edu.au/vital/access/HandleResolver/1959.17/163394
- Identifier
- vital:12791
- Identifier
-
https://doi.org/10.1007/s10115-017-1046-0
- Identifier
- ISBN:0219-1377
- Abstract
- Nearest neighbor search is a core process in many data mining algorithms. Finding reliable closest matches of a test instance is still a challenging task as the effectiveness of many general-purpose distance measures such as ℓp -norm decreases as the number of dimensions increases. Their performances vary significantly in different data distributions. This is mainly because they compute the distance between two instances solely based on their geometric positions in the feature space, and data distribution has no influence on the distance measure. This paper presents a simple data-dependent general-purpose dissimilarity measure called ‘ mp -dissimilarity’. Rather than relying on geometric distance, it measures the dissimilarity between two instances as a probability mass in a region that encloses the two instances in every dimension. It deems two instances in a sparse region to be more similar than two instances of equal inter-point geometric distance in a dense region. Our empirical results in k-NN classification and content-based multimedia information retrieval tasks show that the proposed mp -dissimilarity measure produces better task-specific performance than existing widely used general-purpose distance measures such as ℓp -norm and cosine distance across a wide range of moderate- to high-dimensional data sets with continuous only, discrete only, and mixed attributes.
- Relation
- Knowledge and Information Systems Vol. 53, no. 2 (2017), p. 479-506
- Rights
- © 2017 Springer International Publishing AG.
- Rights
- This metadata is freely available under a CCO license
- Subject
- 0801 Artificial Intelligence and Image Processing; Distance measure ℓp-norm; Cosine distance mp-dissimilarity
- Reviewed
- Hits: 1484
- Visitors: 1391
- Downloads: 0
| Thumbnail | File | Description | Size | Format |
|---|