On feature combination for music classification
- Authors: Fu, Zhouyu , Lu, Guojun , Ting, Kaiming , Zhang, Dengsheng
- Date: 2010
- Type: Text , Conference proceedings
- Full Text: false
Region based color image retrieval using curvelet transform
- Authors: Islam, Md , Zhang, Dengsheng , Lu, Guojun
- Date: 2010
- Type: Text , Conference paper
- Relation: Proceedings of the 9th Asian Conference on Computer Vision p. 448-457
- Full Text: false
- Reviewed:
- Description: Effective texture feature is an essential component in any content based image retrieval system. In the past, spectral features, like Gabor and wavelet, have shown superior retrieval performance than many other statistical and structural based features. Recent researches on multi-resolution analysis have found that curvelet captures texture properties, like curves, lines, and edges, more accurately than Gabor filters. However, the texture feature extracted using curvelet transform is not rotation invariant. This can degrade its retrieval performance significantly, especially in cases where there are many similar images with different orientations. This paper analyses the curvelet transform and derives a useful approach to extract rotation invariant curvelet features. Experimental results show that the new rotation invariant curvelet feature outperforms the curvelet feature without rotation invariance.
Automatic image annotation based on decision tree machine learning
- Authors: Jiang, Lixing , Hou, Jin , Zeng, Chen , Zhang, Dengsheng
- Date: 2009
- Type: Text , Conference paper
- Relation: Proceedings of the International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery p. 170-175
- Full Text: false
- Reviewed:
- Description: With the rapid development of digital imaging technology, image annotation is an important and challenging task in image retrieval. At present, many machine learning methods have been applied to solve the problem of automatic image annotation (AIA). However, there exists enormous semantic expressive gap between the low-level image features and high-level semantic concepts. Due to the problem, the annotation performance of existing methods is not satisfactory, and needs to be further improved. This paper proposes an automatic annotation framework via a novel decision tree-based Bayesian (DTB) machine learning algorithm. It is a hybrid approach that attempts to utilize the advantages of both DT and Naive-Bayesian (NB). We firstly segment an image into different regions and extract low-level features of each region. From these features, high-level semantic concepts are obtained using a DTB learning algorithm. Finally, experiments conducted on the Corel dataset demonstrate the effectiveness of DTB machine learning. The DTB can not only enhance the classification accuracy, but also associate low-level region features with high-level image concepts. This method presents the advantages of the Bayesian method and the DT. Moreover, this semantic interpretation capability is a natural simulation of human learning.
Rotation invariant curvelet features for texture image retrieval
- Authors: Islam, Md , Zhang, Dengsheng , Lu, Guojun
- Date: 2009
- Type: Text , Conference paper
- Relation: Proceedings of the 2009 IEEE International Conference on Multimedia and Expo p. 562-565
- Full Text: false
- Reviewed:
- Description: Effective texture feature is an essential component in any content based image retrieval system. In the past, spectral features, like Gabor and wavelet, have shown superior retrieval performance than many other statistical and structural based features. Recent researches on multi-resolution analysis have found that curvelet captures texture properties, like curves, lines, and edges, more accurately than Gabor filters. However, the texture feature extracted using curvelet transform is not rotation invariant. This can degrade its retrieval performance significantly, especially in cases where there are many similar images with different orientations. This paper analyses the curvelet transform and derives a useful approach to extract rotation invariant curvelet features. Experimental results show that the new rotation invariant curvelet feature outperforms the curvelet feature without rotation invariance.
Semantic image retrieval using region based inverted file
- Authors: Zhang, Dengsheng , Islam, Md , Lu, Guojun , Hou, Jin
- Date: 2009
- Type: Text , Journal article
- Relation: Journal of Visual Communication and Image Representation Vol. 24, no. 7 (2009), p.242-249
- Full Text: false
- Reviewed:
- Description: Image retrieval has lagged far behind text retrieval despite more than two decades of intensive research effort. Most of the research on image retrieval in the last two decades are on content based image retrieval or image retrieval based on low level features. Recent research in this area focuses on semantic image retrieval using automatic image annotation. Most semantic image retrieval techniques in literature, however, treat an image as a bag of features/words while ignore the structural or spatial information in the image. In this paper, we propose a structural image retrieval method based on automatic image annotation and region based inverted file. In the proposed system, regions in an image are treated the same way as keywords in a structural text document, semantic concepts are learnt from image data to label image regions as keywords and weight is assigned to each keyword according to spatial position and relationship. As the result, images are indexed and retrieved in the same way as structural document retrieval. Specifically, images are broken down to regions which are represented using colour, texture and shape features. Region features are then quantized to create visual dictionaries which are similar to monolingual dictionaries like English or Chinese dictionaries. In the next step, a semantic dictionary similar to a bilingual dictionary like the English–Chinese dictionary is learnt to mapping image regions to semantic concepts. Finally, images are then indexed and retrieved using a novel region based inverted file data structure. Results show the proposed method has significant advantage over the widely used Bayesian annotation models.
Spherical harmonics and distance transform for image representation and retrieval
- Authors: Sajjanhar, Atul , Lu, Guojun , Zhang, Dengsheng , Hou, Jingyu , Chen, Yi-Ping Phoebe
- Date: 2009
- Type: Text , Conference paper
- Relation: Proceedings of the Intelligent Data Engineering and Automated Learning p. 309-316
- Full Text: false
- Reviewed:
- Description: In this paper, we have proposed a method for 2D image retrieval based on object shapes. The method relies on transforming the 2D images into 3D space based on distance transform. Spherical harmonics are obtained for the 3D data and used as descriptors for the underlying 2D images. The proposed method is compared against two existing methods which use spherical harmonics for shape based retrieval of images. MPEG-7 Still Images Content Set is used for performing experiments; this dataset consists of 3621 still images. Experimental results show that the performance of the proposed descriptors is significantly better than other methods in the same category.
A geometric method to compute directionality features for texture images
- Authors: Islam, Md , Zhang, Dengsheng , Lu, Guojun
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the 2008 IEEE International Conference on Multimedia and Expo p. 1521-1524
- Full Text: false
- Reviewed:
- Description: In content based image analysis and retrieval, texture feature is an essential component due to its strong discriminative power. Directionality is one of the most significant texture features which are well perceived by the human visual system. A new method to calculate the directionality of image is proposed in this paper. In contrast to Tamura method which uses the statistical property of the directional histogram of an image to calculate its directionality, the proposed method makes use of the geometric property of the directional histogram. Both subjective and objective analyses prove that the proposed method outperforms the conventional Tamura method. It has also been shown that the proposed directionality has better retrieval performance than the conventional Tamura directionality.
Automatic categorization of image regions using dominant color based vector quantization
- Authors: Islam, Md , Zhang, Dengsheng , Lu, Guojun
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the Digital Image Computing: Techniques and Applications p. 191-198
- Full Text: false
- Reviewed:
- Description: This paper proposes a dominant color based vector quantization algorithm that automatically categorizes image regions. In contrast to the conventional vector quantization algorithm, the new algorithm effectively handles variable feature vectors like dominant color descriptors. Furthermore, the algorithm is guided by a novel splitting and stopping criterion which is specially designed for dominant color descriptors. This criterion helps the algorithm not only to learn the number of clusters, but also to avoid unnecessary over-fragmentations of region-clusters. Experimental result shows that the proposed approach categorizes image-regions with very high accuracy.
Composite feature modeling and retrieval
- Authors: Hou, Jin , Zhang, Dengsheng , Chen, Zeng , Xu, Xuerong , Nakamura, Takahiro
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the 2008 10th International Conference on Control, Automation, Robotics & Vision p. 2176-2181
- Full Text: false
- Reviewed:
- Description: Feature-based intelligent design and manufacturing systems in the Internet environment are an evolution of traditional geometric and solid modeling systems. This paper presents some novel algorithms including a new face-base representation, composite feature modeling and retrieval technology, and efficient communication mechanism, to construct an interactive framework for composite feature modeling and retrieval. The proposed system consists of a feature modeler developed on Wolfram Research Mathematica, Java and Java 3D enabled GUI (graphical user interface), and DB (database). Experiments demonstrate that this system reflects designers' intent properly and is user-friendly to experts coming from various technical backgrounds. This paper provides some fundamental principles for composite feature modeling and retrieval in web-based distributed environment.
Content based image retrieval using curvelet transform
- Authors: Sumana, Ishrat , Islam, Md , Zhang, Dengsheng , Lu, Guojun
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the 2008 IEEE 10th Workshop on Multimedia Signal Processing p. 11-16
- Full Text: false
- Reviewed:
- Description: Feature extraction is a key issue in content-based image retrieval (CBIR). In the past, a number of texture features have been proposed in literature, including statistic methods and spectral methods. However, most of them are not able to accurately capture the edge information which is the most important texture feature in an image. Recent researches on multi-scale analysis, especially the curvelet research, provide good opportunity to extract more accurate texture feature for image retrieval. Curvelet was originally proposed for image denoising and has shown promising performance. In this paper, a new image feature based on curvelet transform has been proposed. We apply discrete curvelet transform on texture images and compute the low order statistics from the transformed images. Images are then represented using the extracted texture features. Retrieval results show, it significantly outperforms the widely used Gabor texture feature.
Corners-based composite descriptor for shapes
- Authors: Sajjanhar, Atul , Lu, Guojun , Zhang, Dengsheng , Zhou, Wanlei
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the First International Congress on Image and Signal Processing CISP2008 p. 714-718
- Full Text: false
- Reviewed:
- Description: In this paper, a composite descriptor for shape retrieval is proposed. The composite descriptor is obtained based upon corner-points and shape region. In an earlier paper, we proposed a composite descriptor based on shape region and shape contour, however, the descriptor was not effective for all perspective and geometric transformations. Hence, we modify the composite descriptor by replacing contour features with corner-points features. The proposed descriptor is obtained from Generic FourierDescriptors (GFD) of the shape region and the GFD ofthe corner-points. We study the performance of the proposed composite descriptor. The proposed method is evaluated using Item S8 within the MPEG-7 Still Images Content Set. Experimental results show that the proposed descriptor is effective.
Digital image retrieval using intermediate semantic features and multistep search
- Authors: Zhang, Dengsheng , Liu, Ying , Hou, Jin
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of the Digital Image Computing: Techniques and Applications p. 513-518
- Full Text: false
- Reviewed:
- Description: Recently, semantic image retrieval has attracted large amount of interest due to the rapid growth of digital image storage. However, existing approaches have severe limitations. In this paper, a new approach to digital image retrieval using intermediate semantic features and multistep search has been proposed. Instead of looking for human level semantics which is too challenging at this stage, the research looks for heuristic information and intermediate semantic features which can describe image content objectively. Different from the conventional approaches, the intermediate features are used as filters to eliminate large amount of irrelevant images. Conventional content based image retrieval techniques and relevance feedback (RF) are applied following the filtering to improve the retrieval accuracy. The proposed system has the power of capturing both regional features and global features, and making use of both semantic features and low level features. The proposed system also uses a powerful user interface to provide users with convenient retrieval mechanisms including SQL, RF and query by example. Results show the system has a significant gain over existing region based and global image retrieval approaches
Image retrieval based on semantics of intra-region color properties
- Authors: Sajjanhar, Atul , Lu, Guojun , Zhang, Dengsheng , Zhou, Wanlei , Chen, Yi-Ping Phoebe
- Date: 2008
- Type: Text , Conference paper
- Relation: Proceedings of 2008 IEEE 8th International Conference on Computer and Information Technology p. 338-343
- Full Text: false
- Reviewed:
- Description: Traditional image retrieval systems are content based image retrieval systems which rely on low-level features for indexing and retrieval of images. CBIR systems fail to meet user expectations because of the gap between the low level features used by such systems and the high level perception of images by humans. Semantics based methods have been used to describe images according to their high level features. In this paper, we performed experiments to identify the failure of existing semantics-based methods to retrieve images in a particular semantic category. We have proposed a new semantic category to describe the intra-region color feature. The proposed semantic category complements the existing high level descriptions. Experimental results confirm the effectiveness of the proposed method
Region-based image retrieval with high-level semantics using decision tree learning
- Authors: Liu, Ying , Zhang, Dengsheng , Lu, Guojun
- Date: 2008
- Type: Text , Journal article
- Relation: Pattern Recognition Vol. 41, no. 8 (2008), p. 2554-2570
- Full Text: false
- Reviewed:
- Description: Semantic-based image retrieval has attracted great interest in recent years. This paper proposes a region-based image retrieval system with high-level semantic learning. The key features of the system are: (1) it supports both query by keyword and query by region of interest. The system segments an image into different regions and extracts low-level features of each region. From these features, high-level concepts are obtained using a proposed decision tree-based learning algorithm named DT-ST. During retrieval, a set of images whose semantic concept matches the query is returned. Experiments on a standard real-world image database confirm that the proposed system significantly improves the retrieval performance, compared with a conventional content-based image retrieval system. (2) The proposed decision tree induction method DT-ST for image semantic learning is different from other decision tree induction algorithms in that it makes use of the semantic templates to discretize continuous-valued region features and avoids the difficult image feature discretization problem. Furthermore, it introduces a hybrid tree simplification method to handle the noise and tree fragmentation problems, thereby improving the classification performance of the tree. Experimental results indicate that DT-ST outperforms two well-established decision tree induction algorithms ID3 and C4.5 in image semantic learning.