Relevance and Diversity of Images by Using Tags
DOI:
https://doi.org/10.51983/ajsat-2017.6.2.985Keywords:
Diversity, feature extraction, relevance, reranking, tag based imagesAbstract
Now a day, there is a growth of digital images and video archives. Some of these are very important from user point of view. The collection of these digital images may be for personal use and may be for public use. For searching images in the database, there is the need of secure, fast and efficient techniques. Tag-based image search is an effective technique to find images in the databases and in the social websites. In this paper a reranking system for image retrieval with the consideration of images relevance and diversity is proposed. Reranking of the images have done according to their visual features and semantic features. Visual features are used for detecting duplicate images in proposed method. Each user maintains several images. First sort these images by same group user ranking system. Users that have higher contribution to the given query rank higher. Then an implementation to all-user reranking on the ranked users image set and only the most relevant image from users image set is selected. These selected images compose the final retrieval results. We build an inverted structure for the image dataset to speed up the searching process.
References
X. Tian, L. Yang, Y. Lu, Q. Tian, and D. Tao, "Image Search Reranking With Hierarchical Topic Awareness," IEEE Transactions On Cybernetics, vol. 45, no. 10, pp. 2177-2189, Oct. 2015.
T.-T. Do and N.-M. Cheung, "Embedding based on function approximation for large scale image search," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 99, pp. 1-12, 2017.
X. Yang, T. Mei, Y. Zhang, J. Liu, and S. Satoh, "Web Image Search Re-Ranking With Click-Based Similarity and Typicality," IEEE Transactions on Image Processing, vol. 25, no. 10, pp. 4617-4630, 2016.
Z. Ji, Y. Pang, and X. Li, "Relevance Preserving Projection and Ranking for Web Image Search Reranking," pp. 4137-4147.
L. Xie, J. Wang, B. Zhang, and Q. Tian, "Fine-Grained Image Search," IEEE Transactions On Multimedia, vol. 17, no. 5, pp. 636-647, May 2015.
M. Kan, D. Xu, S. Shan, and X. Chen, "Semisupervised Hashing via Kernel Hyperplane Learning for Scalable Image Search," IEEE Transactions On Circuits And Systems For Video Technology, vol. 24, no. 4, pp. 704-713, Apr. 2014.
W. Zhou et al., "Towards Codebook-Free: Scalable Cascaded Hashing for Mobile Image Search," IEEE Transactions On Multimedia, vol. 16, no. 3, pp. 601-611, Apr. 2014.
Z. Liu et al., "Contextual Hashing for Large-Scale Image Search," IEEE Transactions On Image Processing, vol. 23, no. 4, pp. 1606-1614, Apr. 2014.
Z. Lu et al., "Inferring User Image-Search Goals Under the Implicit Guidance of Users," IEEE Transactions On Circuits And Systems For Video Technology, vol. 24, no. 3, pp. 394-406, Mar. 2014.
Y. Chen et al., "iLike: Bridging the Semantic Gap in Vertical Image Search by Integrating Text and Visual Features," IEEE Transactions On Knowledge And Data Engineering, vol. 25, no. 10, pp. 2257-2270, Oct. 2013.
E. Tiakas et al., "MSIDX: Multi-Sort Indexing for Efficient Content-Based Image Search and Retrieval," IEEE Transactions On Multimedia, vol. 15, no. 6, pp. 1415-1430, Oct. 2013.
Y. Jing et al., "Learning Query-Specific Distance Functions for Large-Scale Web Image Search," IEEE Transactions On Multimedia, vol. 15, no. 8, pp. 2022-2034, Dec. 2013.
Y. Zhang, X. Yang, and T. Mei, "Image Search Reranking With Query-Dependent Click-Based Relevance Feedback," IEEE Transactions On Image Processing, vol. 23, no. 10, pp. 4448-4459, Oct. 2014.
S. Wei et al., "Joint Optimization Toward Effective and Efficient Image Search," IEEE Transactions On Cybernetics, vol. 43, no. 6, pp. 2216-2227, Dec. 2013.
Flickr. http://www.Flickr.com/.
D. Liu et al., "Tag ranking," Proceedings of the IEEE International Conference on World Wide Web, 2009, pp. 351-360.
X. Li et al., "Learning tag relevance by neighbor voting for social image retrieval," Proceedings of the ACM International Conference on Multimedia information retrieval, 2008, pp. 180-187.
D. Liu et al., "Boost Search Relevance For Tag-Based Social Image Retrieval," Proceedings of the IEEE International Conference on Multimedia and Expo, 2009, pp. 1636-1639.
K. Yang et al., "Social Image Search with Diverse Relevance Ranking," Proceedings of the IEEE International Conference on Magnetism and Magnetic Materials, 2010, pp. 174-184.
M. Wang et al., "Towards relevant and diverse search of social images," IEEE Transactions on Multimedia, vol. 12, no. 8, pp. 829-842, 2010.
A. Ksibi et al., "Adaptive diversification for tag-based social image retrieval," International Journal of Multimedia Information Retrieval, vol. 3, no. 1, pp. 29-39, 2014.
Y. Gao et al., "Tag-based social image search with visual-text joint hypergraph learning," Proceedings of the ACM International Conference on Multimedia information retrieval, 2011, pp. 1517-1520.
D. Cai et al., "Hierarchical clustering of WWW image search results using visual, textual and link information," In Proc. ACM Multimedia Conf., 2004.
K. Song et al., "Diversifying the image retrieval results," In Proc. ACM Multimedia Conf., 2006, pp. 707–710.
R. Leuken et al., "Visual diversification of image search results," In Proc. WWW Conf., 2009, pp. 341–350.
R. Cilibrasi and P. Vitanyi, "The Google Similarity Distance," IEEE Transactions on Knowledge and Data Engineering, vol. 19, no. 3, pp. 1065-1076, 2007.
X. Qian, H. Wang, G. Liu, and X. Hou, "HWVP: Hierarchical Wavelet Packet Texture Descriptors and Their Applications in Scene Categorization and Semantic Concept Retrieval," Multimedia Tools and Applications, May 2012.
X. Qian, G. Liu, and D. Guo, "Object categorization using hierarchical wavelet packet texture descriptors," in Proc. ISM 2009, pp. 44-51.
X. Qian, Y. Zhao, and J. Han, "Image Location Estimation by Salient Region Matching," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 4348-4358, 2015.
D. Wu, J. Wu, and M. Lu, "A Two-Step Similarity Ranking Scheme for Image Retrieval," in Parallel Architectures, Algorithms and Programming, pp. 191-196, IEEE, 2014.
D. Zhou, O. Bousquet, T. Lal, and J. Weston, "Learning with local and global consistency," Advances in Neural Information Processing Systems, vol. 16, no. 16, pp. 321-328, 2004.
G. Agrawal and R. Chaudhary, "Relevancy tag ranking," in Computer and Communication Technology, pp. 169-173, IEEE, 2011.
L. Chen, S. Zhu, and Z. Li, "Image retrieval via improved relevance ranking," in Control Conference, pp. 4620-4625, IEEE, 2014.
L. Wu and R. Jin, "Tag completion for image retrieval," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 716-727, 2013.
Y. Yang, Y. Gao, H. Zhang, and J. Shao, "Image Tagging with Social Assistance," in Proceedings of International Conference on Multimedia Retrieval, pp. 81, ACM, 2014.
L. Chen, D. Xu, and I. Tsang, "Tag-based image retrieval improved by augmented features and group-based refinement," IEEE Transactions on Multimedia, vol. 14, no. 4, pp. 1057-1067, 2012.
S. Lee and W. D. Neve, "Visually weighted neighbor voting for image tag relevance learning," Multimedia Tools and Applications, pp. 1-24, 2013.
Z. Xu, X. Luo, Y. Liu, and L. Mei, "Measuring Semantic Relatedness between Flickr Images: From a Social Tag Based View," The Scientific World Journal, 2014.
X. Li, "Tag relevance fusion for social image retrieval," Multimedia Systems, pp. 1-12, 2014.
X. Qian, X. Liu, and C. Zheng, "Tagging photos using users' vocabularies," Neurocomputing, vol. 111, pp. 144-153, 2013.
D. Mishra, "Tag Relevance for Social Image Retrieval in Accordance with Neighbor Voting Algorithm," IJCSNS, vol. 14, no. 7, pp. 50, 2014.
Y. Hu and M. Li, "Multiple-instance ranking: Learning to rank images for image retrieval," in Computer Vision and Pattern Recognition, CVPR 2008. IEEE Conference on, pp. 1-8.
F. Sun, M. Wang, and D. Wang, "Optimizing social image search with multiple criteria: Relevance, diversity, and typicality," Neurocomputing, vol. 95, pp. 40-47, 2012.
B. Wang, Z. Li, and M. Li, "Large-scale duplicate detection for web image search," in Multimedia and Expo, 2006 IEEE International Conference on, pp. 353-356.
K. Weinberger and M. Slaney, "Resolving tag ambiguity," in Proceedings of the 16th ACM international conference on Multimedia, pp. 111-120, ACM, 2008.
A. Ksibi, G. Feki, and A. Ammar, "Effective Diversification for Ambiguous Queries in Social Image Retrieval," in Computer Analysis of Images and Patterns, pp. 571-578, 2013.
A. Khosla and A. Sarma, "What makes an image popular?," in Proceedings of the 23rd international conference on World wide web, pp. 867-876, 2014.
C. Haruechaiyasak, "Improving social tag-based image retrieval with CBIR technique," pp. 212-215, Springer Berlin Heidelberg, 2010.
X. Zhu and W. Nejdl, "An adaptive teleportation random walk model for learning social tag relevance," in Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, pp. 223-232, ACM, 2014.
J. Yu, D. Tao, and M. Wang, "Learning to Rank Using User Clicks and Visual Features for Image Retrieval," IEEE Transactions on Cybernetics, 2014.
S. Ji, K. Zhou, C. Liao, Z. Zheng, and GR. Xue, "Global ranking by exploiting user clicks," in Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, pp. 35-42, ACM, 2009.
G. Dupret, "A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine," in Proceedings of the third ACM international conference on Web search and data mining, pp. 181-190, ACM, 2010.
S. Cen, L. Wang, Y. Feng, and H. Bai, "Efficient image reranking by leveraging click data. In Multimedia and Expo Workshops," 2014 IEEE International Conference on, pp. 1-4.
X. Hua and M. Ye. Mining knowledge from clicks: MSR-Bing image retrieval challenge. In Multimedia and Expo Workshops (ICMEW), 2014 IEEE International Conference on, pp. 1-4.
L. Chen, D. Xu, and I. Tsang, "Tag-based web photo retrieval improved by batch mode re-tagging," in Computer Vision and Pattern Recognition, 2010 IEEE Conference on, pp. 3440-3446, IEEE.
A. Sun and S. Bhowmick, "Image tag clarity: In search of visual representative tags for social images," in 1st SIGMM Workshop on Social Media, New York, pp. 19–26, 2009.
X. Qian, X. Hua, Y. Tang, and T. Mei, "Social image tagging with diverse semantics," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2493-2508, 2014.
X. Qian, D. Lu, and X. Liu, "Tag based image retrieval by user-oriented ranking," Proceedings of International Conference on Multimedia Retrieval, ACM, 2015.
K. Jarvelin and J. Kekalainen, "Cumulated Gain-Based Evaluation of IR Techniques," ACM Transactions on Information Systems, 2002.
Y. Gu, X. Qian, and Q. Li, "Image Annotation by Latent Community Detection and Multikernel Learning," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 3450-3463, 2015.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 The Research Publication
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
