Content-based Image Retrieval Considering Colour Difference Histogram of Image Texture and Edge Orientation

Document Type : Original Article

Authors

1 Image Processing and Data Mining Lab, Shahrood University of Technology, Shahrood, Iran

2 Department of Computer Engineering, Shahrood Non-profit and Non-government Higher Edu. Inst, Shahrood, Iran

Abstract

Content-based image retrieval is one of the interesting subjects in image processing and machine vision. In image retrieval systems, the query image is compared with images in the database to retrieve images containing similar content. Image comparison is done using features extracted from the query and database images. In this paper, the features are extracted based on the human visual system. Since the human visual system considers the texture and the edge orientation in images for comparison, the colour difference histogram associated with the image’s texture and edge orientation is extracted as a feature. In this paper, the features are selected using the Shannon entropy criterion. The proposed method is tested using the Corel-5K and Corel-10K databases. The precision and recall criteria were used to evaluate the proposed system. The experimental results show the ability of the proposed system for more accurate retrieval rather than recently content-based image retrieval systems.

Keywords



1. Ghosh, N., Agrawal S., Motwani M. "A survey of feature
extraction for content-based image retrieval system." 
Proceedings of International Conference on Recent
Advancement on Computer and Communication. Springer, 
Singapore, )2018(, 305-313.
2. Haji, M. S., Alkawaz, M. H., Rehman, A., & Saba, T.  "Content-
based image retrieval: a deep look at features prospectus."
International Journal of Computational Vision and Robotics, 
Vol. 9, No. 1, (2019), 14-38.
3. Qazanfari, H., Hassanpour, H., & Qazanfari, K. "Content-Based 
Image Retrieval Using HSV Colour Space Features."
International Journal of Computer and Information 
Engineering, Vol. 13, No. 10, (2019), 537-545.
4. Keyvanpour, M., Tavoli, R., & Mozafari, S. "Document image 
retrieval based on keyword spotting using relevance feedback."
International Journal of Engineering, Vol. 27, No. 1, (2014),
7-13. 
5. Qazanfari, H., Hassanpour, H., & Qazanfari, K. "A short-term
learning framework based on relevance feedback for contentbased
image retrieval." 2017 3rd Iranian Conference on
Intelligent Systems and Signal Processing (ICSPIS). IEEE,
(2017), 136-140. 
6. Livingstone, M. S., & Hubel, D. H. "Anatomy and physiology of
a colour system in the primate visual cortex." Journal of
Neuroscience, Vol. 4, No. 1, (1984), 309-356. 
7. Liu, G. H., & Yang, J. Y. "Content-based image retrieval using
colour difference histogram." Pattern Recognition, Vol. 46,
No. 1, (2013), 188-198. 
8. Ojala, T., Pietikainen, M., & Maenpaa, T. "Multiresolution grayscale
and rotation invariant texture classification with local
binary patterns." IEEE Transactions On Pattern Analysis and
Machine Intelligence, Vol. 24, No. 7, (2002), 971-987. 
9. Liu, G. H., Li, Z. Y., Zhang, L., & Xu, Y. "Image retrieval based
on micro-structure descriptor." Pattern Recognition, Vol. 44,
No. 9, (2011), 2123-2133. 
10. Singh, C., & Kaur, K. P. "A fast and efficient image retrieval
system based on colour and texture features." Journal of Visual
Communication and Image Representation, Vol. 41, (2016),
225-238. 
11. Kumar, G. S., & Mohan, P. K. "Local mean differential
excitation pattern for content based image retrieval." SN Applied
Sciences, Vol. 1, No. 1, (2019), 46. 
12. Ajam, A., AlyanNezhadi, M. M., Qazanfari, H., Forghani, M., &
Amiri Z. "Content-based Image Retrieval Using Colour
Difference Histogram in Image Textures." 2019 5rd Iranian
Conference on Intelligent Systems and Signal Processing
(ICSPIS). IEEE, 2019. 
13. Carneiro, G., Chan, A. B., Moreno, P. J., & Vasconcelos, N.
"Supervised learning of semantic classes for image annotation
and retrieval." IEEE Transactions On Pattern Analysis and
Machine Intelligence, Vol. 29, No. 3, (2007), 394-410. 
14. Long, J., Shelhamer, E., & Darrell, T. "Fully convolutional
networks for semantic segmentation." Proceedings of the IEEE
Conference On Computer Vision and Pattern Recognition. 
(2015), 3431-3440.
15. Meng, X., An, Y., He, J., Zhuo, Z., Wu, H., & Gao, X. "Similar 
image retrieval only using one image." Optik, Vol. 127, No. 1,
(2016), 141-144. 
16. Xu, Y. Y. "Multiple-instance learning based decision neural
networks for image retrieval and classification."
Neurocomputing, Vol. 171, (2016), 826-836. 
17. Sharif Razavian, A., Azizpour, H., Sullivan, J., & Carlsson, S.
"CNN features off-the-shelf: an astounding baseline for
recognition." Proceedings of the IEEE Conference On Computer
Vision and Pattern Recognition Workshops. (2014), 806-813. 
18. Khosravi, A., Tizhoosh, H. R., Babaie, M., Khatami, A., &
Nahavandi, S. "A radon-based convolutional neural network for
medical image retrieval." International Journal of
Engineering, Vol. 31, No. 6, (2018), 910-915. 
19. Sezavar, A., Farsi, H., & Mohamadzadeh, S. "A Modified
Grasshopper Optimization Algorithm Combined with CNN for
Content Based Image Retrieval." International Journal of
Engineering, Vol. 32, No. 7, (2019), 924-930. 
20. Muja, M., & Lowe, D. G. "Scalable nearest neighbor algorithms
for high dimensional data." IEEE Transactions on Pattern
Analysis and Machine Intelligence, Vol. 36, No. 11, (2014),
2227-2240. 
21. Jegou, H., Douze, M., & Schmid, C. "Product quantization for
nearest neighbor search." IEEE Transactions on Pattern
Analysis and Machine Intelligence, Vol. 33, No. 1, (2010),
117-128. 
22. Zhang, S., Yang, M., Cour, T., Yu, K., & Metaxas, D. N. "Query
specific fusion for image retrieval." European Conference on
Computer Vision. Springer, Berlin, Heidelberg, (2012), 660673.
 
23. Kundert-Gibbs, J. "Image-Based Content Retrieval via ClassBased
Histogram
Comparisons."
IT
Convergence
and
Security
Springer,
Singapore,
(2018),
3-10.
24. Heller, K. A., & Ghahramani, Z. "A simple Bayesian framework
for content-based image retrieval." 2006 IEEE Computer
Society Conference on Computer Vision and Pattern
Recognition (CVPR'06). Vol. 2. IEEE, 2006. 
25. Rao, M. B., Rao, B. P., & Govardhan, A."Content based image
retrieval using Dominant colour and Texture features." 
International Journal of Computer Science and Information
Security, Vol. 9, (2011), 41-46. 
26. Neelima, N., & Reddy, E. S. "An Efficient Multi Object Image
Retrieval System Using Multiple Features and SVM." Advances
in Signal Processing and Intelligent Recognition Systems.
Springer, Cham, (2016), 257-265. 
27. Singha, M., & Hemachandran, K. "Content based image
retrieval using colour and texture." Signal & Image Processing,
Vol. 3, No. 1, (2012), 39. 
28. Jenni, K., Mandala, S., & Sunar, M. S. "Content based image
retrieval using colour strings comparison.", Procedia Computer
Science, Vol. 50, (2015), 374-379. 
29. Tola, E., Lepetit, V., & Fua, P. "Daisy: An efficient dense
descriptor applied to wide-baseline stereo." IEEE Transactions
on Pattern Analysis and Machine Intelligence, Vol. 32, N0. 5,
(2009), 815-830. 
30. Li, B., Xiao, R., Li, Z., Cai, R., Lu, B. L., & Zhang, L. "RankSIFT:
Learning
to rank repeatable local interest points." CVPR
2011. IEEE, (2011), 1737-1744. 
31. Calonder, M., Lepetit, V., Ozuysal, M., Trzcinski, T., Strecha,
C., & Fua, P. "BRIEF: Computing a local binary descriptor very
fast." IEEE Transactions on Pattern Analysis and Machine
Intelligence, Vol. 34, N0. 7, (2011), 1281-1298. 
32. Rublee, E., Rabaud, V., Konolige, K., & Bradski, G."ORB: An
efficient alternative to SIFT or SURF." 2011 International
Conference On Computer Vision. (2011), 2564-2571. 
33. Veenman, C. J., Smeulders, A. W., & Geusebroek, J. M. "Visual
word ambiguity." IEEE Transactions on Pattern Analysis and
Machine Intelligence, Vol. 32, N0. 7, (2010), 1271-1283. 
34. Jégou, H., Douze, M., & Schmid, C. "Improving bag-of-features
for large scale image search." International Journal of
Computer Vision, Vol. 87, N0. 3, (2010), 316-336. 
35. Lazebnik, S., Schmid, C., & Ponce, J. "Beyond bags of features:
Spatial pyramid matching for recognizing natural scene
categories." 2006 IEEE Computer Society Conference on
Computer Vision and Pattern Recognition (CVPR'06). IEEE,
(2006), 2169-2178. 
36. Nowak, E., Jurie, F., & Triggs, B."Sampling strategies for bagof-features
image classification." European Conference on
Computer Vision. Springer, Berlin, Heidelberg, (2006), 490503.
37. Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. "Lost
in quantization: Improving particular object retrieval in large
scale image databases." 2008 IEEE Conference on Computer
Vision and Pattern Recognition. IEEE, (2008), 1-8. 
38. Zhu, C., Bichot, C. E., & Chen, L. "Image region description
using orthogonal combination of local binary patterns enhanced
with colour information." Pattern Recognition, Vol. 46, N0. 7,
(2013), 1949-1963. 
39. Liu, G. H., Zhang, L., Hou, Y. K., Li, Z. Y., & Yang, J. Y.
"Image retrieval based on multi-texton histogram."Pattern
Recognition, Vol. 43, N0. 7, (2010), 2380-2389. 
40. Girija, O. K., & Sudheep E. M. "Overview of Image Retrieval
Techniques." International Journal of Advanced Research in
Computer and Communication Engineering (IJARCCE), Vol.
4, No. 1 (2015), 2319-5940. 
41. Corel Dataset, http://smartcbir.nph-co.ir/datasets.php,last
accessed 2020/02/01.