A New Texture Segmentation Method with Energy-driven Parametric Active Contour Model Based on Jensen-Tsallis Divergence

Document Type : Original Article


Department of Electrical & Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran


Texture image segmentation plays an important role in various computer vision tasks. Active contour models are one of the most efficient and popular methods for identifying the purpose and segmentation of objects in the image. This paper presents a parametric active contour model (PACM) with a robust minimization framework based on image texture energy. First, the texture features of the original image are extracted using gray level co-occurrence matrix (GLCM). Subsequently, based on the GLCM texture features inside and outside the active contour, Jensen-Tsallis divergence of energies is calculated. The Jensen-Tsallis divergence is added to the parametric active contour using the balloon equation. The divergence is maximum at the boundary between the foreground and background of the image, which results in minimizing the active contour equation at the boundary of the target object. This global minimization energy function with texture feature can avoid the existence of local minima in the PACM models. Also, as opposed to previous models, the proposed model only requires the initial contour and is not dependent on the distance of the initial contour from the target object. In terms of segmentation accuracy and efficiency, experiments with synthetic and natural images demonstrate that the proposed approach obtains more satisfactory results than the previous state-of-the-art methods.


Main Subjects

  1. Eng, H.-L., Thida, M., Chew, B.-F., Leman, K. and Anggrelly, S.Y., "Model-based detection and segmentation of vehicles for intelligent transportation system", in 2008 3rd IEEE Conference on Industrial Electronics and Applications, IEEE. (2008), 2127-2132. https://doi.org/10.1109/ICIEA.2008.4582895
  2. Huang, K. and Tan, T., "Vs-star: A visual interpretation system for visual surveillance", Pattern Recognition Letters, Vol. 31, No. 14, (2010), 2265-2285, https://doi.org/10.1016/j.patrec.2010.05.029.
  3. Salimi, A., Pourmina, M.A. and Moin, M.-S., "Fully automatic prostate segmentation in mr images using a new hybrid active contour-based approach", Signal, Image and Video Processing, Vol. 12, No. 8, (2018), 1629-1637, doi.
  4. Jabbari, S. and Baleghi, Y., "Segmentation of skin lesion images using a combination of texture and color information", Journal of Soft Computing and Information Technology, Vol. 8, No. 4, (2020), 87-97, doi.
  5. Mahdiraji, S.A., Baleghi, Y. and Sakhaei, S.M., "Skin lesion images classification using new color pigmented boundary descriptors", in 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA), IEEE. (2017), 102-107. https://doi.org/10.1109/PRIA.2017.7983026
  6. Mahdiraji, S.A., Baleghi, Y. and Sakhaei, S.M., "Bibs, a new descriptor for melanoma/non-melanoma discrimination", in Electrical Engineering (ICEE), Iranian Conference on, IEEE. (2018), 1397-1402. https://doi.org/10.1109/ICEE.2018.8472701
  7. Chen, Q., Sun, Q.-S., Heng, P.A. and Xia, D.-S., "Two-stage object tracking method based on kernel and active contour", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 20, No. 4, (2010), 605-609, https://doi.org/10.1109/TCSVT.2010.2041819.
  8. Nikbakhsh, N., Baleghi, Y. and Agahi, H., "Maximum mutual information and tsallis entropy for unsupervised segmentation of tree leaves in natural scenes", Computers and electronics in Agriculture, Vol. 162, (2019), 440-449, https://doi.org/10.1016/j.compag.2019.04.038.
  9. Nikbakhsh, N., Baleghi, Y. and Agahi, H., "A novel approach for unsupervised image segmentation fusion of plant leaves based on g-mutual information", Machine Vision and Applications, Vol. 32, No. 1, (2021), 1-12.
  10. Nikbakhsh, N., Baleghi Damavandi, Y. and Agahi, H., "Plant classification in images of natural scenes using segmentations fusion", International Journal of Engineering, Vol. 33, No. 9, (2020), 1743-1750.
  11. Asvadi, A., Mahdavinataj, H., KARAMI, M.R. and Baleghi, Y., "Online visual object tracking using incremental discriminative color learning", The CSI Journal on Computer Science and Enginering, Vol. 12, No. 24, (2014), 16-28, doi.
  12. Asvadi, A., Karami-Mollaie, M., Baleghi, Y. and Seyyedi-Andi, H., "Improved object tracking using radial basis function neural networks", in 2011 7th Iranian Conference on Machine Vision and Image Processing, IEEE. (2011), 1-5. https://doi.org/10.1109/IranianMVIP.2011.6121604
  13. Asvadi, A., Karami, M. and Baleghi, Y., "Efficient object tracking using optimized k-means segmentation and radial basis function neural networks", International Journal of Information and Communication Technology Research, Vol. 4, No. 1, (2012), 29-39, doi.
  14. Asvadi, A., Karami, M. and Baleghi, Y., "Object tracking using adaptive object color modeling", in Proceeding of 4th Conference on Information and Knowledge Technology. (2012), 848-852.
  15. Asvadi, A., Mahdavinataj, H., Karami, M. and Baleghi, Y., "Incremental discriminative color object tracking", in International Symposium on Artificial Intelligence and Signal Processing, Springer. (2013), 71-81.
  16. Subudhi, P. and Mukhopadhyay, S., "A fast texture segmentation scheme based on active contours and discrete cosine transform", Computers & Electrical Engineering, Vol. 62, (2017), 105-118, https://doi.org/10.1016/j.compeleceng.2017.04.021.
  17. Sagiv, C., Sochen, N.A. and Zeevi, Y.Y., "Integrated active contours for texture segmentation", IEEE Transactions on Image Processing, Vol. 15, No. 6, (2006), 1633-1646, https://doi.org/10.1109/TIP.2006.871133.
  18. Abdelsamea, M.M., Gnecco, G. and Gaber, M.M., "An efficient self-organizing active contour model for image segmentation", Neurocomputing, Vol. 149, (2015), 820-835, https://doi.org/10.1016/j.neucom.2014.07.052.
  19. Shantkumari, M. and Uma, S., "Grape leaf segmentation for disease identification through adaptive snake algorithm model", Multimedia Tools and Applications, Vol. 80, No. 6, (2021), 8861-8879.
  20. Fu, X., Fang, B., Zhou, M. and Li, J., "Hybrid active contour driven by double-weighted signed pressure force for image segmentation", in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE. (2020), 2463-2467. https://doi.org/10.1109/ICASSP40776.2020.9054627
  21. Cremers, D., Rousson, M. and Deriche, R., "A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape", International Journal of Computer Vision, Vol. 72, No. 2, (2007), 195-215, doi.
  22. Wang, Y. and Zeng, R., "Image segmentation algorithm based on geometric flow bandelets transformation particle replanting", Pattern Recognition Letters, Vol. 116, (2018), 200-204, https://doi.org/10.1016/j.patrec.2018.10.021.
  23. Wu, Q., Gan, Y., Lin, B., Zhang, Q. and Chang, H., "An active contour model based on fused texture features for image segmentation", Neurocomputing, Vol. 151, (2015), 1133-1141, https://doi.org/10.1016/j.neucom.2014.04.085.
  24. Caselles, V., Kimmel, R. and Sapiro, G., "Geodesic active contours", International Journal of Computer Vision, Vol. 22, No. 1, (1997), 61-79, doi.
  25. Kass, M., Witkin, A. and Terzopoulos, D., "Snakes: Active contour models", International Journal of Computer Vision, Vol. 1, No. 4, (1988), 321-331, doi.
  26. Nisirat, M.A., "A new external force for snake algorithm based on energy diffusion", International Journal of Machine Learning and Computing, Vol. 9, (2019), 316-321.
  27. Vard, A., Monadjemi, A., Jamshidi, K. and Movahhedinia, N., "Fast texture energy based image segmentation using directional walsh–hadamard transform and parametric active contour models", Expert Systems with Applications, Vol. 38, No. 9, (2011), 11722-11729, https://doi.org/10.1016/j.eswa.2011.03.058.
  28. Moallem, P., Tahvilian, H. and Monadjemi, S.A., "Parametric active contour model using gabor balloon energy for texture segmentation", Signal, Image and Video Processing, Vol. 10, No. 2, (2016), 351-358, doi.
  29. Bae, H.-J. and Jung, S.-H., "Image retrieval using texture based on dct", in Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat., IEEE. Vol. 2, (1997), 1065-1068.
  30. Ivins, J. and Porrill, J., "Active region models for segmenting medical images", in Proceedings of 1st International Conference on Image Processing, IEEE. Vol. 2, (1994), 227-231.
  31. Schaub, H. and Smith, C.E., "Color snakes for dynamic lighting conditions on mobile manipulation platforms", in Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453), IEEE. Vol. 2, (2003), 1272-1277.
  32. Hamarneh, G., Chodorowski, A. and Gustavsson, T., "Active contour models: Application to oral lesion detection in color images", in Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics.'cybernetics evolving to systems, humans, organizations, and their complex interactions'(cat. no. 0, IEEE. Vol. 4, (2000), 2458-2463.
  33. Vard, A.R., Moallem, P. and Nilchi, A.R.N., "Texture‐based parametric active contour for target detection and tracking", International Journal of Imaging Systems and Technology, Vol. 19, No. 3, (2009), 187-198, https://doi.org/10.1002/ima.20194.
  34. Gao, M., Chen, H., Zheng, S. and Fang, B., "Feature fusion and non-negative matrix factorization based active contours for texture segmentation", Signal Processing, Vol. 159, (2019), 104-118, https://doi.org/10.1016/j.sigpro.2019.01.021.
  35. Subudhi, P. and Mukhopadhyay, S., "A statistical active contour model for interactive clutter image segmentation using graph cut optimization", Signal Processing, Vol. 184, (2021), 108056, https://doi.org/10.1016/j.sigpro.2021.108056.
  36. Wu, X., Tan, G., Li, K., Li, S., Wen, H., Zhu, X. and Cai, W., "Deep parametric active contour model for neurofibromatosis segmentation", Future Generation Computer Systems, Vol. 112, (2020), 58-66, https://doi.org/10.1016/j.future.2020.05.001.
  37. Badoual, A., Unser, M. and Depeursinge, A., "Texture-driven parametric snakes for semi-automatic image segmentation", Computer Vision and Image Understanding, Vol. 188, (2019), 102793, doi: 10.1016/j.cviu.2019.102793.
  38. Prince, J.L. and Xu, C., "A new external force model for snakes", in Proc. 1996 Image and Multidimensional Signal Processing Workshop, Citeseer. Vol. 3, No. 31, (1996), 1.
  39. Mehri, A., Jamaati, M. and Mehri, H., "Word ranking in a single document by jensen–shannon divergence", Physics Letters A, Vol. 379, No. 28-29, (2015), 1627-1632, https://doi.org/10.1016/j.physleta.2015.04.030.
  40. Shannon, C.E., "A mathematical theory of communication", The Bell System Technical Journal, Vol. 27, No. 3, (1948), 379-423.
  41. Mezard, M. and Montanari, A., "Information, physics, and computation, Oxford University Press, (2009).
  42. Klir, G., "Uncertainty and information: Foundation of generalized information theory: John willey and sons, new jersey", (2006).
  43. Kieffer, J., "Elements of information theory (thomas m. Cover and joy a. Thomas)", SIAM Review, Vol. 36, No. 3, (1994), 509-511.
  44. Endres, D.M. and Schindelin, J.E., "A new metric for probability distributions", IEEE Transactions on Information Theory, Vol. 49, No. 7, (2003), 1858-1860, https://doi.org/10.1109/TIT.2003.813506.
  45. Angulo, J., Antolín, J., López-Rosa, S. and Esquivel, R., "Jensen–tsallis divergence and atomic dissimilarity for ionized systems in conjugated spaces", Physica A: Statistical Mechanics and its Applications, Vol. 390, No. 4, (2011), 769-780, https://doi.org/10.1016/j.physa.2010.11.005.
  46. Rajinikanth, V., Dey, N., Satapathy, S.C. and Ashour, A.S., "An approach to examine magnetic resonance angiography based on tsallis entropy and deformable snake model", Future Generation Computer Systems, Vol. 85, (2018), 160-172, https://doi.org/10.1016/j.future.2018.03.025.
  47. Baleghi, Y. and Rousseau, D., "An analytical proof on suitability of cauchy-schwarz divergence as the aggregation criterion in region growing algorithm", Image and Vision Computing, Vol. 115, (2021), 104312, https://doi.org/10.1016/j.imavis.2021.104312.
  48. Hersey, I., "Textures: A photographic album for artists and designers by phil brodatz", Leonardo, Vol. 1, No. 1, (1968), 91-92.
  49. Subudhi, P. and Mukhopadhyay, S., "A pyramidal approach to active contours implementation for 2d gray scale image segmentation", in 2016 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), IEEE., (2016), 752-757.