Foreground Extraction Using Hilbert-Schmidt Independence Criterion and Particle Swarm Optimization Independent Component Analysis

Document Type : Original Article


1 Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

2 Machine Learning and Computational Modeling Labruatory, College of Engineering, University of Tehran, Tehran, Iran


Foreground extraction is one of the crucial subjects in image processing, which drives different applications in industry. The reality behind the continuous research in this area is the various challenging problems we encounter during the separation process of foreground and background images. Among the source separation approaches, the independent component analysis (ICA) is the most prevalent, being involved in different areas of signal separation applications. Despite the improvements being achieved in foreground extraction, the sudden luminance variations and background movements adversely impact the results of techniques in this regard. In this paper, a novel structure called HSIC_ICA is introduced to address the mentioned problem using a modified version of the ICA algorithm which, leverages the Hilbert-Schmidt Independence Criterion (HSIC) instead of the common objective functions.  Moreover, the unmixing matrix elements of ICA are extracted through a Particle Swarm Optimization (PSO) evolutionary algorithm in a much faster way. The experimental results clearly show that the proposed method outperforms over the significant works being cited among the references, using Wallflower dataset.


1. Paul, M., Haque, S.M. and Chakraborty, S., “Human detection in
surveillance videos and its applications-a review”, EURASIP
Journal on Advances in Signal Processing, Vol. 2013, No. 176,
(2013), 1–16.  
2. Vishwakarma, S. and Agrawal, A., “A survey on activity
recognition and behavior understanding in video surveillance”,
The Visual Computer, Vol. 29, No. 10, (2013), 983–1009.  
3. Ostermann, J. and Kampmann, M., “Source models for contentbased
video coding.”, In Proceedings 2000 International
Conference on Image Processing, (Vol. 3), IEEE, (2000), 62–65.  
4. Park, A., Jung, K. and Kurata, T., “Codebook-based background
subtraction to generate photorealistic avatars in a walkthrough
simulator, In International Symposium on Visual Computing,
Springer, Berlin, Heidelberg,” (2009), , 500–510.  
5. Singla, N., “Motion detection based on frame difference method”,
International Journal of Information & Computation
Technology, Vol. 4, No. 15, (2014), 1559–1565.  
6. Ohta, N., “A statistical approach to background subtraction for
surveillance systems”, In Proceedings Eighth IEEE International
Conference on Computer Vision (ICCV 2001) (Vol. 2), IEEE,
(2001), 481–486.  
7. Charoenpong, T., Supasuteekul, A. and Nuthong, C., “Adaptive
background modeling from an image sequence by using k-means
clustering”, In ECTI-CON2010: The 2010 ECTI International
Confernce on Electrical Engineering/Electronics, Computer,
Telecommunications and Information Technology, IEEE, (2010),
8. Braham, M. and Van Droogenbroeck, M., “Deep background
subtraction with scene-specific convolutional neural networks”,
In 2016 international conference on systems, signals and image
processing (IWSSIP), IEEE, (2016), 1–4.  
9. Jiménez-Hernández, H., “Background subtraction approach based 
on independent component analysis”, Sensors, Vol. 10, No. 6,
(2010), 6092–6114.  
10. Guyon, C., Bouwmans, T., Zahzah, E.H. and Sanguansat, P.,
“Robust principal component analysis for background
subtraction: Systematic evaluation and comparative analysis”,
Principal Component Analysis, Vol. 10, (2012), 223–238.  
11. Lu, W. and Rajapakse, J. C., “ICA with reference”,
Neurocomputing, Vol. 69, No. 16–18, (2006), 2244–2257.  
12. Gretton, A., Bousquet, O., Smola, A. and Schölkopf, B.,
“Measuring statistical dependence with Hilbert-Schmidt norms”,
In International conference on algorithmic learning theory,
Springer, Berlin, Heidelberg, (2005), , 63–77.  
13. Sugiyama, M. and Yamada, M., “On kernel parameter selection
in Hilbert-Schmidt independence criterion”, IEICE Transactions
on Information and Systems, Vol. 95, No. 10, (2012), 2564–
14. Damodaran, B.B., Courty, N. and Lefèvre, S., “Sparse Hilbert
Schmidt independence criterion and surrogate-kernel-based
feature selection for hyperspectral image classification”, IEEE
Transactions on Geoscience and Remote Sensing, Vol. 55, No.
4, (2017), 2385–2398.  
15. Schindler, K. and Wang, H., “Smooth foreground-background
segmentation for video processing”, In Asian Conference on
Computer Vision (Computer Vision – ACCV 2006), Springer,
Berlin, Heidelberg, (2006), 581–590.  
16. Barnich, O. and Van Droogenbroeck, M., “ViBe: A universal
background subtraction algorithm for video sequences”, IEEE
Transactions on Image Processing, Vol. 20, No. 6, (2010),
17. Shimada, A. and Taniguchi, R. I., “Hybrid background model
using spatial-temporal LBP”, In 2009 Sixth IEEE International
Conference on Advanced Video and Signal Based Surveillance,
IEEE, (2009), 19–24.  
18. Dou, J., Qin, Q. and Tu, Z., “Background subtraction based on
deep convolutional neural networks features”, Multimedia Tools
and Applications, Vol. 78, No. 11, (2019), 14549–14571.  
19. Tsai, D.M. and Lai, S. C., “Independent component analysisbased
background subtraction for indoor surveillance”, IEEE
Transactions on Image Processing, Vol. 18, No. 1, (2008), 158–
20. Sekkati, H., Laganiere, R., Mitiche, A. and Youmaran, R.,
“Robust background subtraction using geodesic active contours in
ICA subspace for video surveillance applications”, In 2012 Ninth
Conference on Computer and Robot Vision, IEEE, (2012), 190–
21. Borgwardt, K.M., Gretton, A., Rasch, M.J., Kriegel, H.P.,
Schölkopf, B. and Smola, A. J., “Integrating structured biological
data by kernel maximum mean discrepancy”, Bioinformatics,
Vol. 22, No. 14, (2006), e49–e57.  
22. Gretton, A., Fukumizu, K., Teo, C.H., Song, L., Schölkopf, B. and
Smola, A. J., “A kernel statistical test of independence”, In
Proceedings of the 20th International Conference on Neural
Information Processing Systems, (2008), 585–592.  
23. Carmeli, C., De Vito, E. and Toigo, A., “Reproducing kernel
Hilbert spaces and Mercer theorem”, (2005), 1–30. arXiv preprint
24. Giardina, C.R. and Dougherty, E.R., Morphological methods in
image and signal processing, Prentice-Hall, Inc., (1988). 
25. Toyama, K., Krumm, J., Brumitt, B. and Meyers, B.,
“Wallflower: Principles and practice of background
maintenance”, In Proceedings of the seventh IEEE international
conference on computer vision (Vol. 1), IEEE, (1999), 255–261.  
26. Powers, D. M., “Evaluation: from precision, recall and F-measure
to ROC, informedness, markedness and correlation”, Journal of
Machine Learning Technologies, Vol. 2, No. 1, (2011), 37–63.