Open Access Open Access  Restricted Access Subscription or Fee Access

PSO-Based Video Summarization for Content Browsing and Visualization Using Parallel Processing

Hanan H. Elazhary, Heba A. El Nemr

Abstract


Video abstraction or summarization is a technique that generates a short summary of the video possibly as a group of stationary keyframes. Video abstraction has several applications including video content browsing and visualization. The goal of this research study is to develop a comprehensive approach for generating different sets of keyframes according to the application while speeding up the processing time and minimizing human intervention. The proposed approach relies on dividing the video into equal short segments to avoid the delay resulting from shot segmentation. Keyframes are then generated from these segments using Particle Swarm Optimization (PSO) for additional speedup. Since different runs produce different sets of keyframes, automatic integration of the results of few runs has been shown to produce a set of keyframes capable of capturing the changes within each video shot for video content browsing without the need for human intervention. Since this implies the increase of the overhead, parallel processing is utilized for further significant speed up. The generated keyframes are filtered to produce a satisfactory set of keyframes for video visualization while minimizing the false rate, increasing the hit rate, and minimizing human intervention.

Keywords


Parallel Processing, Particle Swarm Optimization, Video Content Browsing, Video Summarization, Video Visualization.

Full Text:

PDF

References


B. Fauvet, P. Bouthemy, P. Gros, and F. Spindler, “A geometrical key-frame selection method exploiting dominant motion estimation in video,” in Proc. ACM International Conference on Image and Video Retrieval, pp. 419-427, 2004.

S. Porter, M. Mirmehdi, and B. Thomas, “A shortest path representation for video summarization,” in Proc. 12th IEEE International Conference on Image Analysis and Processing, pp. 460-465, 2003.

M. Cooper and J. Foote, “Discriminative techniques for keyframe selection,” in Proc. IEEE International Conference on Multimedia and Expo, pp. 502-505, 2005.

Y. Hadi, F. Essannouni, and R. Thami, “Video summarization by K-medoid clustering,” in Proc. ACM Symposium on Applied Computing, 2006.

J. Rong, W. Jin, and L. Wu, "Key frame extraction using inter-shot information", in Proc. IEEE International Conference on Multimedia and Expo, 2004.

X. Cabedo and S. Bhattacharjee, "Shot detection tools in digital video," in proc. Nonlinear Model Based Image Analysis, pp. 121–126, 1998.

X. Ling, O. Yuanxin, L. Huan, and X. Zhang, "A method for fast shot boundary detection based on SVM," in Proc. the 2008 Congress on Image and Signal Processing, vol. 2, pp. 445-449, 2008.

J. Boreczky and L. Rowe, "Comparison of video shot boundary detection techniques," in Proc. SPIE 2664, pp. 170-179, 1996.

R. Zabih, J. Miller, and K. Mai, "A feature-based algorithm for detecting and classifying scene breaks," in Proc. ACM Multimedia 95, pp. 189-200, 1995.

R. Lienhart, C. Kuhmünch, and W. Effelsberg, "On the detection and recognition of television commercials," in Proc. the International Conference on Multimedia Computing and Systems, pp. 509-516, 1997.

R. Lienhart, "Methods towards automatic video analysis, indexing and retrieval," Ph.D. thesis, University of Mannheim, 1998.

G. Ciocca and R. Schettini, "Dynamic storyboards for video content summarization," in Proc. ACM MIR'06, 2006.

Z. Cerneková, C. Nikou, and I. Pitas, “Entropy metrics used for video summarization,” in Proc. the 18th Conference on Computer Graphics, 2002.

A. Doulamis, Y. Avrithis, N. Doulamis, and S. Kollias, “A genetic algorithm for efficient video content representation,” in Computational Intelligence in Systems and Control Design and Applications. Springer, 1st edition, pp. 151-162, 2001.

F. Dirfaux, “Keyframe selection to represent a video,” in Proc. IEEE International Conference on Image Processing, pp. 275-278, 2000.

B. Yeo and B. Liu, “Rapid scene analysis on compressed videos,” IEEE Trans. Circuits and Systems for Video Technology, vol. 5, pp. 533- 544, Dec. 1995.

A. Doulamis and N. Doulamis, “Optimal content-based video decomposition for interactive video navigation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 14, no. 6, pp. 757–775, 2004.

M. Fayek, H. El Nemr, and M. Moussa, “Keyframe selection from shots using particle swarm optimisation,” Ain Shams Journal of Electrical Engineering, 2009.

X. Sun and M. Kankanhalli, “Video summarization using R-sequences,” Real-Time Imaging, vol. 6, pp. 449-459, 2000.

M. Fayek, H. El Nemr, and M. Moussa, “Particle swarm optimisation based video abstraction,” Journal of Advanced Research, pp. 163–167, 2010.

J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proc. IEEE International Conference on Neural Networks, pp.1942-1948, 1995.

P. Yin, “A discrete particle swarm algorithm for optimal polygonal approximation of digital curves,” Journal of Visual Communication and Image Representation, vol. 15, no. 2, pp. 241-260, 2004.

J. Kennedy and R. Eberhart, “A discrete binary version of the particle swarm algorithm,” in Proc. the IEEE International Conference on Systems, Man, and Cybernetics, pp. 4104-4109, 1997.

S. Kirkpatrick, C. Gelatt, and M. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, 1983.

Y. Ohta, T. Kanade, and T. Sakai, "Color information for region segmentation," Computer Graphics and Image Processing, vol. 13, pp. 222-241, 1980.

J. Shawe-Taylor and N. Cristianini, “Support vector machines and other kernel-based learning methods,” Cambridge University Press, 2000.

Y. Yusoff, W. Christmas and J. Kittler, "Video shot cut detection using adaptive thresholding", EC 5th Framework Project IST-13082 (ASSAVID), 2000.


Refbacks

  • There are currently no refbacks.