Open Access Open Access  Restricted Access Subscription or Fee Access

Comparison of Video Shot Boundary Detection

P. Swati Sowjanya, Ravi Mishrab

Abstract


boundaries and classifying shot and shot transition types. Here we are using four different methods for comparison, using GIST1, Segmentation, Color Histogram and Motion Activity Descriptor. The Color histogram is the most simplest and fastest method, it computes a histogram and detects a shot based on the comparison of the histogram of each frame but this is sensitive to luminance and motion. The segmentation method uses SVM classifier for the detection of the shot boundaries, these classifiers trained to detect the transition but may be biased to treat all frames as non transition frames which shows its disadvantage. The motion activity descriptor method computes the motion vector for each frame and based on these it detects the shot boundaries but this can be a complex and lengthy processor and may produce incorrect results. The GIST method uses the color as well as gist property of a frame to compute the shot boundaries. The color shows good results for the detection of gradual transitions while the gist is efficient to detect the abrupt cuts. Thus we can say the GIST is the best method after carrying out comparison between all these methods.

Keywords


Cut, Color Histogram, GIST, Gradual, Motion Descriptor, Segmentation, Shot.

Full Text:

PDF

References


Chunxi Liu1, Huiying Liu2, Shuqiang Jiang2, Qingming Huang1, Yijia Zheng1, Weigang Zhang3, “JDL AT TRECVID 2006 SHOT BOUNDARY DETECTION,” 2006

Alan F. Smeaton, Paul Over, Aiden R. Doherty, “Video Shot Boundary Detection: Seven Years of TRECVid Activity,” Preprint submitted to Elsevier 12 March 2009

J. Bescs, G. Cisneros, J. M. Martnez, J. M. Menndez, and J. Cabrera, “A unified model for techniques on video shot transition detection,” IEEE Transactions on Multimedia, vol. 7, no. 2, pp. 293–307, Apr 2005.

J. Yuan, H. Wang, L. Xiao, W. Zheng, J. Li, F. Lin, and B. Zhang, “A formal study of shot boundary detection,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 2, pp. 168–186, Feb 2007.

Lexing Xie a, Peng Xu a, Shih-Fu Chang, Ajay Divakaran, Huifang Sun, “Structure analysis of soccer video with domain knowledge and hidden Markov models” www.elsevier.com/locate/patrec, Pattern Recognition Letters 25 (2004) 767–775.

Birinci, M.; Diaz-de-Maria, F.; Abdollahian, G.; Delp, E.J.; Gabbouj, M.; “Neighborhood matching for object recognition algorithms based on local image features”, Digital Signal Processing Workshop and IEEE Signal Processing Education Workshop (DSP/SPE), 2011 IEEE, Jan 2011, pp 157-162

Tie-Yan Liu, Kwok-Tung Lo, Xu-Dong Zhang and Jian Feng, “A new cut detection algorithm with constant false-alarm ratio for video segmentation” J. Vis. Commun. Image R. 15 (2004) 132–144

Murat Birinci, Serkan Kiranyaz, Moncef Gabbouj, “VIDEO SHOT BOUNDARY DETECTION BY STRUCTURAL ANALYSIS OF LOCAL IMAGE FEATURES”, 2011

Jianping Fan, Guihua Zeng, Mathurin Body, Mohand-Said Haci, “Seeded region growing: an extensive and comparative study”, Pattern Recognition Letters 26 (2005) 1139–1156

Amel Malek Abdelati, Jlassi bahaeddine, Abdessalem Ben Abdellali and Abdellatif Mtibaa, “ Suivi d’objet en movement par la method Level Set variationnelle, ” international workshop on system engineering design & application, October 24-26, 2008, Monastir, Tunisia.

Werner Bailer (JRS), Franz Holler (JRS), Alberto Messina (RAI), Daniele Airola (RAI), Peter Schallauer (JRS), Michael Hausenblas (JRS), “State of the Art of Content Analysis Tools for Video, Audio and Speech”, Report, 10/3/2005.

Alan F. Smeaton, “Techniques Used and Open Challenges to the Analysis, Indexing and Retrieval of Digital Video”, Science Foundation Ireland and Preprint submitted to Elsevier Science 13 September 2006.

M. Bertini, A. Del Bimbo, P. Pala, “Content- based indexing and retrieval of TV news,” Pattern Recogition Letters 22 (2001) 503-516.

Liangda Li, Ke Zhou, Gui-Rong Xue, Hongyuan Zha, Yong Yu, “Video Summarization via Transferrable Structured Learning”, International World Wide Web Conference Committee (IW3C2), March-April 2011, pp 287-296.

Baber, J.; Afzulpurkar, N.; Dailey, M.N.; Bakhtyar, M.; “Shot boundary detection from videos using entropy and local descriptor”, Digital Signal Processing (DSP), 2011 17th International Conference on Zhao Huan, july 2011, pp 1-6

Li Xiuhuan, Yu Lilei, “Shot Boundary Detection Based on Mutual Information and Canny Edge Detector”, International Conference on Computer Science and Software Engineering, csse, vol. 2, 2008 pp.1124-1128.

Hua-Yong Liu; Tingting He, “Using Multimodal Analysis for Story Segmentation of News Video”, Artificial Intelligence, 2009. JCAI '09. International Joint Conference on, April 2011, pp 124-127

Ying-li Tian, Arun Hampapur, Lisa Brown, Rogerio Feris, Max Lu, Andrew Senior, Chiao-fe Shu, and Yun Zhai, “Event detection, query, and retrieval for video surveillance”, Book chapter for Artificial Intelligence for Maximizing Content Based Image Retrieval

Bo Han; Weiguo Wu; “Video scene segmentation using a novel boundary evaluation criterion and dynamic programming”, Multimedia and Expo (ICME), 2011 IEEE International Conference on, july 2011, pp 1-6

Moshe Guttmann, Lior Wolf, Danny Cohen-Or. “Content aware video manipulation. Computer Vision and Image Understanding xxx (2011) xxx–xxx.

Wu-Chih Hu, “REAL-TIME ON-LINE VIDEO OBJECT SEGMENTATION BASED ON MOTION DETECTION WITHOUT BACKGROUND CONSTRUCTION”, International Journal of

Innovative Computing, Information and Control ICIC International Volume 7, Number 4, April 2011, pp. 1845-1860.

Paul Browne, Alan F Smeaton, Noel Murphy, Noel O’Connor, Seán Marlow, Catherine Berrut, “Evaluating and Combining Digital Video Shot Boundary Detection Algorithms”, Conference or Workshop Item, Feb-2009

John M. Gauch, Susan Gauch, Sylvain Bouix, Xiaolan Zhu, “Real Time Video Scene Detection and Classification”

Kok Meng Pua, John M. Gauch, Susan E. Gauch, and Jedrzej Z. Miadowicz, “Real time repeated video sequence identification”, Computer Vision and Image Understanding 93 (2004) 310–327

Nicola Anselmi, Dongmo Sylvestre Aime, Rossi Maurizio, “Shot Boundary Detection in OpenCV”, 2011.

Abdelati Malek Amel, Ben Abdelali Abdessalem and Mtibaa Abdellatif, “Video shot boundary detection using motion activity descriptor”, JOURNAL OF TELECOMMUNICATIONS, VOLUME 2, ISSUE 1, APRIL 2010, pp 54-59.

Ali Amiri and Mahmood Fathy, “Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection”, EURASIP Journal on Advances in Signal Processing Volume 2009 (2009), Article ID 509438, 12 pages

Matthew Cooper_, Jonathan Foote, John Adcock, and Sandeep Casi, “Shot boundary detection via similarity analysis”, cooper@fxpal.com, 2005

Don Adjeroh, M. C. Lee, N. Banda, Uma Kandaswamy, “Adaptive Edge-Oriented Shot Boundary Detection”, NSF ITR, 2009, pp 1-24.

Jian Zhou, Xiao-Ping Zhang, “VIDEO SHOT BOUNDARY DETECTION USING INDEPENDENT COMPONENT ANALYSIS”, IEEE ICASSP 2005, vol II – 541- 544.

Hueihan Jhuang, Sharat Chikkerur, “Video Shot Boundary Detection Using Gist”, 2006.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.