These techniques are just the start of a new era in deep learning technology when it comes to video summarization. Although recently, some deep learning models are proposed for video summarization task 16,17,24,25. One of the most important aims in video summarization task is to predict whether a frame should be in the. Video summarization via deep networks, shihen wei, wei. Deep reinforcement learning for unsupervised video summarization with diversityrepresentativeness reward kaiyang zhou,1,2 yu qiao1, tao xiang2 1 guangdong key lab of computer vision and virtual reality, shenzhen institutes of advanced technology, chinese academy of sciences, china. Pdf this paper presents a deep learning approach to summarizing long soccer videos by leveraging the spatiotemporal learning capability of. Video summarization via spatiotemporal deep architecture. The power of emerging unsupervised deep learning techniques in video summarization for videos that dont adhere to any pattern and are completely different from each other, gans work very nicely. Many advances will be made in the near future to create and optimize the best summaries based on the audience, delivery medium, and intent of summarization.
The input to our algorithm is a video which we then feed. This paper presents a deep learning approach to summarizing long soccer videos by leveraging the spatiotemporal learning capability of threedimensional co. Deep reinforcement learning for unsupervised video. Thus it can be tailored to different user interests leading to a better personalized summary and differs from the generic video summarization which. Video summarization by learning deep side semantic. So, in this work, we try to implement a regression model using deep learning methods that attempts to do this automatically. Titlebased video summarization tvsum dataset serves as a benchmark to validate video summarization techniques. Soccer video summarization using deep learning ieee xplore. Highlight detection with pairwise deep ranking for first. Enhanced deep video summarization network keele university. To generate a video summary, we extract the deep features from each segment of the original video and apply a clustering. In this paper we have proposed a deep learning based robust scheme, named as deep video events dve, to classify the key frames from the video using alexnet which are further processed using a. The power of emerging unsupervised deep learning techniques in video summarization for videos that dont adhere to any pattern and are completely different. For this, we design a deep neural network that maps videos as well as descriptions to a common semantic space and jointly trained it with.
Ieee transactions on circuits and systems for video technology 1 video summarization by learning deep side semantic embedding yitian yuan, tao mei, senior member, ieee, peng cui, and wenwu zhu, fellow, ieee. In this work, we propose an enhanced deep summarization network edsn to summarize videos. Video summarization by learning deep side semantic embedding dsse. Deep reinforcement learning for queryconditioned video. Leveraging ai and deep learning for video summarization.
943 459 830 1359 1105 1359 1118 918 1381 24 1438 1326 1542 1551 1477 1474 1048 1379 102 524 424 842 936 1158 982 572 744 51 1489 1522 895 417 424 1418 1587 1237 154 709 990 1429 663 770 873 820 1347 941