scholarly journals Watching a Small Portion could be as Good as Watching All: Towards Efficient Video Classification

2018 ◽  
Author(s):  
Hehe Fan ◽  
Zhongwen Xu ◽  
Linchao Zhu ◽  
Chenggang Yan ◽  
Jianjun Ge ◽  
...  
Keyword(s):  
Large Scale ◽  
Sampling Rate ◽  
Computational Cost ◽  
Confidence Score ◽  
Video Content ◽  
Video Classification ◽  
Video Frames ◽  
Similar Accuracy ◽  
Efficient Video

We aim to significantly reduce the computational cost for classification of temporally untrimmed videos while retaining similar accuracy. Existing video classification methods sample frames with a predefined frequency over entire video. Differently, we propose an end-to-end deep reinforcement approach which enables an agent to classify videos by watching a very small portion of frames like what we do. We make two main contributions. First, information is not equally distributed in video frames along time. An agent needs to watch more carefully when a clip is informative and skip the frames if they are redundant or irrelevant. The proposed approach enables the agent to adapt sampling rate to video content and skip most of the frames without the loss of information. Second, in order to have a confident decision, the number of frames that should be watched by an agent varies greatly from one video to another. We incorporate an adaptive stop network to measure confidence score and generate timely trigger to stop the agent watching videos, which improves efficiency without loss of accuracy. Our approach reduces the computational cost significantly for the large-scale YouTube-8M dataset, while the accuracy remains the same.

An Embedded GPU Accelerated Hyperspectral Video Classification System in Real-Time

2021 ◽  
Author(s):  
Jaime Sancho ◽  
Manuel Villa ◽  
Gemma Urbanos ◽  
Marta Villanueva ◽  
Pallab Sutradhar ◽  
...  
Keyword(s):  
Real Time ◽  
Classification System ◽  
Video Classification ◽  
Embedded Gpu

scholarly journals Enhanced Video Classification System Using a Block-Based Motion Vector

Information ◽  
2020 ◽  
Vol 11 (11) ◽  
pp. 499
Author(s):  
Jayasree K ◽  
Sumam Mary Idicula
Keyword(s):  
Support Vector Machine ◽  
Classification System ◽  
Boundary Detection ◽  
Video Data ◽  
Shot Boundary Detection ◽  
Support Vector ◽  
Video Classification ◽  
Video Clips ◽  
Shot Boundary ◽  
Block Based

The main objective of this work was to design and implement a support vector machine-based classification system to classify video data into predefined classes. Video data has to be structured and indexed for any video classification methodology. Video structure analysis involves shot boundary detection and keyframe extraction. Shot boundary detection is performed using a two-pass block-based adaptive threshold method. The seek spread strategy is used for keyframe extraction. In most of the video classification methods, selection of features is important. The selected features contribute to the efficiency of the classification system. It is very hard to find out which combination of features is most effective. Feature selection makes relevance to the proposed system. Herein, a support vector machine-based classifier was considered for the classification of video clips. The performance of the proposed system considered six categories of video clips: cartoons, commercials, cricket, football, tennis, and news. When shot level features and keyframe features, along with motion vectors, were used, 86% correct classification was achieved, which was comparable with the existing methods. The research concentrated on feature extraction where combination of selected features was given to a classifier to get the best classification performance.

Sign in / Sign up

Export Citation Format

Share Document