An improved Temporal Shift Module for Efficient Video Understanding – nvidia Jetson nano projects
Call for Price
Temporal Shift Module for Efficient Video Understanding – nvidia Jetson nano projects
Description
Temporal Shift Module for Efficient Video Understanding – nvidia Jetson nano projects
The explosive growth in video streaming gives rise to challenges on performing video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computationally cheap but cannot capture temporal relationships; 3D CNN based methods can achieve good performance but are computationally intensive, making it expensive to deploy. In this paper, we propose a generic and effective Temporal Shift Module (TSM) that enjoys both high efficiency and high performance. Specifically, it can achieve the performance of 3D CNN but maintain 2D CNN’s complexity. TSM shifts part of the channels along the temporal dimension; thus facilitate information exchanged among neighboring frames. It can be inserted into 2D CNNs to achieve temporal modeling at zero computation and zero parameters. We also extended TSM to online setting, which enables real-time low-latency online video recognition and video object detection.
Additional information
Weight | 1.000000 kg |
---|
Reviews
There are no reviews yet.