Detecting Kissing Scenes in a Database of Hollywood Films
Published in
arXiv.org(2019)External Links:
TL
TL;DR
A highly accurate kissing detector that achieves a validation F1 score of 0.95 on a diverse database of Hollywood films ranging many genres and spanning multiple decades is developed.
Abstract
Detecting scene types in a movie can be very useful for application such as video editing, ratings assignment, and personalization. We propose a system for detecting kissing scenes in a movie. This system consists of two components. The first component is a binary classifier that predicts a binary label (i.e. kissing or not) given a features exctracted from both the still frames and audio waves of a one-second segment. The second component aggregates the binary labels for contiguous non-overlapping segments into a set of kissing scenes. We experimented with a variety of 2D and 3D convolutional architectures such as ResNet, DesnseNet, and VGGish and developed a highly accurate kissing detector that achieves a validation F1 score of 0.95 on a diverse database of Hollywood films ranging many genres and spanning multiple decades. The code for this project is available at this http URL.
References18 items
1
Violent scene detection algorithm based on kernel extreme learning machine and three-dimensional histograms of gradient orientation
2
Scanner
3
Scene
4
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
5