WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose

Published in

British Machine Vision Conference(2020)

External Links:

Generate Graph

TL;DR

The resulting Wide Headpose Estimation Network (WHENet) is the first fine-grained modern method applicable to the full-range of head yaws yet also meets or beats state-of-the-art methods for frontal head pose estimation.

Abstract

We present an end-to-end head-pose estimation network designed to predict Euler angles through the full range head yaws from a single RGB image. Existing methods perform well for frontal views but few target head pose from all viewpoints. This has applications in autonomous driving and retail. Our network builds on multi-loss approaches with changes to loss functions and training strategies adapted to wide range estimation. Additionally, we extract ground truth labelings of anterior views from a current panoptic dataset for the first time. The resulting Wide Headpose Estimation Network (WHENet) is the first fine-grained modern method applicable to the full-range of head yaws (hence wide) yet also meets or beats state-of-the-art methods for frontal head pose estimation. Our network is compact and efficient for mobile devices and applications.

Authors

Yijun Zhou

1 papers

J. Gregson

1 papers

References53 items

FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation From a Single Image

EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

Improving Head Pose Estimation with a Combined Loss and Bounding Box Margin Adjustment

Estimation of Pedestrian Pose Orientation Using Soft Target Training Based on Teacher–Student Framework

Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose

WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose

Published in

British Machine Vision Conference(2020)

External Links:

Generate Graph

TL;DR

Abstract

Authors

Yijun Zhou

1 papers

J. Gregson

1 papers

References53 items

FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation From a Single Image

EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

Improving Head Pose Estimation with a Combined Loss and Bounding Box Margin Adjustment

Estimation of Pedestrian Pose Orientation Using Soft Target Training Based on Teacher–Student Framework

Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose

SSR-Net: A Compact Soft Stagewise Regression Network for Age Estimation

MobileNetV2: Inverted Residuals and Linear Bottlenecks

Appearance based pedestrians' head pose and body orientation estimation using deep learning

Face-from-Depth for Head Pose Estimation on Depth Images

AI Challenger : A Large-scale Dataset for Going Deeper in Image Understanding

Fine-Grained Head Pose Estimation Without Keypoints

Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Network

How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks)

KEPLER: Keypoint and Pose Estimation of Unconstrained Faces by Learning Efficient H-CNN Regressors

Panoptic Studio: A Massively Multiview System for Social Interaction Capture

POSEidon: Face-from-Depth for Driver Pose Estimation

UMDFaces: An annotated face dataset for training deep networks

An All-In-One Convolutional Neural Network for Face Analysis

A Multi-Task Learning Framework for Head Pose Estimation under Target Motion

Context-Aware CNNs for Person Head Detection

Deep Head Pose: Gaze-Direction Estimation in Multimodal Video

Real Time Head Model Creation and Head Pose Estimation on Consumer Depth Cameras

Facial feature point detection: A comprehensive survey

Head detection and orientation estimation for pedestrian safety

Joint Cascade Face Detection and Alignment

One millisecond face alignment with an ensemble of regression trees

YawDD: a yawning detection dataset

No Matter Where You Are: Flexible Graph-Guided Multi-task Learning for Multi-view Head Pose Classification under Target Motion

Pose-Free Facial Landmark Fitting via Optimized Part Mixtures and Cascaded Deformable Shape Model

Vision meets robotics: The KITTI dataset

Deep Convolutional Network Cascade for Facial Point Detection

A Robust Real-Time Face Tracking Using Head Pose Estimation for a Markerless AR System

Random Forests for Real Time 3D Face Analysis

Face detection, pose estimation, and landmark localization in the wild

Real time head pose estimation with random regression forests

3D Deformable Face Tracking with a Commodity Depth Camera

Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness

Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation

The influence of head contour and nose angle on the perception of eye-gaze direction

Head pose estimation for driver monitoring

Object recognition supported by user interaction for service robots

Head pose estimation using view based eigenspaces

Model-based head pose tracking with stereovision

Composite support vector machines for detection of faces across views and pose estimation

Edge and keypoint detection in facial regions

Closed-form solution of absolute orientation using orthonormal matrices

HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

Face alignment across large poses: A 3d solution

Self-initializing Head Pose Estimation With a 2D Monocular USB Camera

Advance in Head Pose Estimation from Low Resolution Images: A Review

Colour Invariant Head Pose Classification in Low Resolution Video

Understanding Pose Discrimination in Similarity Space

Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Head Pose Estimation in Computer Vision: a Survey

Field of Study

Computer Science

Journal Information

Name

ArXiv

Volume

abs/2005.00687

Venue Information

Name

British Machine Vision Conference

Type

conference

URL

http://www.bmva.org/bmvc/

Alternate Names

Br Mach Vis Conf
BMVC