An approach of a two-stage convolutional neural network, one for the detection of hand and another for the fingertips, which outperforms the existing systems in terms of the precision of detection and interaction performance in the VR environment.
Authors
Mohammad Mahmudul Alam
3 papers
S. Rahman
2 papers
References41 items
1
Hand pose estimation in object-interaction based on deep learning for virtual reality applications
2
Detection and Tracking of Fingertips for Geometric Transformation of Objects in Virtual Environment
3
AirPen: A Touchless Fingertip Based Gestural Interface for Smartphones and Head-Mounted Devices
4
MobileNetV2: Inverted Residuals and Linear Bottlenecks
5
YOLSE: Egocentric Fingertip Detection from Single RGB Images
6
Hand gesture control of virtual object in augmented reality
7
Fast hand posture classification using depth features extracted from random line segments
8
An augmented reality application with hand gestures for learning 3D geometry
9
YOLO9000: Better, Faster, Stronger
10
Fingertip in the Eye: An Attention-Based Method for Real-Time Hand Tracking and Fingertip Detection in Egocentric Videos
11
Xception: Deep Learning with Depthwise Separable Convolutions
12
A Pointing Gesture Based Egocentric Interaction System: Dataset, Approach and Application
13
Rethinking the Inception Architecture for Computer Vision
14
Fingertip in the Eye: A cascaded CNN pipeline for the real-time fingertip detection in egocentric videos
15
DeepFinger: A Cascade Convolutional Neuron Network Approach to Finger Key Point Detection in Egocentric Vision with Mobile Camera
16
Hand pose recognition from monocular images by geometrical and texture analysis
17
Real time finger tracking and contour detection for gesture recognition using OpenCV
18
Adam: A Method for Stochastic Optimization
19
Very Deep Convolutional Networks for Large-Scale Image Recognition
20
MixFab: a mixed-reality environment for personal fabrication
21
Markerless 3D gesture-based interaction for handheld Augmented Reality interfaces
22
Hand Gesture Recognition Systems: A Survey
23
Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system
24
United Arab Emirates
25
Hand gesture-based tangible interactions for manipulating virtual objects in a mixed reality environment
26
Hand gesture recognition using a neural network shape fitting technique
27
Vision-based 3D finger interactions for mixed reality games with physics simulation
28
Color Based Hand and Finger Detection Technology for User Interaction
29
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking
30
Unified gesture-based interaction techniques for object manipulation and navigation in a large-scale virtual environment
31
Recent Advances in Augmented Reality
32
An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments
33
The go-go interaction technique: non-linear mapping for direct manipulation in VR
34
A Taxonomy of Mixed Reality Visual Displays
35
Comparing a Mouse and a Free Hand Gesture Interaction Technique for 3D Object Manipulation
36
Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment
37
Augmented assembly technologies based on 3D bare-hand interaction
38
Elementary linear algebra : applications version
39
A Tunnel Window and Its Variations : Seamless Teleportation Techniques in a Virtual Environment
40
Virtual Reality Technology
41
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON CYBERNETICS 1 Enhanced Computer Vision with Microsoft Kinect Sensor: A Review