Semi-Supervised Haptic Material Recognition for Robots using Generative Adversarial Networks (2017-07-10T00:00:00.000000Z)

TL;DR

This work presents a semi-supervised learning approach for material recognition that uses generative adversarial networks (GANs) with haptic features such as force, temperature, and vibration and explores how well this approach can recognize the material of new objects.

Abstract

Material recognition enables robots to incorporate knowledge of material properties into their interactions with everyday objects. For example, material recognition opens up opportunities for clearer communication with a robot, such as "bring me the metal coffee mug", and recognizing plastic versus metal is crucial when using a microwave or oven. However, collecting labeled training data with a robot is often more difficult than unlabeled data. We present a semi-supervised learning approach for material recognition that uses generative adversarial networks (GANs) with haptic features such as force, temperature, and vibration. Our approach achieves state-of-the-art results and enables a robot to estimate the material class of household objects with ~90% accuracy when 92% of the training data are unlabeled. We explore how well this approach can recognize the material of new objects and we discuss challenges facing generalization. To motivate learning from unlabeled training data, we also compare results against several common supervised learning classifiers. In addition, we have released the dataset used for this work which consists of time-series haptic measurements from a robot that conducted thousands of interactions with 72 household objects.

Authors

C. Kemp

6 papers

Zackory Erickson

4 papers

S. Chernova

5 papers

Semi-Supervised Haptic Material Recognition for Robots using Generative Adversarial Networks

TL;DR

Abstract

Authors

References27 items

Shape-independent hardness estimation using deep learning and a GelSight tactile sensor

Learning to identify container contents through tactile vibration signatures

Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network

Improved Techniques for Training GANs

Data-driven thermal recognition of contact with people and objects

Deep learning for tactile understanding from visual and haptic data

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks

Adversarial Autoencoders

Deep multi-scale video prediction beyond mean square error

Tactile Object Recognition with Semi-Supervised Learning

Material Recognition from Heat Transfer given Varying Initial Conditions and Short-Duration Contact

Semi-supervised Learning with Ladder Networks

Adam: A Method for Stochastic Optimization

Material recognition in the wild with the Materials in Context Database

Very Deep Convolutional Networks for Large-Scale Image Recognition

Semi-supervised Learning with Deep Generative Models

Grounding semantic categories in behavioral interactions: Experiments with 100 objects

Material classification based on thermal properties — A robot and human evaluation

Recent advances in deep learning for speech research at Microsoft

Using robotic exploratory procedures to learn the meaning of haptic adjectives

Tactile-Data Classification of Contact Materials Using Computational Intelligence

Et al

Robust material discrimination by a soft anthropomorphic finger with tactile and thermal sense

Stane: synthesized surfaces for tactile input

GENERATIVE ADVERSARIAL NETS

Keras

Field of Study

Venue Information

Name

Type

URL

Alternate Names