Gazing at Social Interactions Between Foraging and Decision Theory
TL
TL;DR
The audio-visual landscape of social interactions is distilled into a number of multimodal patches that convey different social value, and the general frame of foraging as a tradeoff between local patch exploitation and landscape exploration is worked under.
Abstract
Finding the underlying principles of social attention in humans seems to be essential for the design of the interaction between natural and artificial agents. Here, we focus on the computational modeling of gaze dynamics as exhibited by humans when perceiving socially relevant multimodal information. The audio-visual landscape of social interactions is distilled into a number of multimodal patches that convey different social value, and we work under the general frame of foraging as a tradeoff between local patch exploitation and landscape exploration. We show that the spatio-temporal dynamics of gaze shifts can be parsimoniously described by Langevin-type stochastic differential equations triggering a decision equation over time. In particular, value-based patch choice and handling is reduced to a simple multi-alternative perceptual decision making that relies on a race-to-threshold between independent continuous-time perceptual evidence integrators, each integrator being associated with a patch.
References85 items
1
Speech Envelope Dynamics for Noise-Robust Auditory Scene Analysis in Robotics
2
Gravitational Laws of Focus of Attention
3
Social Visual Perception Under the Eye of Bayesian Theories in Autism Spectrum Disorder Using Advanced Modeling of Spatial and Temporal Parameters
4
On Gaze Deployment to Audio-Visual Cues of Social Interactions
5