reasoning-2

Theory of Mind Modeling

3260 papers • 126 benchmarks • 313 datasets

This task has no description! Would you like to contribute one?

(Image credit: Papersgraph)

Benchmarks

These leaderboards are used to track progress in theory-of-mind-modeling-2

Trend

Dataset

Best Model

Actions

No benchmarks available.

Libraries

i

Use these libraries to find theory-of-mind-modeling-2 models and implementations

Datasets

MMToM-QA

2D-ATOMS

Subtasks

No subtasks available.

Most implemented papers

MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks

J. Chai, Cristian-Paul Bara, Sky CH-Wang•Sun Sep 12 2021

A fine-grained dataset of collaborative tasks performed by pairs of human subjects in the 3D virtual blocks world of Minecraft is introduced to enable theory of mind modeling in situated interactions.

78

Content

0

Paper Graph

Collective Intelligence in Human-AI Teams: A Bayesian Theory of Mind Approach

Christoph Riedl, Samuel Westby•Tue Aug 23 2022

It is found that humans struggle to fully integrate information from teammates into their decisions, especially when communication load is high, and have cognitive biases which lead them to underweight certain useful, but ambiguous, information.

30 0

Paper Graph

Towards Collaborative Plan Acquisition through Theory of Mind Modeling in Situated Dialogue

J. Shah, J. Chai, Cristian-Paul Bara, Ziqiao Ma, Yingzhuo Yu•Wed May 17 2023

A novel problem for agents to predict the missing task knowledge for themselves and for their partners based on rich perceptual and dialogue history is formulated and empirical results suggest that predicting the partner's missing knowledge is a more viable approach than predicting one's own.

11 0

Paper Graph

Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models

Ziqiao Ma, Jacob Sansom, Run Peng, Joyce Chai•Sun Oct 29 2023

This position paper argues for a holistic and situated evaluation of ToM to break ToM into individual components and treat LLMs as an agent who is physically situated in environments and socially situated in interactions with humans.

28 0

Paper Graph

MMToM-QA: Multimodal Theory of Mind Question Answering

T. Ullman, Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Antonio Torralba, Joshua B. Tenenbaum, Tianmin Shu•Mon Jan 15 2024

A multimodal Theory of Mind question answering (MMToM-QA) benchmark is introduced and a systematic comparison of human performance, BIP-ALM, and state-of-the-art models, including GPT-4 are compared.

69 0

Paper Graph

Adding a benchmark result helps the community track progress.