Computational Models of Naturalistic Conversations

People Involved:
  • Dongwon Oh, Department of Psychology, National University of Singapore
  • Ding Xiaopan​, Department of Psychology, National University of Singapore
  • Song Zhaoli, Department of Business, National University of Singapore
  • Wang Wanjie, Department of Statistics and Data Science, National University of Singapore
Description

Our project studies how impressions of a conversation partner change from moment to moment during everyday interactions. Using multi-camera video and audio, we extract second-by-second visual, speech, and language cues and align them with continuous, real-time trait ratings collected during playback. We then build computational models that forecast impression trajectories and pinpoint conversational states where perceptions shift. The work advances basic science of social cognition and informs applied domains such as teamwork, hiring, and cross-cultural communication.

Example conversation frame with automatic body-pose tracking; below, a line graph plots several colored curves across time points, summarizing changing conversation dynamics derived from many features.
Example conversation frame with automatic body-pose tracking; below, a line graph plots several colored curves across time points, summarizing changing conversation dynamics derived from many features.
Scroll to Top