Exploring the effects of mixed reality agents' locomotion and postures on social perception through a board game

dc.contributor.authorChang, Z.
dc.contributor.authorCao, J.
dc.contributor.authorGupta, K.
dc.contributor.authorBai, H.
dc.contributor.authorBillinghurst, M.
dc.date.issued2024
dc.description.abstractNon-verbal cues like locomotion and posture influence users’ perceptions of Mixed Reality Agents (MiRAs). While Electroencephalography (EEG) captures cognitive responses, the influence of MiRAs’ locomotion and postures on brain activity remains underexplored. Additionally, few studies integrate subjective and behavioral measures with EEG to evaluate these cues’ impact on social perception. To address this, we conducted a within-subject study where participants played Gobang against three virtual agents in mixed reality: 1) a speech-only agent (S), 2) an embodied agent with speech and locomotion (S + L), and 3) an embodied agent with speech, locomotion, and posture (S + L + P). Results showed the S + L + P agent had higher engagement measured by the questionnaire but a lower EEG-based engagement index at AF3 than the S + L agent. Besides, the S + L + P was also rated higher in social presence, engagement, and emotional arousal than the S condition; No behavioral differences were observed. We discuss how MiRAs’ locomotion and posture affect users’ social perception and provide design implications for future human-agent interactions.
dc.identifier.citationInternational Journal of Human-Computer Interaction, online, 2024; online(17):1-19
dc.identifier.doi10.1080/10447318.2024.2435694
dc.identifier.issn1044-7318
dc.identifier.issn1532-7590
dc.identifier.urihttps://hdl.handle.net/11541.2/41225
dc.language.isoen
dc.publisherTaylor & Francis Inc.
dc.relation.fundingChina Scholarship Council 202008320270
dc.rightsCopyright 2024 Taylor & Francis Group
dc.source.urihttps://doi.org/10.1080/10447318.2024.2435694
dc.subjectEEG
dc.subjectengagement
dc.subjectmixed reality
dc.subjectvirtual agents
dc.titleExploring the effects of mixed reality agents' locomotion and postures on social perception through a board game
dc.typeJournal article
pubs.publication-statusPublished
ror.mmsid9916927225501831

Files

Collections