May I Still Define Myself? Exploring How Dissonance in Displaying Personal Information Through Head-Mounted Augmented Reality Can Affect Personal Information Sovereignty

Head-mounted Augmented Reality enables individuals to overlay digital information onto the physical world, consequently influencing how they assess and react to augmented social situations. While prior work has shown that augmenting social situations with faithful personal information can benefit a conversation, honest mistakes or an attempt to deceive might lead to a dissonance between augmentation and verbally disclosed information. In this work, we take the first steps towards understanding the happenings in case of information dissonance by conducting a preliminary within-subject online video study (N=30), investigating how it affects users, perception of the interlocutor, and if augmentation or interlocutor would act as the more trusted instance. We found that only 26.7% trusted the interlocutor’s verbally uttered information, while a majority believed the AR device (46.7%) or were undecided (26.7%). We discuss this split in trust and argue for the importance of and factors for a follow-up study on this topic.