New Way to Measure Group Dynamics in eXtended Reality (XR): DIS Wins the Best Paper Award
Publication date: 2025-10-10
Postdoctoral researcher Sam Van Damme has won the Best Paper Award at the 17th International Conference on Quality of Multimedia Experience (QoMEX’25). QoMEX is an annual international conference that focuses on research related to the quality and experience of multimedia technology.
Van Damme won the Award for his article “From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR”. The paper is the result of the scientific sabbatical of three months at CWI, Distributed and Interactive Systems group, of the postdoctoral researcher Sam Van Damme from Ghent University. The article is co-authored by Jack Jansen (CWI), Silvia Rossi (CWI), and Pablo Cesar (CWI and TU Delft).
Focus on Group Dynamics in XR
To truly measure the success of an XR team application, the research focuses less on individual technical satisfaction and more on the group’s collective understanding and connection. To do so, Van Damme explores a novel approach for evaluating collaborative and social eXtended Reality (XR) experiences. Beyond the more traditional individual metrics used by the community, such as Quality of Experience (QoE) or Sense of Presence (SoP), this article proposes a metric based on group level dynamics: Shared Mental Model (SMM). This metric, coming from Psychology, measures the strength and congruence of the dynamics of a group. A high SMM is already known in team psychology to be crucial for effective collaboration and better performance.
Results: A Strong Shared Understanding is Possible in XR
To better understand how to explore this construct, we ran a prototypical experiment where two users worked together on a block-building task. The influence of asymmetric latency (delay) was manipulated, meaning one collaborator might experience a different amount of lag than the other.
The results showed that even in an XR context, a strong SMM can still form among collaborators, even when those users have very different roles and behaviors, and are working under the stress of unequal technical conditions (like asymmetric lag).
This work is one further step of the DIS group on the exploration of metrics and protocols to adequately evaluate Social XR experiences, mixing subjective and objective methods. Apart from award-winning articles, the work has resulted in open source software and datasets, and in standardization activities in ITU.
More Information:
