Talk to the Wall: The Role of Speech Interaction in Collaborative Visual Analytics - Extreme Situated Interaction
Journal Articles IEEE Transactions on Visualization and Computer Graphics Year : 2025

Talk to the Wall: The Role of Speech Interaction in Collaborative Visual Analytics

Abstract

We present the results of an exploratory study on how pairs interact with speech commands and touch gestures on a wall-sized display during a collaborative sensemaking task. Previous work has shown that speech commands, alone or in combination with other input modalities, can support visual data exploration by individuals. However, it is still unknown whether and how speech commands can be used in collaboration, and for what tasks. To answer these questions, we developed a functioning prototype that we used as a technology probe. We conducted an in-depth exploratory study with 10 participant pairs to analyze their interaction choices, the interplay between the input modalities, and their collaboration. While touch was the most used modality, we found that participants preferred speech commands for global operations, used them for distant interaction, and that speech interaction contributed to the awareness of the partner's actions. Furthermore, the likelihood of using speech commands during collaboration was related to the personality trait of agreeableness. Regarding collaboration styles, participants interacted with speech equally often whether they were in loosely or closely coupled collaboration. While the partners stood closer to each other during close collaboration, they did not distance themselves to use speech commands. From our findings, we derive and contribute a set of design considerations for collaborative and multimodal interactive data analysis systems.
Fichier principal
Vignette du fichier
Leon_2025_Talking.pdf (6.46 Mo) Télécharger le fichier
Vignette du fichier
Leon_2025_Talking.png.jpg (110.76 Ko) Télécharger le fichier
Origin Files produced by the author(s)
licence
Format Figure, Image
licence

Dates and versions

hal-04845442 , version 1 (18-12-2024)

Licence

Identifiers

Cite

Gabriela Molina León, Anastasia Bezerianos, Olivier Gladin, Petra Isenberg. Talk to the Wall: The Role of Speech Interaction in Collaborative Visual Analytics. IEEE Transactions on Visualization and Computer Graphics, 2025, 31 (1), pp.941--951. ⟨10.1109/tvcg.2024.3456335⟩. ⟨hal-04845442⟩
0 View
0 Download

Altmetric

Share

More