An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper - Laboratoire Interdisciplinaire des Sciences du Numérique Access content directly
Conference Papers Year : 2022

An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper

Kostiantyn Kucher
  • Function : Author
  • PersonId : 1167037
Nicole Sultanum
  • Function : Author
  • PersonId : 1116364
Vasiliki Simaki
  • Function : Author
  • PersonId : 1167038
Maria Skeppstedt
  • Function : Author
  • PersonId : 1167039
Barbara Plank
  • Function : Author
  • PersonId : 1167040
Jean-Daniel Fekete
Narges Mahyar
  • Function : Author
  • PersonId : 1167041

Abstract

Appropriate evaluation and experimental design are fundamental for empirical sciences, particularly in data-driven fields. Due to the successes in computational modeling of languages, for instance, research outcomes are having an increasingly immediate impact on end users. As the gap in adoption by end users decreases, the need increases to ensure that tools and models developed by the research communities and practitioners are reliable, trustworthy, and supportive of the users in their goals. In this position paper, we focus on the issues of evaluating visual text analytics approaches. We take an interdisciplinary perspective from the visualization and natural language processing communities, as we argue that the design and validation of visual text analytics include concerns beyond computational or visual/interactive methods on their own. We identify four key groups of challenges for evaluating visual text analytics approaches (data ambiguity, experimental design, user trust, and "big picture" concerns) and provide suggestions for research opportunities from an interdisciplinary perspective.
Fichier principal
Vignette du fichier
BELIV22_Evaluation_Visual_Text_Analytics (1).pdf (646.83 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03786359 , version 1 (23-09-2022)

Identifiers

Cite

Kostiantyn Kucher, Nicole Sultanum, Angel Daza, Vasiliki Simaki, Maria Skeppstedt, et al.. An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper. BELIV 2022 - IEEE Workshop on Evaluation and Beyond - Methodological Approaches to Visualization, Oct 2022, Oklahoma City, United States. pp.28-37, ⟨10.1109/BELIV57783.2022.00008⟩. ⟨hal-03786359⟩
138 View
117 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More