DASH: A Bimodal Data Exploration Tool for Interactive Text and Visualizations

IEEE Transactions on Visualization and Computer Graphics, VIS 2024 (October 13 - 28, 2024 in St. Pete Beach, Florida, USA.)

Integrating textual content, such as titles, annotations, and captions, with visualizations facilitates comprehension and takeaways during data exploration. Yet current tools often lack mechanisms for integrating meaningful long-form prose with visual data. This paper introduces DASH, a bimodal data exploration tool that supports integrating semantic levels into the interactive process of visualization and text-based analysis. DASH operationalizes a modified version of Lundgard et al.’s semantic hierarchy model that categorizes data descriptions into four levels ranging from basic encodings to high-level insights. By leveraging this structured semantic level framework and a large language model’s text generation capabilities, DASH enables the creation of data-driven narratives via drag-and-drop user interaction. Through a preliminary user evaluation, we discuss the utility of DASH’s text and chart integration capabilities when participants perform data exploration with the tool.

Author(s)

Tableau Author(s)

Dennis Bromley, Vidya Setlur