Coupling Text and Visualizations

Description

Online writers and journalism media are increasingly combining visualization (and other multimedia content) with narrative text to create narrative visualizations. Often, however, the two elements are presented independently of one another.

In this project, we seek to understand different text visualization integration forms and propose approaches to automatically integrate text and visualization elements for storytelling.

People

Qiyu Zhi

Publications

Zhi, Qiyu, Alvitta Ottley, and Ronald Metoyer. "Linking and Layout: Exploring the Integration of Text and Visualization in Storytelling." In Computer Graphics Forum, vol. 38, no. 3, pp. 675-685. 2019.
Metoyer, Ronald, Qiyu Zhi, Bart Janczuk, and Walter Scheirer. "Coupling story to visualization: Using textual analysis as a bridge between data and interpretation." In 23rd International Conference on Intelligent User Interfaces, pp. 503-507. ACM, 2018.

Demos/Software

Coupling sports story to visualizations

Coupling from text to visualization. The user has selected a passage that reads: The Warriors trailed by six with three minutes left before Durant, criticized for leaving Oklahoma City last summer to chase a championship, brought them back, scoring 14 in the fourth. Story excerpt from the Associated Press.

Exploring Text and Visualization Integration in Storytelling

The study interfaces for original and slideshow layout with linking study condition. It shows that the explanatory visualization elements are highlighted when participants hovering over the first sentence of the second paragraph in section ``Some Have Prospered''.

The study interfaces for slideshow layout with linking study condition. It shows that the explanatory visualization elements are highlighted when participants hovering over the first sentence of the second paragraph in section ``Some Have Prospered''.

Report abuse