STUDIO FOR NARRATIVE SPACES

Project

Vistoria

Summary

"Stories are created, not written."

Humans think visually-we remember in images, dream in pictures, and use visual metaphors to communicate. Yet, most creative. writing tools remain text-centric, limiting how writers plan and translate ideas. We present Vistoria, a system for synchronized image-text co-editing in fictional story writing. A formative Wizard-of-Oz co-design study with 10 story writers revealed how sketches, images, and text serve as essential elements for ideation and organization. Drawing on theories of Instrumental Interaction, Vistoria introduces instrumental operations-Lasso, Collage, Perspective Shift, and Filter that enable seamless narrative exploration across modalities. A controlled study with 12 participants shows that co-editing enhances expressiveness, immersion, and collaboration, opening space for writers to follow divergent story directions and craft more vivid, detailed narratives. While multimodality increased cognitive demand, participants reported stronger senses of ownership and agency. These findings demonstrate how multimodal co-editing expands creative potential by balancing abstraction and concreteness in narrative development.

Publication: Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI'26), arxiv.

People

Kexue Fu, Lucy Ling, Jingfei Huang, RAY LC, Toby Li

Tech

hci, machine learning, web

Venues

City University of Hong Kong, University of Notre Dame, Harvard University, Tongji University

Year

2026