Towards Natural Language-Based Visualization Authoring

A key challenge to visualization authoring is the process of getting familiar with the complex user interfaces of authoring tools. Natural Language Interface (NLI) presents promising benefits due to its learnability and usability. However, supporting NLIs for authoring tools requires expertise in na...

Description complète

Détails bibliographiques
Publié dans:IEEE transactions on visualization and computer graphics. - 1996. - 29(2023), 1 vom: 18. Jan., Seite 1222-1232
Auteur principal: Wang, Yun (Auteur)
Autres auteurs: Hou, Zhitao, Shen, Leixian, Wu, Tongshuang, Wang, Jiaqi, Huang, He, Zhang, Haidong, Zhang, Dongmei
Format: Article en ligne
Langue:English
Publié: 2023
Accès à la collection:IEEE transactions on visualization and computer graphics
Sujets:Journal Article
LEADER 01000caa a22002652c 4500
001 NLM34713260X
003 DE-627
005 20250303222646.0
007 cr uuu---uuuuu
008 231226s2023 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2022.3209357  |2 doi 
028 5 2 |a pubmed25n1156.xml 
035 |a (DE-627)NLM34713260X 
035 |a (NLM)36197854 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Wang, Yun  |e verfasserin  |4 aut 
245 1 0 |a Towards Natural Language-Based Visualization Authoring 
264 1 |c 2023 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 05.04.2023 
500 |a Date Revised 05.04.2023 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a A key challenge to visualization authoring is the process of getting familiar with the complex user interfaces of authoring tools. Natural Language Interface (NLI) presents promising benefits due to its learnability and usability. However, supporting NLIs for authoring tools requires expertise in natural language processing, while existing NLIs are mostly designed for visual analytic workflow. In this paper, we propose an authoring-oriented NLI pipeline by introducing a structured representation of users' visualization editing intents, called editing actions, based on a formative study and an extensive survey on visualization construction tools. The editing actions are executable, and thus decouple natural language interpretation and visualization applications as an intermediate layer. We implement a deep learning-based NL interpreter to translate NL utterances into editing actions. The interpreter is reusable and extensible across authoring tools. The authoring tools only need to map the editing actions into tool-specific operations. To illustrate the usages of the NL interpreter, we implement an Excel chart editor and a proof-of-concept authoring tool, VisTalk. We conduct a user study with VisTalk to understand the usage patterns of NL-based authoring systems. Finally, we discuss observations on how users author charts with natural language, as well as implications for future research 
650 4 |a Journal Article 
700 1 |a Hou, Zhitao  |e verfasserin  |4 aut 
700 1 |a Shen, Leixian  |e verfasserin  |4 aut 
700 1 |a Wu, Tongshuang  |e verfasserin  |4 aut 
700 1 |a Wang, Jiaqi  |e verfasserin  |4 aut 
700 1 |a Huang, He  |e verfasserin  |4 aut 
700 1 |a Zhang, Haidong  |e verfasserin  |4 aut 
700 1 |a Zhang, Dongmei  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 29(2023), 1 vom: 18. Jan., Seite 1222-1232  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnas 
773 1 8 |g volume:29  |g year:2023  |g number:1  |g day:18  |g month:01  |g pages:1222-1232 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2022.3209357  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 29  |j 2023  |e 1  |b 18  |c 01  |h 1222-1232