notesum.ai

Published at December 10

Ask Humans or AI? Exploring Their Roles in Visualization Troubleshooting

cs.HC

Released Date: December 10, 2024

Authors: Shuyu Shen¹, Sirong Lu¹, Leixian Shen², Zhonghua Sheng², Nan Tang², Yuyu Luo²

Aff.: ¹The Hong Kong University of Science and Technology (Guangzhou); ²The Hong Kong University of Science and Technology

Arxiv: http://arxiv.org/pdf/2412.07673v1

Experimental Results (Accuracy)

Count

Question Types (Operation Details)

Forum-based

Solutions

GPT-4V

Zero-Shot

GPT-4V

(+Doc)

GPT-4V

(+Ex.)

GPT-4V

(+Doc and Ex.)

View

90%

40%

65%

55%

40%

Color chart with specific colors (Scale, Condition)

83.3%

50%

100%

66.7%

Add line mark (Rule Properties/Config)

75%

50%

Conditional grid format (Grid)

100%

Discontinuous issue (Discrete Scales)

100%

Hide legend and normalise size (Legends, Circle Properties/Config)

100%

Overlay text (Stack, Calculate, Join Aggregate)

100%

33.3%

66.7%

33.3%

Text format (Format, Time Unit)

100%

25%

50%

25%

Data Transformation

100%

33.3%

44.4%

27.8%

50%

Data sorting (Window, Calculate, Sort, Order Channel)

100%

33.3%

16.7%

50%

Data structure (Flatten, Fold, Calculate)

100%

33.3%

50%

33.3%

66.7%

Data transformation (Aggregate, Window, Join aggregate)

100%

33.3%

Topn (Window, Filter, Aggregate)

100%

66.7%

Composition and Layout

100%

40%

60%

40%

Create scatter matrix (Pivot, Repeat)

100%

Field appears in the wrong chart (Concatenate)

100%

Independent color in concatenated plot (Resolve)

100%

Share axes in concatenated plot (Resolve)

100%

50%

100%

Selection and Interaction

100%

25%

50%

25%

Add tooltip (Tooltip Based on Encoding, Tooltip Based on Data Point)

100%

50%

Clicking on the main bar chart (Using Parameters Data Extents)

100%

Select at a distance (Point Selection Properties)

100%

Overall Accuracy

95.7%

31.9%

51.1%

44.7%

42.6%