notesum.ai

Published at December 9

Subgraph-Oriented Testing for Deep Learning Libraries

cs.SE

Released Date: December 9, 2024

Authors: Xiaoyuan Xie¹, Yan Song¹, Songqiang Chen², Jinfu Chen¹

Aff.: ¹School of Computer Science, Wuhan University, China; ²Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, China

Arxiv: http://arxiv.org/pdf/2412.06430v1

API	FreeFuzz-C	FreeFuzz-P	DeepREL-S	DeepREL-V	DocTer	ACETest-G	ACETest-C	TitanFuzz	SORT
flatten	75.64%	75.64%	84.75%	86.66%	62.23%	0.10%	0.14%	69.59%	100.00%
__mul__	80.26%	80.19%	89.05%	88.97%	28.82%	44.13%	43.50%	47.42%	100.00%
div	80.39%	50.43%	88.65%	89.93%	71.17%	44.17%	44.52%	67.02%	100.00%
softmax	54.35%	2.85%	73.86%	/	33.04%	22.37%	18.05%	46.88%	100.00%
adaptive_avg_pool2d	53.30%	31.05%	/	/	/	/	/	39.60%	100.00%
matmul	58.79%	4.33%	79.49%	78.13%	2.44%	6.70%	6.71%	40.97%	100.00%
max_pool2d	14.38%	0.03%	56.09%	/	3.71%	0.00%	0.00%	45.58%	100.00%
batch_norm	45.75%	2.01%	/	/	2.44%	0.15%	0.13%	36.87%	100.00%
dropout	55.59%	32.86%	/	/	53.62%	79.74%	79.74%	56.21%	100.00%
relu	97.66%	3.16%	/	97.94%	74.85%	/	/	53.76%	100.00%
conv2d	12.04%	0.05%	/	/	0.22%	0.00%	0.00%	18.86%	100.00%
gelu	93.72%	0.36%	/	/	/	/	/	53.91%	100.00%
linear	50.66%	0.30%	/	/	1.29%	0.15%	0.17%	/	100.00%
layer_norm	31.67%	0.00%	/	/	3.86%	0.00%	0.00%	24.53%	100.00%
__add__	71.38%	71.23%	80.39%	81.83%	27.64%	27.22%	27.36%	55.93%	100.00%
Total	40.44%	7.15%	77.18%	86.79%	11.00%	6.80%	6.72%	41.54%	100.00%