notesum.ai

Published at October 21

Centrality-aware Product Retrieval and Ranking

cs.CV

cs.AI

Released Date: October 21, 2024

Authors: Hadeel Saadany¹, Swapnil Bhosale¹, Samarth Agrawal², Diptesh Kanojia¹, Constantin Orasan³, Zhe Wu²

Aff.: ¹Institute for People-Centred AI, University of Surrey, United Kingdom; ²eBay Inc., USA; ³Centre for Translation Studies, University of Surrey, United Kingdom

Arxiv: https://arxiv.org/abs/2410.15930v1

Encoder	UCO	$\textbf{Precision}@k~{}(\uparrow)$			$\textbf{Recall}@k~{}(\uparrow)$			$\textbf{NDCG}@k~{}(\uparrow)$			MRR ( $\uparrow$ )
		3	5	10	3	5	10	3	5	10	@10
CQ test
BERT	✗	$16.20$	$13.03$	$8.93$	$11.31$	$14.41$	$18.83$	$0.1912$	$0.1818$	$0.1833$	$0.2771$
eBERT	✗	$20.71$	$17.25$	$12.54$	$14.46$	$19.19$	$26.26$	$0.2392$	$0.2330$	$0.2430$	$0.3415$
eBERT	✓	$64.76$	$55.74$	$39.22$	$49.63$	$63.92$	$79.65$	$0.7439$	$0.7488$	$0.7672$	$0.8189$
eBERT (siam)	✗	$55.25$	$48.33$	$34.90$	$42.36$	$56.09$	$72.22$	$0.6315$	$0.6428$	$0.6704$	$0.7263$
eBERT (siam)	✓	$66.25$	$57.16$	$40.20$	$51.18$	$65.79$	$81.66$	$0.7635$	$0.7698$	$0.7886$	$0.8347$
CQ-balanced test
BERT	✗	$7.13$	$4.94$	$2.95$	$21.26$	$24.58$	$29.33$	$0.1824$	$0.1961$	$0.2115$	$0.1862$
eBERT	✗	$9.72$	$6.94$	$4.22$	$29.02$	$34.58$	$42.07$	$0.2428$	$0.2657$	$0.2899$	$0.2495$
eBERT	✓	$28.57$	$18.15$	$9.50$	$85.40$	$90.42$	$94.62$	$0.7851$	$0.8059$	$0.8197$	$0.7789$
eBERT (siam)	✗	$25.99$	$16.68$	$8.89$	$77.66$	$83.08$	$88.59$	$0.6888$	$0.7112$	$0.7291$	$0.6784$
eBERT (siam)	✓	$29.19$	$18.39$	$9.58$	$87.26$	$91.58$	$95.43$	$0.8046$	$0.8225$	$0.8351$	$0.7965$
CQ-common-str test
BERT	✗	$9.41$	$6.31$	$3.65$	$28.15$	$31.47$	$36.35$	$0.2532$	$0.2669$	$0.2828$	$0.2579$
eBERT	✗	$12.62$	$8.64$	$5.00$	$37.79$	$43.10$	$49.92$	$0.3272$	$0.3491$	$0.3714$	$0.3315$
eBERT	✓	$32.03$	$19.58$	$9.92$	$95.84$	$97.65$	$98.87$	$0.9091$	$0.9166$	$0.9206$	$0.8979$
eBERT (siam)	✗	$29.93$	$18.76$	$9.68$	$89.57$	$93.58$	$96.50$	$0.8194$	$0.8361$	$0.8456$	$0.8063$
eBERT (siam)	✓	$32.12$	$19.64$	$9.92$	$96.11$	$97.94$	$98.93$	$0.9117$	$0.9193$	$0.9226$	$0.9003$
CQ-alphanum test
BERT	✗	$20.54$	$16.65$	$11.47$	$13.45$	$17.32$	$22.82$	$0.2333$	$0.2176$	$0.2226$	$0.3350$
eBERT	✗	$23.35$	$19.54$	$13.77$	$15.53$	$20.76$	$27.85$	$0.2630$	$0.2516$	$0.2617$	$0.3739$
eBERT	✓	$64.58$	$57.27$	$40.35$	$44.05$	$59.97$	$77.00$	$0.7119$	$0.7094$	$0.7344$	$0.8018$
eBERT (siam)	✗	$60.67$	$54.10$	$38.54$	$41.32$	$57.10$	$74.20$	$0.6652$	$0.6654$	$0.6951$	$0.7618$
eBERT (siam)	✓	$67.10$	$59.70$	$41.81$	$46.07$	$62.72$	$79.76$	$0.7375$	$0.7371$	$0.7609$	$0.8171$