notesum.ai

Published at November 21

Layer Pruning with Consensus: A Triple-Win Solution

cs.CV

Released Date: November 21, 2024

Authors: Leandro Giusti Mugnaini¹, Carolina Tavares Duarte¹, Anna H. Reali Costa, Artur Jordao¹

Aff.: ¹Escola Politécnica, Universidade de São Paulo, Brasil

Arxiv: http://arxiv.org/abs/2411.14345v1

Refer to caption

Method	$\Delta$ Acc.	FLOPs
DECORE [1] (CVPR, 2022)	+ 0.08	26.30
HALP [50] (NeurIPS, 2022)	+ 0.03	33.72
SOKS [37] (TNNLS, 2023)	+ 0.16	35.91
CKA [47] (ICPR, 2024)	+ 1.25	37.52
Consensus (Ours)	+ 0.99	37.52
GKP-TMI [67] (ICLR, 2022)	+ 0.22	43.23
GCNP [26] (IJCAI, 2022)	+ 0.13	48.31
CKA [47] (ICPR, 2024)	+ 0.86	48.78
Consensus (Ours)	+ 0.72	48.78
RLAL [15] (CVPR, 2024)	+ 0.45	50.00
UDSP [16] (CVPR, 2024)	+0.66	50.10
GNN-RL [63] (ICML, 2022)	+ 0.10	54.00
ATO [59] (CVPR, 2024)	+ 0.24	55.00
RL-MCTS [57] (WACV, 2022)	+ 0.36	55.00
WhiteBox [66] (TNNLS, 2023)	+ 0.28	55.60
CLR-RNF [35] (TNNLS, 2023)	+ 0.01	57.30
CKA [47] (ICPR, 2024)	+ 0.78	60.04
Consensus (Ours)	+ 0.60	60.04
DAIS [18] (TNNLS, 2023)	- 1.00	70.90
HRank [36] (CVPR, 2020)	- 2.54	74.09
CKA [47] (ICPR, 2024)	+ 0.08	75.05
Consensus₂₀ (Ours)	- 0.17	75.05
GCNP [26] (IJCAI, 2022)	- 0.97	77.22
CKA [47] (ICPR, 2024)	- 0.66	78.80
Consensus (Ours)	- 0.58	78.80