notesum.ai

Published at December 9

Flexible and Scalable Deep Dendritic Spiking Neural Networks with Multiple Nonlinear Branching

cs.NE

Released Date: December 9, 2024

Authors: Yifan Huang¹, Wei Fang², Zhengyu Ma³, Guoqi Li⁴, Yonghong Tian¹

Aff.: ¹Peking University, Beijing, China.; ²Shenzhen Graduate School, Peking University, Shenzhen, China.; ³Peng Cheng Laboratory, Shenzhen, China.; ⁴Institute of Automation, Chinese Academy of Sciences, Beijing, China.

Arxiv: http://arxiv.org/pdf/2412.06355v1

Neuron Type		K rule
Dendritic Activation	#Branches	none	learnable	PFA	MA
Mexican hat	1	90.37	90.31	89.89	10.00
	2	90.04	89.95	90.60	10.00
	5	90.19	89.88	90.23	89.94
leaky ReLU	1	90.02	90.04	89.76	10.00
	2	90.36	90.45	89.64	87.68
	5	90.36	90.53	90.15	89.07
Swish	1	89.67	89.71	89.25	48.41
	2	89.63	89.96	89.58	88.35
	5	90.15	90.03	89.99	88.35
USwish	1	89.98	89.63	89.09	10.00
	2	90.18	89.72	89.57	88.20
	5	89.90	90.09	89.49	87.94
point SN		88.97	-	-	-