notesum.ai

Published at December 3

OMENN: One Matrix to Explain Neural Networks

cs.LG

cs.AI

cs.CV

Released Date: December 3, 2024

Authors: Adam Wróbel, Mikołaj Janusz, Bartosz Zieliński, Dawid Rymarczyk

Arxiv: http://arxiv.org/pdf/2412.02399v1

Refer to caption

	$x_{0}=-4$	$x_{1}=-0.75$
$\nabla_{x}$	0	0
$\Omega_{w}(x)$	0	0.22
$\nabla_{x}\cdot x$	0	0
$\Omega_{w}(x)\cdot x$	0	-0.17
${GELU(x)}$	0	-0.17