notesum.ai

Published at November 20

FabuLight-ASD: Unveiling Speech Activity via Body Language

cs.CV

cs.AI

cs.NE

cs.SD

Released Date: November 20, 2024

Authors: Hugo Carneiro¹, Stefan Wermter¹

Aff.: ¹Universität Hamburg

Arxiv: http://arxiv.org/abs/2411.13674v1

Refer to caption

Model	OC	SI	FO	HVN	SS	Overall
ASC [2]	91.2	92.3	87.1	66.8	72.2	85.7
MAAS [3]	90.7	92.6	87.0	67.0	76.5	86.4
ASDNet [22]	96.5	97.4	92.1	77.4	77.8	92.0
TalkNet (face + audio) [38]	95.8	97.5	93.1	81.4	77.5	92.3
TS-TalkNet [19]	96.8	97.9	94.4	84.0	79.3	93.1
Light-ASD [23]	97.8	98.3	95.4	84.7	77.9	93.7
TalkNet (body + audio) [32]	91.1	95.5	88.4	73.1	75.0	—
TalkNet (face + body + audio) [32]	96.9	98.1	95.4	83.8	81.5	—
FabuLight-ASD (upper body)	97.7	98.6	96.1	86.4	77.3	94.3
FabuLight-ASD (whole body)	98.1	98.6	96.0	85.6	77.1	94.0