notesum.ai

Published at December 6

StableVC: Style Controllable Zero-Shot Voice Conversion with Conditional Flow Matching

eess.AS

cs.SD

Released Date: December 6, 2024

Authors: Jixun Yao¹, Yuguang Yan², Yu Pan², Ziqian Ning¹, Jiaohao Ye², Hongbin Zhou², Lei Xie¹

Aff.: ¹Northwestern Polytechnical University; ²Ximalaya Inc

Arxiv: http://arxiv.org/pdf/2412.04724v1

Refer to caption

	nMOS $\uparrow$	sMOS-p $\uparrow$	UTMOS $\uparrow$	WER $\downarrow$	SECS $\uparrow$	RTF $\downarrow$	#Param.
GT	4.33 $\pm 0.04$	-	4.24	1.61	-	-	-
LMVC	3.01 $\pm 0.05$	3.17 $\pm 0.07$	3.32	4.17	0.61	3.891	305M
VALLE-VC	3.56 $\pm 0.05$	3.65 $\pm 0.04$	3.63	3.08	0.55	3.944	302M
StyleVC	3.24 $\pm 0.07$	3.21 $\pm 0.07$	3.41	5.21	0.43	0.075	31M
NS2VC	3.32 $\pm 0.05$	3.16 $\pm 0.05$	3.49	4.88	0.44	0.337	435M
DDDM-VC	3.67 $\pm 0.07$	3.61 $\pm 0.06$	3.75	3.07	0.51	0.287	66M
SEF-VC	3.63 $\pm 0.04$	3.72 $\pm 0.05$	3.59	2.89	0.53	0.168	260M
StableVC	3.96 $\pm$ 0.04	4.04 $\pm$ 0.05	4.12	2.03	0.67	0.146	166M