notesum.ai

Published at October 23

OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation

cs.CL

cs.AI

Released Date: October 23, 2024

Authors: Qinglin Zhang¹, Luyao Cheng¹, Chong Deng¹, Qian Chen¹, Wen Wang¹, Siqi Zheng¹, Jiaqing Liu¹, Hai Yu¹, Chaohong Tan¹

Aff.: ¹Tongyi Lab

Arxiv: https://arxiv.org/abs/2410.17799v1

Refer to caption

	Librispeech(CER)		WenetSpeech(CER)
Model	test_clean $\downarrow$	test_other $\downarrow$	test_meeting $\downarrow$
ASR
OmniFlatten (Ours)	9.46	22.48	31.76
Whisper V3	3.71	5.74	19.91
TTS
OmniFlatten (Ours)	10.9	12.87	50.56
GT Speech Tokens	5.82	12.74	40.18