notesum.ai

Published at November 7

CUIfy the XR: An Open-Source Package to Embed LLM-powered Conversational Agents in XR

cs.HC

cs.AI

Released Date: November 7, 2024

Authors: Kadir Burak Buldu¹, Süleyman Özdel, Ka Hei Carrie Lau¹, Mengdi Wang¹, Daniel Saad¹, Sofie Schönborn, Auxane Boch¹, Enkelejda Kasneci¹, Efe Bozkir¹

Aff.: ¹Technical University of Munich (TUM)

Arxiv: http://arxiv.org/abs/2411.04671v1

Name

Speech to Text

Large Language Model

Text to Speech

Streaming

Local

OpenAI

Whisper

Whisper-tiny (local)

GPT 3.5

GPT 4

GPT 4o

GPT 4o-mini

TTS

✓

\times

Amazon

Transcribe

\times

Polly

✓

\times

Google

\times

Gemini 1.0 Pro

Gemini 1.5 Pro

Gemini 1.5 Flash

\times

✓

\times