notesum.ai

Published at November 7

Alopex: A Computational Framework for Enabling On-Device Function Calls with LLMs

cs.AI

cs.CL

Released Date: November 7, 2024

Authors: Yide Ran¹, Zhaozhuo Xu¹, Yuhang Yao¹, Zijian Hu¹, Shanshan Han¹, Han Jin¹, Alay Dilipbhai Shah¹, Jipeng Zhang², Dimitris Stripelis¹, Tong Zhang³, Salman Avestimehr¹, Chaoyang He¹

Aff.: ¹TensorOpera Inc.; ²Hong Kong University of Science and Technology; ³University of Illinois Urbana-Champaign

Arxiv: http://arxiv.org/abs/2411.05209v1

Data Generation\Model	stabilityai/stablelm-2-1_6b	Gemma2B	Qwen1.5-1.8B	tensoropera/Fox-1-1.6B
Question:Output + func describe	0.996	0.9945	0.9954	0.989
LLM Generation (Octopus)	0.705	0.719	0.697	0.732
Function describtion + question	0.999	0.997	0.997	0.997