notesum.ai

Published at November 20

Closer Look at Efficient Inference Methods: A Survey of Speculative Decoding

cs.CL
cs.AI

Released Date: November 20, 2024

Authors: Hyun Ryu, Eric Kim

Arxiv: http://arxiv.org/abs/2411.13157v1