notesum.ai

Published at December 4

KKLIP: Knowledge Distillation Exploiting K-means Clustering for Language-Image Pre-Training

cs.AI

cs.CL

cs.CV

cs.LG

Released Date: December 4, 2024

Authors: Kuei-Chun Kao¹

Aff.: ¹University of California, Los Angeles

Arxiv: http://arxiv.org/pdf/2412.03513v1

Encoder	EM (%)
Proof-of-concept T5	90
Llama2	52.5
CLIP	35.8
KKLIP	44.4