notesum.ai

Published at November 14

cs.LG

cs.AI

cs.CV

cs.NE

Released Date: November 14, 2024

Authors: Alexander C. Li¹, Yuandong Tian², Beidi Chen¹, Deepak Pathak¹, Xinlei Chen²

Aff.: ¹Carnegie Mellon University; ²FAIR

method	acc.
scratch	83.0
fine-tune	85.7
attn. copy	85.1
attn. copy from fine-tuned	85.6
attn. distill	85.7
ensemble attn. distill $+$ fine-tune	86.3