notesum.ai

Published at November 6

Interactions Across Blocks in Post-Training Quantization of Large Language Models

cs.LG
cs.AI
cs.CL

Released Date: November 6, 2024

Authors: Khasmamad Shabanovi1, Lukas Wiest2, Vladimir Golkov, Daniel Cremers3, Thomas Pfeil2

Aff.: 1Recogni, Technical University of Munich; 2Recogni; 3Technical University of Munich

Arxiv: http://arxiv.org/abs/2411.03934v1