notesum.ai
Published at November 26LiteVAR: Compressing Visual Autoregressive Modelling with Efficient Attention and Quantization
cs.CV
Released Date: November 26, 2024
Authors: Rui Xie1, Tianchen Zhao1, Zhihang Yuan1, Rui Wan2, Wenxi Gao1, Zhenhua Zhu1, Xuefei Ning1, Yu Wang1
Aff.: 1Tsinghua University; 2Fudan University

| Threshold | FLOPs Saving(%) | FID() | IS() | Image Reward() |
|---|---|---|---|---|
| 1 | 0.00 | 13.39 | 257.34 | -0.28 |
| 0.95 | 70.34 | 13.47 | 260.95 | -0.28 |
| 0.90 | 73.43 | 13.50 | 261.45 | -0.29 |
| 0.85 | 75.47 | 13.72 | 259.54 | -0.31 |
| 0.80 | 76.82 | 13.77 | 258.45 | -0.34 |
| 0.70 | 79.36 | 13.94 | 254.17 | -0.40 |
| 0.60 | 81.39 | 14.39 | 250.97 | -0.48 |