notesum.ai
Published at November 6Exploring the Stability Gap in Continual Learning: The Role of the Classification Head
cs.LG
cs.AI
cs.CV
Released Date: November 6, 2024
Authors: Wojciech Łapacz1, Daniel Marczak2, Filip Szatkowski2, Tomasz Trzciński
Aff.: 1Warsaw University of Technology; 2Warsaw University of Technology, IDEAS NCBR

| WC-ACC () | min-ACC () | SG() | ACC () | |
|---|---|---|---|---|
| CIFAR100/5 | ||||
| FT | 23.120.11 | 11.90.20 | 54.020.99 | 25.520.42 |
| +NMC | 34.290.60 | 29.380.68 | 23.850.88 | 35.240.78 |
| CIFAR100/10 | ||||
| FT | 13.940.39 | 7.580.32 | 63.042.57 | 21.040.31 |
| +NMC | 27.270.50 | 24.010.65 | 25.352.66 | 31.140.38 |
| ImageNet100/5 | ||||
| FT | 29.570.62 | 15.90.72 | 61.622.00 | 40.500.48 |
| +NMC | 47.271.43 | 39.241.60 | 29.851.84 | 52.150.75 |
| ImageNet100/10 | ||||
| FT | 24.81.13 | 17.451.21 | 49.202.70 | 32.380.37 |
| +NMC | 41.980.88 | 37.260.83 | 20.031.84 | 45.020.77 |