notesum.ai
Published at November 5Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight
cs.LG
cs.AI
Released Date: November 5, 2024
Authors: Tao Huang, Qingyu Huang, Xin Shi, Jiayang Meng, Guolong Zheng, Xu Yang, Xun Yi

| Datasets and Models | Differentially Private Methods | ||||
|---|---|---|---|---|---|
| DP-SGD | Auto-S/NSGD | DP-PSAC | DP-PSASC | DP-PSASC* | |
| MNIST(CNN) | 97.35 | 97.95 | 98.11 | 98.37() | 98.65() |
| FashionMNIST(CNN) | 85.59 | 86.15 | 86.36 | 86.91() | 87.22() |
| CIFAR10(SimCLR) | 92.24 | 92.65 | 92.85 | 93.12() | 93.36() |
| CelebA([Male])(ResNet9) | 94.79 | 95.12 | 95.2 | 95.36() | 95.61(s=0.45) |
| Imagenette(ResNet9) | 63.61 | 63.87 | 64.21 | 65.26() | 66.79() |