notesum.ai
Published at November 17Different Horses for Different Courses: Comparing Bias Mitigation Algorithms in ML
cs.AI
cs.CY
Released Date: November 17, 2024
Authors: Prakhar Ganesh1, Usman Gohar2, Lu Cheng, Golnoosh Farnadi1
Aff.: 1McGill University and Mila; 2Iowa State University

| Dataset | Runtime (rounded to 5s intervals) | |||||||
|---|---|---|---|---|---|---|---|---|
| ERM | DiffDP | DiffEOdd | DiffEOpp | HSIC | LAFTR | PRemover | AdvDebias | |
| Bank | 1m 15s | 1m 15s | 1m 45s | 1m 45s | 1m 50s | 1m 46s | 1m 50s | 1m 25s |
| German | 30s | 30s | 35s | 35s | 40s | 35s | 40s | 30s |
| Adult | 1m 40s | 1m 40s | 1m 45s | 1m 45s | 2m 0s | 1m 50s | 2m 0s | 1m 40s |
| COMPAS | 30s | 30s | 30s | 30s | 30s | 30s | 30s | 30s |
| KDDCensus | 6m 45s | 6m 50s | 10m 40s | 10m 40s | 10m 5s | 10m 0s | 9m 50s | 6m 50s |
| ACS-I | 7m 10s | 7m 10s | 9m 50s | 9m 50s | 9m 50s | 9m 30s | 10m 0s | 7m 50s |
| ACS-E | 13m 40s | 13m 45s | 15m 40s | 15m 40s | 16m 20s | 15m 50s | 16m 10s | 13m 40s |
| ACS-P | 7m 20s | 7m 35s | 9m 50s | 9m 50s | 9m 40s | 10m 5s | 10m 5s | 7m 40s |
| ACS-M | 4m 40s | 4m 45s | 6m 5s | 6m 5s | 6m 0s | 6m 10s | 6m 0s | 4m 50s |
| ACS-T | 7m 30s | 7m 30s | 10m 5s | 10m 5s | 10m 15s | 10m 0s | 10m 20s | 8m 0s |