notesum.ai
Published at November 26Confidence-Aware Deep Learning for Load Plan Adjustments in the Parcel Service Industry
cs.LG
Released Date: November 26, 2024
Authors: Thomas Bruys1, Reza Zandehshahvar1, Amira Hijazi1, Pascal Van Hentenryck1
Aff.: 1Georgia Institute of Technology, Atlanta, USA

| Model | Num Emb | Building Prediction Accuracy | |||
| All Data | No Shift | Internal Shift | External Shift | ||
| DT | - | 0.988 ± 0.003 | 0.996 ± 0.001 | 0.994 ± 0.002 | 0.587 ± 0.031 |
| RF | - | 0.990 ± 0.003 | 0.999 ± 0.001 | 0.998 ± 0.001 | 0.502 ± 0.039 |
| CatBoost | - | 0.974 ± 0.035 | 0.982 ± 0.035 | 0.984 ± 0.032 | 0.529 ± 0.069 |
| LGBM | - | 0.986 ± 0.015 | 0.995 ± 0.009 | 0.995 ± 0.008 | 0.571 ± 0.152 |
| XGBoost | - | 0.992 ± 0.001 | 0.999 ± 0.001 | 0.998 ± 0.002 | 0.643 ± 0.030 |
| MLP | ✗ | 0.952 ± 0.075 | 0.960 ± 0.075 | 0.959 ± 0.075 | 0.514 ± 0.068 |
| MLP | PLR | 0.990 ± 0.001 | 0.997 ± 0.001 | 0.997 ± 0.002 | 0.592 ± 0.058 |
| MLP | QL | 0.990 ± 0.002 | 0.997 ± 0.001 | 0.997 ± 0.001 | 0.622 ± 0.030 |
| ResNet | ✗ | 0.974 ± 0.030 | 0.983 ± 0.029 | 0.978 ± 0.037 | 0.533 ± 0.079 |
| ResNet | PLR | 0.989 ± 0.002 | 0.996 ± 0.001 | 0.996 ± 0.002 | 0.590 ± 0.055 |
| ResNet | QL | 0.990 ± 0.002 | 0.997 ± 0.001 | 0.997 ± 0.001 | 0.651 ± 0.036 |