notesum.ai
Published at November 18Making Sigmoid-MSE Great Again: Output Reset Challenges Softmax Cross-Entropy in Neural Network Classification
cs.AI
stat.ML
Released Date: November 18, 2024
Authors: Kanishka Tyagi1, Chinmay Rane1, Ketaki Vaidya2, Jeshwanth Challgundla1, Soumitro Swapan Auddy1, Michael Manry1
Aff.: 1Department of Electrical Engineering, The University of Texas at Arlington; 2Oracle Corporation

| Dataset | Average Testing PE | Best Average Validation Iteration |
| MNIST | 8.0517 | 1428.5 |
| CIFAR10 | 59.6683 | 2271.7 |
| SVHN | 74.4050 | 3903.7 |
| FASHION MNIST | 14.5357 | 3916 |
| SCRAP DATA | 31.1343 | 3757.9 |