notesum.ai
Published at November 25Even Sparser Graph Transformers
stat.ML
Released Date: November 25, 2024
Authors: Hamed Shirzad1, Honghao Lin2, Balaji Venkatachalam3, Ameya Velingker4, David Woodruff, Danica Sutherland
Aff.: 1University of British Columbia; 2Carnegie Mellon University; 3Meta; 4Independent Researcher

| Model | Computer | Photo | CS | Physics | WikiCS | ogbn-arxiv |
|---|---|---|---|---|---|---|
| GCN | 89.65 0.52 | 92.70 0.20 | 92.92 0.12 | 96.18 0.07 | 77.47 0.85 | 71.74 0.29 |
| GraphSAGE | 91.20 0.29 | 94.59 0.14 | 93.91 0.13 | 96.49 0.06 | 74.77 0.95 | 71.49 0.27 |
| GAT | 90.78 0.13 | 93.87 0.11 | 93.61 0.14 | 96.17 0.08 | 76.91 0.82 | 72.01 0.20 |
| GraphSAINT | 90.22 0.15 | 91.72 0.13 | 94.41 0.09 | 96.43 0.05 | - | 68.50 0.23 |
| NodeFormer | 86.98 0.62 | 93.46 0.35 | 95.64 0.22 | 96.45 0.28 | 74.73 0.94 | 59.90 0.42 |
| GraphGPS | 91.19 0.54 | 95.06 0.13 | 93.93 0.12 | 97.12 0.19 | 78.66 0.49 | 70.92 0.04 |
| GOAT | 90.96 0.90 | 92.96 1.48 | 94.21 0.38 | 96.24 0.24 | 77.00 0.77 | 72.41 0.40 |
| Exphormer+GCN | 91.59 0.31 | 95.27 0.42 | 95.77 0.15 | 97.16 0.13 | 78.54 0.49 | 72.44 0.28 |
| Exphormer* | 91.16 0.26 | 95.36 0.17 | 95.19 0.26 | 96.40 0.20 | 78.19 0.29 | 71.27 0.27 |
| Spexphormer | 91.09 0.08 | 95.33 0.49 | 95.00 0.15 | 96.70 0.05 | 78.2 0.14 | 70.82 0.24 |
| Avg. Edge Percent | 7.6% | 8.2% | 12.8% | 11.3% | 8.6% | 13.7% |