notesum.ai
Published at October 31LSEAttention is All You Need for Time Series Forecasting
cs.LG
cs.AI
Released Date: October 31, 2024
| Hyperparameter | Values |
|---|---|
| Batch size | 8 |
| Initial learning rate | 0.5 to 0.00001 |
| Number of heads | 4 to 16 |
| Head dropout rate | 0, 0.2, 0.3 |
| Input sequence length | 336 |
| Prediction length | 96, 192, 336, 720 |