Leave one city out
A complete city is excluded from fitting and uncertainty calibration.
This laboratory holds out complete cities and regions, measures domain shift, compares forecasts statistically and publishes worst-domain performance—not only average scores.
A complete city is excluded from fitting and uncertainty calibration.
Every city in one region becomes an untouched external test domain.
Target shift, feature shift and event-rate shift accompany every fold.
Paired skill uncertainty is estimated without destroying short temporal dependence.
Horizon-aware Diebold–Mariano statistics compare candidates with persistence.
Ranking includes mean error, worst-domain error, event skill and interval calibration.
City and region holdouts
Target, features, events
Bootstrap and DM tests
Season and intensity