LightCTS: A Lightweight Framework for Correlated Time Series Forecasting

23 Feb 2023  ·  Zhichen Lai, Dalin Zhang, Huan Li, Christian S. Jensen, Hua Lu, Yan Zhao ·

Correlated time series (CTS) forecasting plays an essential role in many practical applications, such as traffic management and server load control. Many deep learning models have been proposed to improve the accuracy of CTS forecasting. However, while models have become increasingly complex and computationally intensive, they struggle to improve accuracy. Pursuing a different direction, this study aims instead to enable much more efficient, lightweight models that preserve accuracy while being able to be deployed on resource-constrained devices. To achieve this goal, we characterize popular CTS forecasting models and yield two observations that indicate directions for lightweight CTS forecasting. On this basis, we propose the LightCTS framework that adopts plain stacking of temporal and spatial operators instead of alternate stacking that is much more computationally expensive. Moreover, LightCTS features light temporal and spatial operator modules, called L-TCN and GL-Former, that offer improved computational efficiency without compromising their feature extraction capabilities. LightCTS also encompasses a last-shot compression scheme to reduce redundant temporal features and speed up subsequent computations. Experiments with single-step and multi-step forecasting benchmark datasets show that LightCTS is capable of nearly state-of-the-art accuracy at much reduced computational and storage overheads.

PDF Abstract

Results from the Paper


 Ranked #1 on Traffic Prediction on PeMS04 (FLOPs(M) metric, using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Correlated Time Series Forecasting Electricity LightCTS FLOPs(M) 239 # 1
Parameters(K) 27 # 1
Correlated Time Series Forecasting METR-LA LightCTS FLOPs(M) 71 # 1
MAE @ 12 step 3.42 # 1
RMSE @ 12 step 0.0721 # 1
MAPE @ 12 step 9.46% # 1
Parameters(K) 133 # 1
Traffic Prediction PeMS04 LightCTS FLOPs(M) 147 # 1
Parameters(K) 185 # 1
MAE 18.79 # 1
RMSE 0.3014 # 1
MAPE 12.8% # 1
Traffic Prediction PeMS08 LightCTS FLOPs(M) 70 # 1
Parameters(K) 177 # 1
MAE 14.63 # 1
RMSE 0.2349 # 1
MAPE 9.43% # 1
Correlated Time Series Forecasting PEMS-BAY LightCTS FLOPs(M) 208 # 1
MAE @ 12 step 1.89 # 1
RMSE @ 12 step 4.32 # 1
MAPE @ 12 step 4.39 # 1
Parameters(K) 236 # 1
Correlated Time Series Forecasting Solar-Power LightCTS FLOPs(M) 169 # 1
Parameters(K) 38 # 1

Methods