source: arxiv machine learning: unicorn: scaling high-dimensional time series forecasting via universal correlation modeling

level: research

modern time series models often choose between channel-independent approaches that scale well but miss inter-channel dependencies, and channel-dependent ones that capture dependencies but struggle to generalize across different datasets. unicorn introduces a universal correlation network that decouples correlation modeling from specific channel identities. it projects heterogeneous channels into a shared latent space using a prototype codebook, learning reusable interaction patterns that transfer across domains with varying dimensionalities and semantics.

the framework enables scalable, multi-dataset pretraining on high-dimensional time series. by treating channels as identity-agnostic, unicorn avoids the dimension-bounded limitations of previous channel-dependent models. the latent codebook stores a set of prototypes that represent common correlation structures, allowing the model to adapt to new datasets without retraining from scratch. this design supports few-shot transfer, where the model can forecast on unseen channels with minimal additional data.

experiments show unicorn significantly outperforms state-of-the-art forecasting architectures, especially in few-shot transfer scenarios. the approach bridges the gap between scalability and expressiveness in time series modeling. it opens possibilities for pretraining large-scale foundation models on diverse time series data, similar to trends in natural language processing and computer vision. the codebook mechanism provides a way to capture universal patterns while remaining flexible to new data sources.

why it matters: it enables building general-purpose time series models that can be pretrained on many datasets and quickly adapted to new forecasting tasks, reducing the need for task-specific models.


source: arxiv machine learning: unicorn: scaling high-dimensional time series forecasting via universal correlation modeling