Model for Time Series

This Page collects the papers and codes of Large Language Models (LLMs) and Foundation Models (FMs) for Time Series (TS).

After the success of BERT, GPT, and other LLMs in NLP, some researchers have proposed to apply LLMs to Time Series (TS) tasks. They fintune the LLMs on TS datasets and achieve SOTA results.

🦙 LLMs for Time Series

  • Time-LLM: Time Series Forecasting by Reprogramming Large Language Models. [Paper] [Note]

  • TEST: Text Prototype Aligned Embedding to Activate LLM’s Ability for Time Series. [Paper] [Note]

  • PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecasting Hao, in arXiv 2022. [Paper] [Note]

  • One Fits All: Power General Time Series Analysis by Pretrained LM, in arXiv 2023. [Paper] [Note]

  • Temporal Data Meets LLM – Explainable Financial Time Series Forecasting, in arXiv 2023. [Paper]

  • LLM4TS: Two-Stage Fine-Tuning for Time-Series Forecasting with Pre-Trained LLMs. [Paper] [Note]

  • The first step is the hardest: Pitfalls of Representing and Tokenizing Temporal Data for Large Language Models. [Paper]

  • Large Language Models Are Zero-Shot Time Series Forecasters. [Paper] [Note]

  • TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting. [Paper] [Note]

  • S2IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting. [Paper]

📍 Survey

  • Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook. [Survey]

  • Position Paper: What Can Large Language Models Tell Us about Time Series Analysis. [Survey]

  • Foundation Models for Time Series Analysis: A Tutorial and Survey [Survey]

Here, some related fields are listed. These fields are not the main focus of this project, but they are also important for understanding how LLMs are applied to other fields rather than NLP and FMs in specific fields are developed.

📍 LLM for Recommendation Systems

  • Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5), in arXiv 2022. [Paper]
  • LLM4Rec. [GitHub]



Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Backdoor Attack
  • A Comprehensive Overview of Backdoor Attacks in Large Language Models within Communication Networks
  • Heterogeneous Graph Neural Network
  • Efficient LLM
  • Interesting Paper