Search Results for author: Qingsong Wen

Found 122 papers, 65 papers with code

Automating Personalization: Prompt Optimization for Recommendation Reranking

no code implementations4 Apr 2025 Chen Wang, Mingdai Yang, Zhiwei Liu, Pan Li, Linsey Pang, Qingsong Wen, Philip Yu

Modern recommender systems increasingly leverage large language models (LLMs) for reranking to improve personalization.

Position Profile Generation +2

UniEDU: A Unified Language and Vision Assistant for Education Applications

no code implementations26 Mar 2025 Zhendong Chu, Jian Xie, Shen Wang, Zichao Wang, Qingsong Wen

Education materials for K-12 students often consist of multiple modalities, such as text and images, posing challenges for models to fully understand nuanced information in these materials.

Knowledge Tracing

MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection

no code implementations23 Mar 2025 Yibo Yan, Shen Wang, Jiahao Huo, Philip S. Yu, Xuming Hu, Qingsong Wen

Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex reasoning capabilities.

Math Mathematical Problem-Solving

LLM Agents for Education: Advances and Applications

no code implementations14 Mar 2025 Zhendong Chu, Shen Wang, Jian Xie, Tinghui Zhu, Yibo Yan, Jinheng Ye, Aoxiao Zhong, Xuming Hu, Jing Liang, Philip S. Yu, Qingsong Wen

Large Language Model (LLM) agents have demonstrated remarkable capabilities in automating tasks and driving innovation across diverse educational applications.

Fairness Hallucination +4

Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey

1 code implementation12 Mar 2025 Yuxuan Liang, Haomin Wen, Yutong Xia, Ming Jin, Bin Yang, Flora Salim, Qingsong Wen, Shirui Pan, Gao Cong

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent transportation.

Management

A Survey on Post-training of Large Language Models

no code implementations8 Mar 2025 Guiyao Tie, Zeli Zhao, Dingjie Song, Fuyang Wei, Rong Zhou, Yurou Dai, Wen Yin, Zhejian Yang, Jiangyue Yan, Yao Su, Zhenhan Dai, Yifeng Xie, Yihan Cao, Lichao Sun, Pan Zhou, Lifang He, Hechang Chen, Yu Zhang, Qingsong Wen, Tianming Liu, Neil Zhenqiang Gong, Jiliang Tang, Caiming Xiong, Heng Ji, Philip S. Yu, Jianfeng Gao

The emergence of Large Language Models (LLMs) has fundamentally transformed natural language processing, making them indispensable across domains ranging from conversational systems to scientific exploration.

Survey

AgentSafe: Safeguarding Large Language Model-based Multi-agent Systems via Hierarchical Data Management

no code implementations6 Mar 2025 Junyuan Mao, Fanci Meng, Yifan Duan, Miao Yu, Xiaojun Jia, Junfeng Fang, Yuxuan Liang, Kun Wang, Qingsong Wen

Large Language Model based multi-agent systems are revolutionizing autonomous communication and collaboration, yet they remain vulnerable to security threats like unauthorized access and data breaches.

Language Modeling Language Modelling +2

RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systems

1 code implementation6 Mar 2025 Biao Ouyang, Yingying Zhang, Hanyin Cheng, Yang Shu, Chenjuan Guo, Bin Yang, Qingsong Wen, Lunting Fan, Christian S. Jensen

This paper proposes a method capable of both identifying possible root cause types for slow queries and ranking these according to their potential for accelerating slow queries.

cross-modal alignment

Brain Foundation Models: A Survey on Advancements in Neural Signal Processing and Brain Discovery

no code implementations1 Mar 2025 Xinliang Zhou, Chenyu Liu, Zhisheng Chen, Kun Wang, Yi Ding, Ziyu Jia, Qingsong Wen

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks.

Survey

LAG: LLM agents for Leaderboard Auto Generation on Demanding

no code implementations25 Feb 2025 Jian Wu, Jiayu Zhang, Dongyuan Li, Linyi Yang, Aoxiao Zhong, Renhe Jiang, Qingsong Wen, Yue Zhang

This paper introduces Leaderboard Auto Generation (LAG), a novel and well-organized framework for automatic generation of leaderboards on a given research topic in rapidly evolving fields like Artificial Intelligence (AI).

Document Summarization Multi-Document Summarization

Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam

1 code implementation24 Feb 2025 Tianjin Huang, Haotian Hu, Zhenyu Zhang, Gaojie Jin, Xiang Li, Li Shen, Tianlong Chen, Lu Liu, Qingsong Wen, Zhangyang Wang, Shiwei Liu

This paper comprehensively evaluates several recently proposed optimizers for 4-bit training, revealing that low-bit precision amplifies sensitivity to learning rates and often causes unstable gradient norms, leading to divergence at higher learning rates.

Corrections Meet Explanations: A Unified Framework for Explainable Grammatical Error Correction

no code implementations21 Feb 2025 Jingheng Ye, Shang Qin, Yinghui Li, Hai-Tao Zheng, Shen Wang, Qingsong Wen

Grammatical Error Correction (GEC) faces a critical challenge concerning explainability, notably when GEC systems are designed for language learners.

Grammatical Error Correction

From Correctness to Comprehension: AI Agents for Personalized Error Diagnosis in Education

no code implementations19 Feb 2025 Yi-Fan Zhang, Hang Li, Dingjie Song, Lichao Sun, Tianlong Xu, Qingsong Wen

Finally, we propose a multi-agent collaborative framework that combines a Time Series Agent for historical analysis and an MLLM Agent for real-time refinement, enhancing error classification and feedback generation.

Diagnostic GSM8K +1

Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting

no code implementations6 Feb 2025 Siru Zhong, Weilin Ruan, Ming Jin, Huan Li, Qingsong Wen, Yuxuan Liang

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy.

Time Series Time Series Forecasting

Noise-Resilient Point-wise Anomaly Detection in Time Series Using Weak Segment Labels

1 code implementation21 Jan 2025 Yaxuan Wang, Hao Cheng, Jing Xiong, Qingsong Wen, Han Jia, Ruixuan Song, Liyuan Zhang, Zhaowei Zhu, Yang Liu

Detecting anomalies in temporal data has gained significant attention across various real-world applications, aiming to identify unusual events and mitigate potential hazards.

Anomaly Detection Time Series +1

CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries

no code implementations2 Jan 2025 Shudong Liu, Yiqiao Jin, Cheng Li, Derek F. Wong, Qingsong Wen, Lichao Sun, Haipeng Chen, Xing Xie, Jindong Wang

Our evaluation of 16 models reveals significant disparities, with a stronger performance in Western concepts and weaker results in African and Asian contexts.

LLM-Virus: Evolutionary Jailbreak Attack on Large Language Models

1 code implementation28 Dec 2024 Miao Yu, Junfeng Fang, Yingjie Zhou, Xing Fan, Kun Wang, Shirui Pan, Qingsong Wen

While safety-aligned large language models (LLMs) are increasingly used as the cornerstone for powerful systems such as multi-agent frameworks to solve complex real-world problems, they still suffer from potential adversarial queries, such as jailbreak attacks, which attempt to induce harmful content.

Transfer Learning

Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions

no code implementations22 Dec 2024 Hang Li, Tianlong Xu, Kaiqi Yang, Yucheng Chu, Yanling Chen, Yichi Song, Qingsong Wen, Hui Liu

The rise of large language models (LLMs) offers new opportunities for automatic error detection in education, particularly for math word problems (MWPs).

GSM8K Math +1

GraphSubDetector: Time Series Subsequence Anomaly Detection via Density-Aware Adaptive Graph Neural Network

no code implementations26 Nov 2024 Weiqi Chen, Zhiqiang Zhou, Qingsong Wen, Liang Sun

Time series subsequence anomaly detection is an important task in a large variety of real-world applications ranging from health monitoring to AIOps, and is challenging due to the following reasons: 1) how to effectively learn complex dynamics and dependencies in time series; 2) diverse and complicated anomalous subsequences as well as the inherent variance and noise of normal patterns; 3) how to determine the proper subsequence length for effective detection, which is a required parameter for many existing algorithms.

Anomaly Detection Graph Neural Network +1

NetSafe: Exploring the Topological Safety of Multi-agent Networks

no code implementations21 Oct 2024 Miao Yu, Shilong Wang, Guibin Zhang, Junyuan Mao, Chenlong Yin, Qijiong Liu, Qingsong Wen, Kun Wang, Yang Wang

Large language models (LLMs) have empowered nodes within multi-agent networks with intelligence, showing growing applications in both academia and industry.

Hallucination Misinformation

Abnormality Forecasting: Time Series Anomaly Prediction via Future Context Modeling

1 code implementation16 Oct 2024 Sinong Zhao, Wenrui Wang, Hongzuo Xu, Zhaoyang Yu, Qingsong Wen, Gang Wang, Xiaoguang Liu, Guansong Pang

It then models a normality correlation of the observation data with the forecasting future context to complement the normality modeling of the observation data in foreseeing possible abnormality in the target window.

Time Series

Toward Physics-guided Time Series Embedding

1 code implementation9 Oct 2024 Jiaxi Hu, BoWen Zhang, Qingsong Wen, Fugee Tsung, Yuxuan Liang

This theory enables us to bypass the parameterized embedding layer and directly employ physical reconstruction techniques to acquire a data embedding representation.

Time Series Time Series Analysis

Task-oriented Time Series Imputation Evaluation via Generalized Representers

1 code implementation9 Oct 2024 Zhixian Wang, Linxiao Yang, Liang Sun, Qingsong Wen, Yi Wang

Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc.

Anomaly Detection Imputation +3

ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection

no code implementations6 Oct 2024 Yibo Yan, Shen Wang, Jiahao Huo, Hang Li, Boyan Li, Jiamin Su, Xiong Gao, Yi-Fan Zhang, Tianlong Xu, Zhendong Chu, Aoxiao Zhong, Kun Wang, Hui Xiong, Philip S. Yu, Xuming Hu, Qingsong Wen

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks.

Benchmarking Mathematical Reasoning

Mind Scramble: Unveiling Large Language Model Psychology Via Typoglycemia

1 code implementation2 Oct 2024 Miao Yu, Junyuan Mao, Guibin Zhang, Jingheng Ye, Junfeng Fang, Aoxiao Zhong, Yang Liu, Yuxuan Liang, Kun Wang, Qingsong Wen

Research into the external behaviors and internal mechanisms of large language models (LLMs) has shown promise in addressing complex tasks in the physical world.

Language Modeling Language Modelling +2

Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts

1 code implementation24 Sep 2024 Xiaoming Shi, Shiyu Wang, Yuqi Nie, Dianqi Li, Zhou Ye, Qingsong Wen, Ming Jin

However, despite the success of large-scale pre-training in language and vision domains, pre-trained time series models remain limited in scale and operate at a high cost, hindering the development of larger capable forecasting models in real-world applications.

Computational Efficiency Mixture-of-Experts +2

Knowledge Tagging with Large Language Model based Multi-Agent System

no code implementations12 Sep 2024 Hang Li, Tianlong Xu, Ethan Chang, Qingsong Wen

Knowledge tagging for questions is vital in modern intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization.

Language Modeling Language Modelling +2

Time Series Analysis for Education: Methods, Applications, and Future Directions

1 code implementation25 Aug 2024 Shengzhong Mao, Chaoli Zhang, Yichi Song, Jindong Wang, Xiao-jun Zeng, Zenglin Xu, Qingsong Wen

The contributions of this paper include a detailed taxonomy of educational data, a synthesis of time series techniques with specific educational applications, and a forward-looking perspective on emerging trends and future research opportunities in educational analysis.

Anomaly Detection Time Series +1

LogParser-LLM: Advancing Efficient Log Parsing with Large Language Models

no code implementations25 Aug 2024 Aoxiao Zhong, Dengyao Mo, Guiyang Liu, Jinbu Liu, Qingda Lu, Qi Zhou, Jiesheng Wu, Quanzheng Li, Qingsong Wen

In evaluations on the LogPub benchmark, involving an average of 3. 6 million logs per dataset across 14 datasets, our LogParser-LLM requires only 272. 5 LLM invocations on average, achieving a 90. 6% F1 score for grouping accuracy and an 81. 1% for parsing accuracy.

2k Log Parsing

Unlocking the Power of LSTM for Long Term Time Series Forecasting

no code implementations19 Aug 2024 Yaxuan Kong, Zepu Wang, Yuqi Nie, Tian Zhou, Stefan Zohren, Yuxuan Liang, Peng Sun, Qingsong Wen

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks.

Time Series Time Series Forecasting

Cluster-Wide Task Slowdown Detection in Cloud System

1 code implementation8 Aug 2024 Feiyi Chen, Yingying Zhang, Lunting Fan, Yuxuan Liang, Guansong Pang, Qingsong Wen, Shuiguang Deng

To tackle these challenges, we propose SORN (i. e., Skimming Off subperiods in descending amplitude order and Reconstructing Non-slowing fluctuation), which consists of a Skimming Attention mechanism to reconstruct the compound periodicity and a Neural Optimal Transport module to distinguish cluster-wide slowdowns from other exceptional fluctuations.

Anomaly Detection Cloud Computing

Intelligent Cross-Organizational Process Mining: A Survey and New Perspectives

no code implementations15 Jul 2024 Yiyuan Yang, Zheshun Wu, Yong Chu, Zhenghua Chen, Zenglin Xu, Qingsong Wen

Process mining, as a high-level field in data mining, plays a crucial role in enhancing operational efficiency and decision-making across organizations.

Data Integration Decision Making +2

Knowledge Tagging System on Math Questions via LLMs with Flexible Demonstration Retriever

no code implementations19 Jun 2024 Hang Li, Tianlong Xu, Jiliang Tang, Qingsong Wen

Knowledge tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization.

Math Semantic Similarity +1

TSI-Bench: Benchmarking Time Series Imputation

4 code implementations18 Jun 2024 Wenjie Du, Jun Wang, Linglong Qian, Yiyuan Yang, Zina Ibrahim, Fanxing Liu, Zepu Wang, Haoxin Liu, Zhiyuan Zhao, Yingjie Zhou, Wenjia Wang, Kaize Ding, Yuxuan Liang, B. Aditya Prakash, Qingsong Wen

Despite the development of numerous deep learning algorithms for time series imputation, the community lacks standardized and comprehensive benchmark platforms to effectively evaluate imputation performance across different settings.

Benchmarking Deep Learning +3

A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges

no code implementations15 Jun 2024 Yuqi Nie, Yaxuan Kong, Xiaowen Dong, John M. Mulvey, H. Vincent Poor, Qingsong Wen, Stefan Zohren

We then highlight this survey for categorizing the existing literature into key application areas, including linguistic tasks, sentiment analysis, financial time series, financial reasoning, agent-based modeling, and other applications.

Data Augmentation Sentiment Analysis +2

Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models

1 code implementation12 Jun 2024 Yi-Fan Zhang, Qingsong Wen, Chaoyou Fu, Xue Wang, Zhang Zhang, Liang Wang, Rong Jin

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning.

Image Compression

AutoSurvey: Large Language Models Can Automatically Write Surveys

1 code implementation10 Jun 2024 Yidong Wang, Qi Guo, Wenjin Yao, Hongbo Zhang, Xin Zhang, Zhen Wu, Meishan Zhang, Xinyu Dai, Min Zhang, Qingsong Wen, Wei Ye, Shikun Zhang, Yue Zhang

This paper introduces AutoSurvey, a speedy and well-organized methodology for automating the creation of comprehensive literature surveys in rapidly evolving fields like artificial intelligence.

Retrieval Survey

TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting

no code implementations6 Jun 2024 Jiaxi Hu, Qingsong Wen, Sijie Ruan, Li Liu, Yuxuan Liang

In this paper, we begin by validating this theory through wavelet analysis and propose the Transformer-based TwinS model, which consists of three modules to address the non-stationary periodic distributions: Wavelet Convolution, Period-Aware Attention, and Channel-Temporal Mixed MLP.

Multivariate Time Series Forecasting Time Series

NuwaTS: a Foundation Model Mending Every Incomplete Time Series

1 code implementation24 May 2024 Jinguo Cheng, Chunwei Yang, Wanlin Cai, Yuxuan Liang, Qingsong Wen, Yuankai Wu

In this paper, we present \textbf{NuwaTS}, a novel framework that repurposes Pre-trained Language Models (PLMs) for general time series imputation.

Benchmarking Contrastive Learning +4

CulturePark: Boosting Cross-cultural Understanding in Large Language Models

1 code implementation24 May 2024 Cheng Li, Damien Teney, Linyi Yang, Qingsong Wen, Xing Xie, Jindong Wang

Cultural bias is pervasive in many large language models (LLMs), largely due to the deficiency of data representative of different cultures.

Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting

no code implementations23 May 2024 Qingxiang Liu, Xu Liu, Chenghao Liu, Qingsong Wen, Yuxuan Liang

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity.

Time Series Time Series Forecasting

A Survey on Diffusion Models for Time Series and Spatio-Temporal Data

2 code implementations29 Apr 2024 Yiyuan Yang, Ming Jin, Haomin Wen, Chaoli Zhang, Yuxuan Liang, Lintao Ma, Yi Wang, Chenghao Liu, Bin Yang, Zenglin Xu, Jiang Bian, Shirui Pan, Qingsong Wen

Conditioned models, on the other hand, utilize extra information to enhance performance and are similarly divided for both predictive and generative tasks.

Anomaly Detection Imputation +1

DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series

1 code implementation17 Apr 2024 Zahra Zamanzadeh Darban, Yiyuan Yang, Geoffrey I. Webb, Charu C. Aggarwal, Qingsong Wen, Mahsa Salehi

To address this limitation, we propose a novel Domain Adaptation Contrastive learning model for Anomaly Detection in multivariate time series (DACAD), combining UDA with contrastive learning.

Anomaly Detection Contrastive Learning +5

Automate Knowledge Concept Tagging on Math Questions with LLMs

no code implementations26 Mar 2024 Hang Li, Tianlong Xu, Jiliang Tang, Qingsong Wen

Knowledge concept tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization.

Few-Shot Learning Math

Large Language Models for Education: A Survey and Outlook

no code implementations26 Mar 2024 Shen Wang, Tianlong Xu, Hang Li, Chaoli Zhang, Joleen Liang, Jiliang Tang, Philip S. Yu, Qingsong Wen

The advent of Large Language Models (LLMs) has brought in a new era of possibilities in the realm of education.

Survey

UrbanVLP: Multi-Granularity Vision-Language Pretraining for Urban Socioeconomic Indicator Prediction

2 code implementations25 Mar 2024 Xixuan Hao, Wei Chen, Yibo Yan, Siru Zhong, Kun Wang, Qingsong Wen, Yuxuan Liang

Our UrbanVLP seamlessly integrates multi-granularity information from both macro (satellite) and micro (street-view) levels, overcoming the limitations of prior pretrained models.

Hallucination Text Generation

Foundation Models for Time Series Analysis: A Tutorial and Survey

2 code implementations21 Mar 2024 Yuxuan Liang, Haomin Wen, Yuqi Nie, Yushan Jiang, Ming Jin, Dongjin Song, Shirui Pan, Qingsong Wen

Time series analysis stands as a focal point within the data mining community, serving as a cornerstone for extracting valuable insights crucial to a myriad of real-world applications.

Survey Time Series +1

Online GNN Evaluation Under Test-time Graph Distribution Shifts

1 code implementation15 Mar 2024 Xin Zheng, Dongjin Song, Qingsong Wen, Bo Du, Shirui Pan

This enables the effective evaluation of the well-trained GNNs' ability to capture test node semantics and structural representations, making it an expressive metric for estimating the generalization error in online GNN evaluation.

Debiasing Multimodal Large Language Models

1 code implementation8 Mar 2024 Yi-Fan Zhang, Weichen Yu, Qingsong Wen, Xue Wang, Zhang Zhang, Liang Wang, Rong Jin, Tieniu Tan

In the realms of computer vision and natural language processing, Large Vision-Language Models (LVLMs) have become indispensable tools, proficient in generating textual descriptions based on visual inputs.

Fairness Question Answering

DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting

no code implementations5 Mar 2024 Hao Wu, Haomin Wen, Guibin Zhang, Yutong Xia, Yuxuan Liang, Yu Zheng, Qingsong Wen, Kun Wang

In this paper, we introduce for the first time the concept of spatio-temporal data dynamic sparse training and are committed to adaptively, dynamically filtering important sensor distributions.

Spatio-Temporal Forecasting

PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations

1 code implementation25 Feb 2024 shiyi qi, Zenglin Xu, Yiduo Li, Liangjian Wen, Qingsong Wen, Qifan Wang, Yuan Qi

Recent advancements in deep learning have led to the development of various models for long-term multivariate time-series forecasting (LMTF), many of which have shown promising results.

Multivariate Time Series Forecasting Time Series

Generative Semi-supervised Graph Anomaly Detection

1 code implementation19 Feb 2024 Hezhe Qiao, Qingsong Wen, XiaoLi Li, Ee-Peng Lim, Guansong Pang

This work considers a practical semi-supervised graph anomaly detection (GAD) scenario, where part of the nodes in a graph are known to be normal, contrasting to the extensively explored unsupervised setting with a fully unlabeled graph.

Graph Anomaly Detection One-class classifier

Attractor Memory for Long-Term Time Series Forecasting: A Chaos Perspective

1 code implementation18 Feb 2024 Jiaxi Hu, Yuehong Hu, Wei Chen, Ming Jin, Shirui Pan, Qingsong Wen, Yuxuan Liang

In long-term time series forecasting (LTSF) tasks, an increasing number of models have acknowledged that discrete time series originate from continuous dynamic systems and have attempted to model their dynamical structures.

Time Series Time Series Forecasting

Deep Learning for Multivariate Time Series Imputation: A Survey

5 code implementations6 Feb 2024 Jun Wang, Wenjie Du, Wei Cao, Keli Zhang, Wenjia Wang, Yuxuan Liang, Qingsong Wen

In this paper, we conduct a comprehensive survey on the recently proposed deep learning imputation methods.

Deep Learning Missing Values +3

Position: What Can Large Language Models Tell Us about Time Series Analysis

2 code implementations5 Feb 2024 Ming Jin, Yifan Zhang, Wei Chen, Kexin Zhang, Yuxuan Liang, Bin Yang, Jindong Wang, Shirui Pan, Qingsong Wen

Time series analysis is essential for comprehending the complexities inherent in various realworld systems and applications.

Decision Making Position +3

Bringing Generative AI to Adaptive Learning in Education

no code implementations2 Feb 2024 Hang Li, Tianlong Xu, Chaoli Zhang, Eason Chen, Jing Liang, Xing Fan, Haoyang Li, Jiliang Tang, Qingsong Wen

The recent surge in generative AI technologies, such as large language models and diffusion models, has boosted the development of AI applications in various domains, including science, finance, and education.

Position

Explaining Time Series via Contrastive and Locally Sparse Perturbations

1 code implementation16 Jan 2024 Zichuan Liu, Yingying Zhang, Tianchun Wang, Zefan Wang, Dongsheng Luo, Mengnan Du, Min Wu, Yi Wang, Chunlin Chen, Lunting Fan, Qingsong Wen

Explaining multivariate time series is a compound challenge, as it requires identifying important locations in the time series and matching complex temporal patterns.

Contrastive Learning counterfactual +1

Load Data Valuation in Multi-Energy Systems: An End-to-End Approach

no code implementations16 Nov 2023 Yangze Zhou, Qingsong Wen, Jie Song, Xueyuan Cui, Yi Wang

Accurate load forecasting serves as the foundation for the flexible operation of multi-energy systems (MES).

Data Valuation Load Forecasting

UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Web

1 code implementation22 Oct 2023 Yibo Yan, Haomin Wen, Siru Zhong, Wei Chen, Haodong Chen, Qingsong Wen, Roger Zimmermann, Yuxuan Liang

To answer the questions, we leverage the power of Large Language Models (LLMs) and introduce the first-ever LLM-enhanced framework that integrates the knowledge of textual modality into urban imagery profiling, named LLM-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining (UrbanCLIP).

Image to text Language Modeling +2

Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook

6 code implementations16 Oct 2023 Ming Jin, Qingsong Wen, Yuxuan Liang, Chaoli Zhang, Siqiao Xue, Xue Wang, James Zhang, Yi Wang, Haifeng Chen, XiaoLi Li, Shirui Pan, Vincent S. Tseng, Yu Zheng, Lei Chen, Hui Xiong

In this survey, we offer a comprehensive and up-to-date review of large models tailored (or adapted) for time series and spatio-temporal data, spanning four key facets: data types, model categories, model scopes, and application areas/tasks.

Time Series Time Series Analysis

ADGym: Design Choices for Deep Anomaly Detection

3 code implementations NeurIPS 2023 Minqi Jiang, Chaochuan Hou, Ao Zheng, Songqiao Han, Hailiang Huang, Qingsong Wen, Xiyang Hu, Yue Zhao

Deep learning (DL) techniques have recently found success in anomaly detection (AD) across various fields such as finance, medical services, and cloud computing.

Anomaly Detection Cloud Computing

OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensembling

2 code implementations NeurIPS 2023 Yi-Fan Zhang, Qingsong Wen, Xue Wang, Weiqi Chen, Liang Sun, Zhang Zhang, Liang Wang, Rong Jin, Tieniu Tan

Online updating of time series forecasting models aims to address the concept drifting problem by efficiently updating forecasting models based on streaming data.

Time Series Time Series Forecasting

BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition

1 code implementation28 Aug 2023 Shikai Fang, Qingsong Wen, Yingtao Luo, Shandian Zhe, Liang Sun

More importantly, almost all methods assume the observations are sampled at regular time stamps, and fail to handle complex irregular sampled time series arising from different applications.

Computational Efficiency Gaussian Processes +4

EasyTPP: Towards Open Benchmarking Temporal Point Processes

1 code implementation16 Jul 2023 Siqiao Xue, Xiaoming Shi, Zhixuan Chu, Yan Wang, Hongyan Hao, Fan Zhou, Caigao Jiang, Chen Pan, James Y. Zhang, Qingsong Wen, Jun Zhou, Hongyuan Mei

In this paper, we present EasyTPP, the first central repository of research assets (e. g., data, models, evaluation programs, documentations) in the area of event sequence modeling.

Benchmarking Point Processes

A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection

1 code implementation7 Jul 2023 Ming Jin, Huan Yee Koh, Qingsong Wen, Daniele Zambon, Cesare Alippi, Geoffrey I. Webb, Irwin King, Shirui Pan

In this survey, we provide a comprehensive review of graph neural networks for time series analysis (GNN4TS), encompassing four fundamental dimensions: forecasting, classification, anomaly detection, and imputation.

Anomaly Detection Imputation +3

DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection

2 code implementations17 Jun 2023 Yiyuan Yang, Chaoli Zhang, Tian Zhou, Qingsong Wen, Liang Sun

On the other hand, contrastive learning aims to find a representation that can clearly distinguish any instance from the others, which can bring a more natural and promising representation for time series anomaly detection.

Anomaly Detection Contrastive Learning +3

SaDI: A Self-adaptive Decomposed Interpretable Framework for Electric Load Forecasting under Extreme Events

no code implementations14 Jun 2023 Hengbo Liu, Ziqing Ma, Linxiao Yang, Tian Zhou, Rui Xia, Yi Wang, Qingsong Wen, Liang Sun

In this paper, we propose a novel forecasting framework, named Self-adaptive Decomposed Interpretable framework~(SaDI), which ensembles long-term trend, short-term trend, and period modelings to capture temporal characteristics in different components.

Load Forecasting Management

DiffLoad: Uncertainty Quantification in Electrical Load Forecasting with the Diffusion Model

1 code implementation31 May 2023 Zhixian Wang, Qingsong Wen, Chaoli Zhang, Liang Sun, Yi Wang

The uncertainties in load forecasting can be divided into two types: epistemic uncertainty and aleatoric uncertainty.

Decision Making energy management +3

CARD: Channel Aligned Robust Blend Transformer for Time Series Forecasting

1 code implementation20 May 2023 Wang Xue, Tian Zhou, Qingsong Wen, Jinyang Gao, Bolin Ding, Rong Jin

In this work, we design a special Transformer, i. e., Channel Aligned Robust Blend Transformer (CARD for short), that addresses key shortcomings of CI type Transformer in time series forecasting.

Time Series Time Series Forecasting

AHPA: Adaptive Horizontal Pod Autoscaling Systems on Alibaba Cloud Container Service for Kubernetes

no code implementations7 Mar 2023 Zhiqiang Zhou, Chaoli Zhang, Lingna Ma, Jing Gu, Huajie Qian, Qingsong Wen, Liang Sun, Peng Li, Zhimin Tang

This paper discusses horizontal POD resources management in Alibaba Cloud Container Services with a newly deployed AI algorithm framework named AHPA -- the adaptive horizontal pod auto-scaling system.

Management

Robust Dominant Periodicity Detection for Time Series with Missing Data

no code implementations6 Mar 2023 Qingsong Wen, Linxiao Yang, Liang Sun

In this paper, we propose a robust and effective periodicity detection algorithm for time series with block missing data.

Missing Values Time Series +1

DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models

1 code implementation31 Jan 2023 Haomin Wen, Youfang Lin, Yutong Xia, Huaiyu Wan, Qingsong Wen, Roger Zimmermann, Yuxuan Liang

Spatio-temporal graph neural networks (STGNN) have emerged as the dominant model for spatio-temporal graph (STG) forecasting.

Decision Making Denoising

AirFormer: Predicting Nationwide Air Quality in China with Transformers

1 code implementation29 Nov 2022 Yuxuan Liang, Yutong Xia, Songyu Ke, Yiwei Wang, Qingsong Wen, Junbo Zhang, Yu Zheng, Roger Zimmermann

Air pollution is a crucial issue affecting human health and livelihoods, as well as one of the barriers to economic and social growth.

Towards Out-of-Distribution Sequential Event Prediction: A Causal Treatment

1 code implementation24 Oct 2022 Chenxiao Yang, Qitian Wu, Qingsong Wen, Zhiqiang Zhou, Liang Sun, Junchi Yan

The goal of sequential event prediction is to estimate the next event based on a sequence of historical events, with applications to sequential recommendation, user behavior analysis and clinical treatment.

Sequential Recommendation Variational Inference

TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysis

1 code implementation18 Oct 2022 Chaoli Zhang, Tian Zhou, Qingsong Wen, Liang Sun

Time series anomaly detection is a challenging problem due to the complex temporal dependencies and the limited label data.

Anomaly Detection Data Augmentation +2

TreeDRNet:A Robust Deep Model for Long Term Time Series Forecasting

no code implementations24 Jun 2022 Tian Zhou, Jianqing Zhu, Xue Wang, Ziqing Ma, Qingsong Wen, Liang Sun, Rong Jin

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting. However, those transformer-based models suffer a severe deterioration performance with prolonged input length, which prohibits them from using extended historical info. Moreover, these methods tend to handle complex examples in long-term forecasting with increased model complexity, which often leads to a significant increase in computation and less robustness in performance(e. g., overfitting).

Computational Efficiency feature selection +2

FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting

3 code implementations18 May 2022 Tian Zhou, Ziqing Ma, Xue Wang, Qingsong Wen, Liang Sun, Tao Yao, Wotao Yin, Rong Jin

Recent studies have shown that deep learning models such as RNNs and Transformers have brought significant performance gains for long-term forecasting of time series because they effectively utilize historical information.

Deep Learning Dimensionality Reduction +2

A Global Modeling Approach for Load Forecasting in Distribution Networks

no code implementations1 Apr 2022 Miha Grabner, Yi Wang, Qingsong Wen, Boštjan Blažič, Vitomir Štruc

Efficient load forecasting is needed to ensure better observability in the distribution networks, whereas such forecasting is made possible by an increasing number of smart meter installations.

Load Forecasting

Transformers in Time Series: A Survey

11 code implementations15 Feb 2022 Qingsong Wen, Tian Zhou, Chaoli Zhang, Weiqi Chen, Ziqing Ma, Junchi Yan, Liang Sun

From the perspective of network structure, we summarize the adaptations and modifications that have been made to Transformers in order to accommodate the challenges in time series analysis.

Anomaly Detection Survey +2

FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting

3 code implementations30 Jan 2022 Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, Rong Jin

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series (e. g. overall trend).

Time Series Time Series Analysis

CloudRCA: A Root Cause Analysis Framework for Cloud Computing Platforms

no code implementations5 Nov 2021 Yingying Zhang, Zhengxiong Guan, Huajie Qian, Leili Xu, Hengbo Liu, Qingsong Wen, Liang Sun, Junwei Jiang, Lunting Fan, Min Ke

As business of Alibaba expands across the world among various industries, higher standards are imposed on the service quality and reliability of big data cloud computing platforms which constitute the infrastructure of Alibaba Cloud.

Anomaly Detection Cloud Computing +1

Two-Stage Framework for Seasonal Time Series Forecasting

no code implementations3 Mar 2021 Qingyang Xu, Qingsong Wen, Liang Sun

By incorporating the learned long-range structure, the second stage can enhance the prediction accuracy in the forecast horizon.

Time Series Time Series Forecasting +1

RobustPeriod: Time-Frequency Mining for Robust Multiple Periodicity Detection

2 code implementations21 Feb 2020 Qingsong Wen, Kai He, Liang Sun, Yingying Zhang, Min Ke, Huan Xu

Periodicity detection is a crucial step in time series tasks, including monitoring and forecasting of metrics in many areas, such as IoT applications and self-driving database management system.

Anomaly Detection Clustering +3

RobustSTL: A Robust Seasonal-Trend Decomposition Algorithm for Long Time Series

1 code implementation5 Dec 2018 Qingsong Wen, Jingkun Gao, Xiaomin Song, Liang Sun, Huan Xu, Shenghuo Zhu

Based on the extracted trend, we apply the the non-local seasonal filtering to extract the seasonality component.

Anomaly Detection Time Series +1

Cannot find the paper you are looking for? You can Submit a new open access paper.