Search Results for author: Fugee Tsung

Found 28 papers, 12 papers with code

LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting

no code implementations24 Nov 2024 Lingzheng Zhang, Lifeng Shen, Yimin Zheng, Shiyuan Piao, Ziyue Li, Fugee Tsung

Building on recent advancements in using linear models for time series, this paper introduces an LLM-enhanced mixture of linear experts for precise and efficient time series forecasting.

Computational Efficiency Natural Language Understanding +3

Heterophilic Graph Neural Networks Optimization with Causal Message-passing

no code implementations21 Nov 2024 Botao Wang, Jia Li, Heng Chang, Keli Zhang, Fugee Tsung

We then present an analysis of decomposing the optimization target into a consistency penalty and a structure modification based on cause-effect relations.

Causal Inference Graph Learning +3

Graph Pre-Training Models Are Strong Anomaly Detectors

no code implementations24 Oct 2024 Jiashun Cheng, Zinan Zheng, Yang Liu, Jianheng Tang, Hongwei Wang, Yu Rong, Jia Li, Fugee Tsung

Graph Anomaly Detection (GAD) is a challenging and practical research topic where Graph Neural Networks (GNNs) have recently shown promising results.

Graph Anomaly Detection

MCCoder: Streamlining Motion Control with LLM-Assisted Code Generation and Rigorous Verification

1 code implementation19 Oct 2024 Yin Li, Liangwei Wang, Shiyuan Piao, Boo-Ho Yang, Ziyue Li, Wei Zeng, Fugee Tsung

To address these challenges, we introduce MCCoder, an LLM-powered system designed to generate code that addresses complex motion control tasks, with integrated soft-motion data verification.

Code Generation RAG

Disentangling Likes and Dislikes in Personalized Generative Explainable Recommendation

no code implementations17 Oct 2024 Ryotaro Shimizu, Takashi Wada, Yu Wang, Johannes Kruse, Sean O'Brien, Sai HtaungKham, Linxin Song, Yuya Yoshikawa, Yuki Saito, Fugee Tsung, Masayuki Goto, Julian McAuley

Specifically, we construct the datasets by explicitly extracting users' positive and negative opinions from their post-purchase reviews using an LLM, and propose to evaluate systems based on whether the generated explanations 1) align well with the users' sentiments, and 2) accurately identify both positive and negative opinions of users on the target items.

Explainable Recommendation Text Generation

Toward Physics-guided Time Series Embedding

1 code implementation9 Oct 2024 Jiaxi Hu, BoWen Zhang, Qingsong Wen, Fugee Tsung, Yuxuan Liang

This theory enables us to bypass the parameterized embedding layer and directly employ physical reconstruction techniques to acquire a data embedding representation.

Time Series Time Series Analysis

Agent-Oriented Planning in Multi-Agent Systems

1 code implementation3 Oct 2024 Ao Li, Yuexiang Xie, Songze Li, Fugee Tsung, Bolin Ding, Yaliang Li

Through the collaboration of multiple agents possessing diverse expertise and tools, multi-agent systems achieve impressive progress in solving real-world problems.

Scheduling

Enabling Tensor Decomposition for Time-Series Classification via A Simple Pseudo-Laplacian Contrast

no code implementations23 Sep 2024 Man Li, Ziyue Li, Lijun Sun, Fugee Tsung

Tensor decomposition has emerged as a prominent technique to learn low-dimensional representation under the supervision of reconstruction error, primarily benefiting data inference tasks like completion and imputation, but not classification task.

Data Augmentation Imputation +3

Parameter-Efficient Fine-Tuning via Circular Convolution

no code implementations27 Jul 2024 Aochuan Chen, Jiashun Cheng, Zijing Liu, Ziqi Gao, Fugee Tsung, Yu Li, Jia Li

Low-Rank Adaptation (LoRA) has gained popularity for fine-tuning large foundation models, leveraging low-rank matrices $\mathbf{A}$ and $\mathbf{B}$ to represent weight changes (i. e., $\Delta \mathbf{W} = \mathbf{B} \mathbf{A}$).

parameter-efficient fine-tuning

DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation

no code implementations7 Jun 2024 Weiqi Zhang, Jiexia Ye, Ziyue Li, Jia Li, Fugee Tsung

In this study, based on the complementary information mining of time series multimodal data, we propose DualTime, a Dual-adapter multimodal language model for Time series representation implementing temporal-primary and textual-primary modeling simultaneously.

Language Modeling Language Modelling +1

A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model

1 code implementation3 May 2024 Jiexia Ye, Weiqi Zhang, Ke Yi, Yongzi Yu, Ziyue Li, Jia Li, Fugee Tsung

There are two main research lines, namely pre-training foundation models from scratch for time series and adapting large language foundation models for time series.

Decision Making Few-Shot Learning +5

Low-Rank Robust Subspace Tensor Clustering for Metro Passenger Flow Modeling

no code implementations5 Apr 2024 Jiuyun Hu, Ziyue Li, Chen Zhang, Fugee Tsung, Hao Yan

Moreover, a case study in the station clustering based on real passenger flow data is conducted, with quite valuable insights discovered.

Clustering Dimensionality Reduction

Tensor-based process control and monitoring for semiconductor manufacturing with unstable disturbances

no code implementations31 Jan 2024 YanRong Li, Juan Du, Fugee Tsung, Wei Jiang

This paper proposes a novel process control and monitoring method for the complex structure of high-dimensional image-based overlay errors (modeled in tensor form), which are collected in semiconductor manufacturing processes.

Choose A Table: Tensor Dirichlet Process Multinomial Mixture Model with Graphs for Passenger Trajectory Clustering

no code implementations31 Oct 2023 Ziyue Li, Hao Yan, Chen Zhang, Lijun Sun, Wolfgang Ketter, Fugee Tsung

In this paper, we propose a novel tensor Dirichlet Process Multinomial Mixture model with graphs, which can preserve the hierarchical structure of the multi-dimensional trip information and cluster them in a unified one-step manner with the ability to determine the number of clusters automatically.

Clustering Community Detection +1

Deep Insights into Noisy Pseudo Labeling on Graph Data

1 code implementation NeurIPS 2023 Botao Wang, Jia Li, Yang Liu, Jiashun Cheng, Yu Rong, Wenjia Wang, Fugee Tsung

We first present the error analysis of PL strategy by showing that the error is bounded by the confidence of PL threshold and consistency of multi-view prediction.

Graph Learning Link Prediction +2

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases

no code implementations25 Aug 2023 Yang Liu, Jiashun Cheng, Haihong Zhao, Tingyang Xu, Peilin Zhao, Fugee Tsung, Jia Li, Yu Rong

Furthermore, we offer theoretical insights into SEGNO, highlighting that it can learn a unique trajectory between adjacent states, which is crucial for model generalization.

Tensor Dirichlet Process Multinomial Mixture Model for Passenger Trajectory Clustering

no code implementations23 Jun 2023 Ziyue Li, Hao Yan, Chen Zhang, Andi Wang, Wolfgang Ketter, Lijun Sun, Fugee Tsung

In this paper, we propose a novel Tensor Dirichlet Process Multinomial Mixture model (Tensor-DPMM), which is designed to preserve the multi-mode and hierarchical structure of the multi-dimensional trip information via tensor, and cluster them in a unified one-step manner.

Clustering Trajectory Clustering

Correlated Time Series Self-Supervised Representation Learning via Spatiotemporal Bootstrapping

1 code implementation12 Jun 2023 Luxuan Wang, Lei Bai, Ziyue Li, Rui Zhao, Fugee Tsung

We evaluated the effectiveness and flexibility of our representation learning framework on correlated time series forecasting and cold-start transferring the forecasting model to new instances with limited data.

Correlated Time Series Forecasting Representation Learning +1

MM-DAG: Multi-task DAG Learning for Multi-modal Data -- with Application for Traffic Congestion Analysis

1 code implementation5 Jun 2023 Tian Lan, Ziyue Li, Zhishuai Li, Lei Bai, Man Li, Fugee Tsung, Wolfgang Ketter, Rui Zhao, Chen Zhang

This encourages the multi-task design: with each DAG as a task, the MM-DAG tries to learn the multiple DAGs jointly so that their consensus and consistency are maximized.

Data Imputation from the Perspective of Graph Dirichlet Energy

1 code implementation10 Apr 2023 Weiqi Zhang, Guanlue Li, Jianheng Tang, Jia Li, Fugee Tsung

In our study, we examine this prevalent strategy through the lens of graph Dirichlet energy.

Imputation

Robust Attributed Graph Alignment via Joint Structure Learning and Optimal Transport

1 code implementation30 Jan 2023 Jianheng Tang, Weiqi Zhang, Jiajin Li, Kangfei Zhao, Fugee Tsung, Jia Li

As the graphs to be aligned are usually constructed from different sources, the inconsistency issues of structures and features between two graphs are ubiquitous in real-world applications.

Graph Embedding

Human Mobility Modeling During the COVID-19 Pandemic via Deep Graph Diffusion Infomax

no code implementations12 Dec 2022 Yang Liu, Yu Rong, Zhuoning Guo, Nuo Chen, Tingyang Xu, Fugee Tsung, Jia Li

To address these challenges, we formulate the micro perspective mobility modeling into computing the relevance score between a diffusion and a location, conditional on a geometric graph.

Handling Missing Data via Max-Entropy Regularized Graph Autoencoder

no code implementations30 Nov 2022 Ziqi Gao, Yifan Niu, Jiashun Cheng, Jianheng Tang, Tingyang Xu, Peilin Zhao, Lanqing Li, Fugee Tsung, Jia Li

In this work, we present a regularized graph autoencoder for graph attribute imputation, named MEGAE, which aims at mitigating spectral concentration problem by maximizing the graph spectral entropy.

Attribute Imputation

Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning

1 code implementation26 Jun 2022 Jiashun Cheng, Man Li, Jia Li, Fugee Tsung

Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs.

Contrastive Learning Decoder +1

Long-Short Term Spatiotemporal Tensor Prediction for Passenger Flow Profile

no code implementations23 Apr 2020 Ziyue Li, Hao Yan, Chen Zhang, Fugee Tsung

Spatiotemporal data is very common in many applications, such as manufacturing systems and transportation systems.

Clustering Tensor Decomposition

Tensor Completion for Weakly-dependent Data on Graph for Metro Passenger Flow Prediction

1 code implementation11 Dec 2019 Ziyue Li, Nurettin Dorukhan Sergin, Hao Yan, Chen Zhang, Fugee Tsung

Low-rank tensor decomposition and completion have attracted significant interest from academia given the ubiquity of tensor data.

Tensor Decomposition

Cannot find the paper you are looking for? You can Submit a new open access paper.