TimeSeriesBench: An Industrial-Grade Benchmark for Time Series Anomaly Detection Models

1 code implementation • 16 Feb 2024 • Haotian Si, Changhua Pei, Hang Cui, Jingwen Yang, Yongqian Sun, Shenglin Zhang, Jingjing Li, Haiming Zhang, Jing Han, Dan Pei, Jianhui Li, Gaogang Xie

The performance of testing newly incoming unseen time series on current TSAD algorithms remains unknown.

Anomaly Detection Time Series +1

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

1 code implementation • 11 Oct 2023 • Yuhe Liu, Changhua Pei, Longlong Xu, Bohan Chen, Mingze Sun, Zhirui Zhang, Yongqian Sun, Shenglin Zhang, Kun Wang, Haiming Zhang, Jianhui Li, Gaogang Xie, Xidao Wen, Xiaohui Nie, Minghua Ma, Dan Pei

Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems.

Hallucination In-Context Learning +2

A Survey of Time Series Anomaly Detection Methods in the AIOps Domain

no code implementations • 1 Aug 2023 • Zhenyu Zhong, Qiliang Fan, Jiacheng Zhang, Minghua Ma, Shenglin Zhang, Yongqian Sun, QIngwei Lin, Yuzhi Zhang, Dan Pei

Internet-based services have seen remarkable success, generating vast amounts of monitored key performance indicators (KPIs) as univariate or multivariate time series.

Anomaly Detection Time Series +1

UniLog: Deploy One Model and Specialize it for All Log Analysis Tasks

no code implementations • 6 Dec 2021 • Yichen Zhu, Weibin Meng, Ying Liu, Shenglin Zhang, Tao Han, Shimin Tao, Dan Pei

UniLog: Deploy One Model and Specialize it for All Log Analysis Tasks