ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation

no code implementations • 23 May 2024 • Jingnan Zheng, Han Wang, An Zhang, Tai D. Nguyen, Jun Sun, Tat-Seng Chua

Systematic analysis also validates that the generated test scenarios represent meaningful use cases, as well as integrate enhanced measures to probe long-tail risks.

Robust Collaborative Filtering to Popularity Distribution Shift

1 code implementation • 16 Oct 2023 • An Zhang, Wenchang Ma, Jingnan Zheng, Xiang Wang, Tat-Seng Chua

The popularity shortcut tricks are good for in-distribution (ID) performance but poorly generalized to out-of-distribution (OOD) data, i. e., when popularity distribution of test data shifts w. r. t.

Collaborative Filtering

Invariant Collaborative Filtering to Popularity Distribution Shift

1 code implementation • 10 Feb 2023 • An Zhang, Jingnan Zheng, Xiang Wang, Yancheng Yuan, Tat-Seng Chua

Collaborative Filtering (CF) models, despite their great success, suffer from severe performance drops due to popularity distribution shifts, where these changes are ubiquitous and inevitable in real-world scenarios.

Collaborative Filtering Representation Learning

OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services

1 code implementation • 3 Mar 2021 • Xiao Liu, Da Yin, Jingnan Zheng, Xingjian Zhang, Peng Zhang, Hongxia Yang, Yuxiao Dong, Jie Tang

Academic knowledge services have substantially facilitated the development of the science enterprise by providing a plenitude of efficient research tools.

Language Modelling Link Prediction