no code implementations • 26 Feb 2024 • Hantao Yang, Xutong Liu, Zhiyong Wang, Hong Xie, John C. S. Lui, Defu Lian, Enhong Chen
We study the problem of federated contextual combinatorial cascading bandits, where $|\mathcal{U}|$ agents collaborate under the coordination of a central server to provide tailored recommendations to the $|\mathcal{U}|$ corresponding users.
no code implementations • 30 Mar 2023 • Xutong Liu, Jinhang Zuo, Siwei Wang, John C. S. Lui, Mohammad Hajiesmaili, Adam Wierman, Wei Chen
We study contextual combinatorial bandits with probabilistically triggered arms (C$^2$MAB-T) under a variety of smoothness conditions that capture a wide range of applications, such as contextual cascading bandits and contextual influence maximization bandits.
1 code implementation • 1 Mar 2023 • Zhiyong Wang, Xutong Liu, Shuai Li, John C. S. Lui
To tackle these issues, we first propose ``ConLinUCB", a general framework for conversational bandits with better information incorporation, combining arm-level and key-term-level feedback to estimate user preference in one step at each time.
no code implementations • 15 Feb 2023 • Yu-Zhen Janice Chen, Lin Yang, Xuchuang Wang, Xutong Liu, Mohammad Hajiesmaili, John C. S. Lui, Don Towsley
We propose ODC, an on-demand communication protocol that tailors the communication of each pair of agents based on their empirical pull times.
no code implementations • 31 Aug 2022 • Xutong Liu, Jinhang Zuo, Siwei Wang, Carlee Joe-Wong, John C. S. Lui, Wei Chen
Under this new condition, we propose a BCUCB-T algorithm with variance-aware confidence intervals and conduct regret analysis which reduces the $O(K)$ factor to $O(\log K)$ or $O(\log^2 K)$ in the regret bound, significantly improving the regret bounds for the above applications.
1 code implementation • 31 Aug 2022 • Xutong Liu, Haoru Zhao, Tong Yu, Shuai Li, John C. S. Lui
Contextual multi-armed bandit (MAB) is an important sequential decision-making problem in recommendation systems.
no code implementations • 9 Jun 2021 • Xutong Liu, Jinhang Zuo, Xiaowei Chen, Wei Chen, John C. S. Lui
For the online learning setting, neither the network structure nor the node weights are known initially.
no code implementations • 24 Jun 2020 • Jinhang Zuo, Xutong Liu, Carlee Joe-Wong, John C. S. Lui, Wei Chen
In this paper, we introduce a new Online Competitive Influence Maximization (OCIM) problem, where two competing items (e. g., products, news stories) propagate in the same network and influence probabilities on edges are unknown.
1 code implementation • 7 Oct 2018 • Xutong Liu, Yu-Zhen Janice Chen, John C. S. Lui, Konstantin Avrachenkov
The number of each graphlet, called graphlet count, is a signature which characterizes the local network structure of a given graph.