Search Results for author:
Found 8 papers, 0 papers with code
Fixed-Budget Differentially Private Best Arm Identification
We study best arm identification (BAI) in linear bandits in the fixed-budget regime under differential privacy constraints, when the arm rewards are supported on the unit interval.
Optimal Best Arm Identification with Fixed Confidence in Restless Bandits
It is shown that under every policy, the state-action visitation proportions satisfy a specific approximate flow conservation constraint and that these proportions match the optimal proportions dictated by the lower bound under any asymptotically optimal policy.
Best Arm Identification in Bandits with Limited Precision Sampling
The pulled arm and its instantaneous reward are revealed to the learner, whose goal is to find the best arm by minimising the expected stopping time, subject to an upper bound on the error probability.
Federated Best Arm Identification with Heterogeneous Clients
Furthermore, we show that for any algorithm whose upper bound on the expected stopping time matches with the lower bound up to a multiplicative constant ({\em almost-optimal} algorithm), the ratio of any two consecutive communication time instants must be {\em bounded}, a result that is of independent interest.
Almost Cost-Free Communication in Federated Best Arm Identification
The local best arm at a client is the arm with the largest mean among the arms local to the client, whereas the global best arm is the arm with the largest average mean across all the clients.
Best Arm Identification in Restless Markov Multi-Armed Bandits
For this problem, we derive the first-known problem instance-dependent asymptotic lower bound on the growth rate of the expected time required to find the index of the best arm, where the asymptotics is as the error probability vanishes.
Learning to Detect an Odd Restless Markov Arm with a Trembling Hand
This paper studies the problem of finding an anomalous arm in a multi-armed bandit when (a) each arm is a finite-state Markov process, and (b) the arms are restless.
Detecting an Odd Restless Markov Arm with a Trembling Hand
The state space is common across the arms, and the arms are independent of each other.
