no code implementations • 11 Nov 2023 • Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu
Then, for both AoII under the perfect channel setup and distortion, we express the belief as a function of the age of information (AoI).
no code implementations • 3 Apr 2023 • Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu
Then, for the perfect channel setup, we effectively truncate the corresponding belief space and solve the MDP problem using the relative value iteration method.
no code implementations • 23 Sep 2022 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
This letter provides query-age-optimal joint sampling and transmission scheduling policies for a heterogeneous status update system, consisting of a stochastic arrival and a generate-at-will source, with an unreliable channel.
no code implementations • 19 Jul 2022 • Saeid Sadeghi Vilni, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
Finally, we consider unknown environment and devise a learning-based transmission policy by relaxing the CMDP problem into an MDP problem using the DPP method and then adopting the deep Q-learning algorithm.
no code implementations • 10 Mar 2022 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
The CMDP problem is solved by transforming it into an MDP problem using the Lagrangian relaxation method.
no code implementations • 10 Sep 2021 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
We propose an algorithm that obtains a stationary deterministic near-optimal policy, establishing a benchmark for the system.