no code implementations • 9 Jul 2024 • Saeid Sadeghi Vilni, Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu
Thus, by exploiting a specific property of the belief evolution, we truncate the state space and formulate a finite-state MDP problem, which is then solved using the relative value iteration algorithm (RVIA).
no code implementations • 11 Nov 2023 • Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu
Then, for both AoII under the perfect channel setup and distortion, we express the belief as a function of the age of information (AoI).
no code implementations • 3 Apr 2023 • Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu
Then, for the perfect channel setup, we effectively truncate the corresponding belief space and solve the MDP problem using the relative value iteration method.
no code implementations • 31 Mar 2023 • Mohammad Hatami, Markus Leinonen, Marian Codreanu
We study status updating under inexact knowledge about the battery levels of the energy harvesting sensors in an IoT network, where users make on-demand requests to a cache-enabled edge node to send updates about various random processes monitored by the sensors.
no code implementations • 12 Dec 2022 • Mohammad Hatami, Markus Leinonen, Marian Codreanu
We consider an energy harvesting (EH) IoT network, where users make on-demand requests to a cache-enabled edge node to send status updates about various random processes, each monitored by an EH sensor.
no code implementations • 23 Sep 2022 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
This letter provides query-age-optimal joint sampling and transmission scheduling policies for a heterogeneous status update system, consisting of a stochastic arrival and a generate-at-will source, with an unreliable channel.
no code implementations • 19 Jul 2022 • Saeid Sadeghi Vilni, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
Finally, we consider unknown environment and devise a learning-based transmission policy by relaxing the CMDP problem into an MDP problem using the DPP method and then adopting the deep Q-learning algorithm.
no code implementations • 19 Mar 2022 • Mohammad Hatami, Markus Leinonen, Marian Codreanu
We consider status updating under inexact knowledge of the battery level of an energy harvesting (EH) sensor that sends status updates about a random process to users via a cache-enabled edge node.
no code implementations • 10 Mar 2022 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
The CMDP problem is solved by transforming it into an MDP problem using the Lagrangian relaxation method.
no code implementations • 28 Jan 2022 • Mohammad Hatami, Markus Leinonen, Zheng Chen, Nikolaos Pappas, Marian Codreanu
We consider a resource-constrained IoT network, where multiple users make on-demand requests to a cache-enabled edge node to send status updates about various random processes, each monitored by an energy harvesting sensor.
no code implementations • 10 Sep 2021 • Abolfazl Zakeri, Mohammad Moltafet, Markus Leinonen, Marian Codreanu
We propose an algorithm that obtains a stationary deterministic near-optimal policy, establishing a benchmark for the system.
no code implementations • 9 Mar 2021 • Elif Uysal, Onur Kaya, Anthony Ephremides, James Gross, Marian Codreanu, Petar Popovski, Mohamad Assaad, Gianluigi Liva, Andrea Munari, Touraj Soleymani, Beatriz Soret, Karl Henrik Johansson
We present our vision for a departure from the established way of architecting and assessing communication networks, by incorporating the semantics of information for communications and control in networked systems.
no code implementations • 9 Sep 2020 • Mohammad Hatami, Markus Leinonen, Marian Codreanu
Users send requests to the edge node where a cache contains the most recently received measurements from each sensor.
no code implementations • 17 May 2020 • Markus Leinonen, Marian Codreanu
In such a quantized compressed sensing (QCS) context, we address remote acquisition of a sparse source through vector quantized noisy compressive measurements.
no code implementations • 27 Apr 2020 • Mohammad Hatami, Mojtaba Jahandideh, Markus Leinonen, Marian Codreanu
We consider an IoT sensing network with multiple users, multiple energy harvesting sensors, and a wireless edge node acting as a gateway between the users and sensors.