Abstract The 5th Generation (5G) and beyond networks are expected to offer huge
throughputs, connect large number of devices, support low latency and large numbers of …

Due to large specific surface area, abundant functional groups and low cost, biochar is
widely used for pollutant removal. The adsorption performance of biochar is related to …

Ubiquitous utilization of Information and Communication Technologies in modern
manufacturing plants has transformed them into Cyber-Physical Systems (CPSs), making …

In recent years, flying ad hoc networks have attracted the attention of many researchers in
industry and universities due to easy deployment, proper operational costs, and diverse …

Dealing with non-stationarity in environments (eg, in the transition dynamics) and objectives
(eg, in the reward functions) is a challenging problem that is crucial in real-world …

Serendipitous recommendations have emerged as a compelling approach to deliver users
with unexpected yet valuable information, contributing to heightened user satisfaction and …

We consider model-free reinforcement learning (RL) in non-stationary Markov decision
processes. Both the reward functions and the state transition functions are allowed to vary …

Anomaly detection has been used to detect and analyze anomalous elements from data for
years. Various techniques have been developed to detect anomalies. However, the most …

When faced with sequential decision-making problems, it is often useful to be able to predict
what would happen if decisions were made using a new policy. Those predictions must …

Today, the use of safety solutions in Intelligent Transportation Systems (ITS) is a serious
challenge because of novel progress in wireless technologies and the high number of road …