CLUE: Safe Model-Based RL HVAC Control Using Epistemic Uncertainty Estimation

Z An, X Ding, A Rathee, W Du - … of the 10th ACM International Conference …, 2023 - dl.acm.org
Model-Based Reinforcement Learning (MBRL) has been widely studied for Heating,
Ventilation, and Air Conditioning (HVAC) control in buildings. One of the fundamental …

Drlic: Deep reinforcement learning for irrigation control

X Ding, W Du - 2022 21st ACM/IEEE International Conference …, 2022 - ieeexplore.ieee.org
Agricultural irrigation is a major consumer of freshwater. Current irrigation systems used in
the field are not efficient, since they are mainly based on soil moisture sensors' …

Exploring deep reinforcement learning for holistic smart building control

X Ding, A Cerpa, W Du - arXiv preprint arXiv:2301.11510, 2023 - arxiv.org
In this paper, we take a holistic approach to deal with the tradeoffs between energy use and
comfort in commercial buildings. We developed a system called OCTOPUS, which employs …

Multi-zone hvac control with model-based deep reinforcement learning

X Ding, A Cerpa, W Du - IEEE Transactions on Automation …, 2024 - ieeexplore.ieee.org
The application of reinforcement learning in controlling Heating, Ventilation, and Air
Conditioning (HVAC) systems has been extensively researched. Existing studies primarily …

MODES: M ulti-sensor o ccupancy d ata-driven e stimation s ystem for smart buildings

H Rajabi, Z Hu, X Ding, S Pan, W Du… - Proceedings of the …, 2022 - dl.acm.org
Buildings account for more than 40% of the energy US primary energy consumption. Of all
the building services, heating, ventilation, and air-conditioning (HVAC) account for almost …

Optimizing Irrigation Efficiency using Deep Reinforcement Learning in the Field

X Ding, W Du - arXiv preprint arXiv:2304.01435, 2023 - arxiv.org
Agricultural irrigation is a significant contributor to freshwater consumption. However, the
current irrigation systems used in the field are not efficient. They rely mainly on soil moisture …

Fault Detection for High-Speed Trains Using CCA and Just-in-Time Learning

H Zheng, K Zhu, C Cheng, Z Fu - Machines, 2022 - mdpi.com
Online monitors of the running gears systems of high-speed trains play critical roles in
ensuring operational safety and reliability. Status signals collected from high-speed train …

Blockchain Facilitated Protection and Safety in Cyberphysical Systems from Defective Sensors

P Banerjee, K Guha - 2023 14th International Conference on …, 2023 - ieeexplore.ieee.org
The cyber physical systems (CPS) are linked to a range of sensors, the data from which is
used for decision making and real-time operation. With the introduction of Industry 5.0, which …

Cyber-Physical Systems Optimization with Reinforcement Learning: Methods and Applications

X Ding - 2023 - escholarship.org
Cyber-physical systems rely on many control and decision-making algorithms. However, the
majority of cyber-physical systems today are still operated by simple rule-based and …

[PDF][PDF] Fault Detection for High-Speed Trains Using CCA and Just-in-Time Learning. Machines 2022, 10, 526

H Zheng, K Zhu, C Cheng, Z Fu - Deep Learning-Based Machinery Fault …, 2022 - mdpi.com
Online monitors of the running gears systems of high-speed trains play critical roles in
ensuring operational safety and reliability. Status signals collected from high-speed train …