Virtual Hardware-in-the-Loop FMU Co-Simulation Based Digital Twins for Heating, Ventilation, and Air-Conditioning (HVAC) Systems

In this paper, a novel self-adaptive control method based on a digital twin is developed and investigated for a multi-input multi-output (MIMO) nonlinear system, which is a heating, ventilation, and air-conditioning system. For this purpose, hardware-in-loop (HIL) and software-in-loop (SIL) are integrated to develop the digital twin control concept in a straightforward manner. A nonlinear integral backstepping (NIB) model-free control technique is integrated with the HIL (implemented as a physical controller) and SIL (implemented as a virtual controller) controllers to control the HVAC system without the need for dynamic feature identification. The main goal is to design the virtual controller to minimize the distinction between system outputs in the SIL and HIL setups. For this purpose, Deep Reinforcement Learning (DRL) is applied to update the NIB controller coefficients of the virtual controller based on the measured data of the physical controller. Since the temperature and humidity of HVAC systems should be regulated, the NIB controllers in the HIL and SIL are designed by the DRL algorithm in a multi-objective scheme (MO). In particular, the simulations of the HIL and SIL environments are coupled by a new advanced tool: function mockup interface (FMI) standard. The Functional Mock-up Unit (FMU) is adopted into the FMI interface for data exchange. The extensive research of HIL and SIL controllers shows that the system outputs of the virtual controller are controlled exactly according to the physical controller.