Reinforcement learning based controller for power electronics converters
Prof. Hani Vahedi
TU Delft, the Netherlands
This lecture explores the development and implementation of AI-based control strategies for power electronics converters, focusing on reinforcement learning (RL) controllers for the 5-level Packed U-Cell (PUC5) grid-connected inverter. Traditional model-based controllers, such as Model Predictive Control (MPC) and Sliding Mode Control (SMC), achieve precise current regulation but are heavily dependent on system parameters. In contrast, reinforcement learning provides a model-free approach capable of handling nonlinearities and uncertainties. The proposed RL-based controller leverages a Proportional-Integral (PI) reward function, streamlining the training process by decoupling voltage balancing from the RL control objective. Instead, voltage balancing is managed via redundant switching states, significantly reducing the action space and training complexity. This study highlights the potential of RL as a robust and adaptive control solution for multilevel inverters, offering a promising alternative to conventional control methods.
Biography
Hani Vahedi (Senior Member, IEEE) received his Ph.D. with honors from École de Technologie Supérieure (ÉTS), Université du Québec, Montreal, in 2016. He has authored over 100 IEEE conference and journal papers, a Springer Nature book, and a book chapter published by Elsevier. He has been an active member of the IEEE Industrial Electronics Society (IES) since 2012, serving on the local organizing committee for IECON12 in Montreal, acting as Students and Young Professionals Chair for numerous IES-sponsored conferences from 2016 to 2024, and serving as Technical Program Chair (GreenTech Cluster) for IECON25 in Madrid, as well as Special Sessions Chair for IECON26 in Doha. He currently manages the IES Chapters & Joint Chapters Program. He is an Associate Editor for the IEEE Transactions on Industrial Electronics, the IEEE Open Journal of the IES, and the IEEE Open Journal of Power Electronics. Dr. Vahedi is the inventor of the 5-level Packed U-Cell (PUC5) converter, holds several U.S. and international patents, and transferred this technology to industry, assisting in the development of a bidirectional EV charger based on his invention. After 7 years in the industry working as a power electronics designer and later as Chief Scientific Officer, he joined Delft University of Technology as an Assistant Professor to advance electrification for the clean energy transition. He leads TU Delft’s 24/7 Energy Hub at The Green Village, an operational microgrid that integrates renewables, green hydrogen production, and hybrid energy storage systems.