Composable life under the extensive global warming of the Earth encourages the progress of renewable energy devices and the adoption of new technologies, such as artificial intelligence. Regarding enormous potential of wave energy and its consistency, wave energy converter (WEC) plays vital role in uniform energy harvesting field. In this paper, the significant environmental changes in the ocean prompt us to propose an intelligent feedback control system to mitigate the impact of disturbances and variable wind effects on the efficacy of WECs. Deep reinforcement learning (DRL), as a powerful machine intelligence technique, is capable of identifying WECs as black-box models. Therefore, based on the DRL model, the disturbance and unmeasured state variables are simultaneously estimated in the extended state observer section. Leakage in identification data and real-time application requirements of limited number of layers in the deep neural networks are compensated by implementation of immersion and invariance-based extended state observer which improves coping with the unwanted exogenous noises as well. In the overall intelligent control system, the estimated parameters are inputted into the DRL as the actor-critic networks. The initial actor network is responsible for predicting the control action, while the subsequent critic network determines the decision criterion for evaluating the accuracy of the actor's estimated amount. Next, the output value of the critic stage is backpropagated through the layers to update the network weights. The simulation test results in MATLAB indicate the convergence of unmeasured parameters/states to the corresponding true values and the significance of newly designed intelligent DRL method.
Keighobadi J, KhalafAnsar HM, Naseradinmousavi P. Adaptive neural dynamic surface control for uniform energy exploitation of floating wind turbine. Applied Energy. 2022;316:119132. https://doi.org/10.1016/j.apenergy.2022.119132
Nielsen KM, Pedersen TS, Andersen P, Ambühl S. Optimizing control of wave energy converter with losses and fatigue in power take off. IFAC-PapersOnLine. 2017;50(1):14680-5. https://doi.org/10.1016/j.ifacol.2017.08.2497
Sadripour G, Shafaghat R, Alizadeh Kharkeshi B, Tabassom R, Mahmoudi A. Installation Depth and Incident Wave Height Effect on Hydrodynamic Performance of a Flap Type Wave Energy Converter: Experimental Analysis. International Journal of Engineering. 2022;35(12):2283-90. https://doi.org/10.5829/ije.2022.35.12c.02
Arish N, Marignetti F. Evaluation of Linear Permanent Magnet Vernier Machine Topologies for Wave Energy Converters. International Journal of Engineering. 2021;34(2):403-13. https://doi.org/10.5829/ije.2021.34.02b.12
Bayani R, Farhadi M, Shafaghat R, Alamian R. Experimental evaluation of irwec1, a novel offshore wave energy converter. International Journal of Engineering. 2016;29(9):1292-9. https://doi.org/10.5829/idosi.ije.2016.29.09c.15
Alizadeh Kharkeshi B, Shafaghat R, Jahanian O, Alamian R. Experimental evaluation of the effect of dimensionless hydrodynamic coefficients on the performance of a multi-chamber oscillating water column converter in laboratory scale. Modares Mechanical Engineering. 2021;21(12):823-34. http://mme.modares.ac.ir/article-15-52993-en.html
Son D, Yeung RW. Real-time implementation and validation of optimal damping control for a permanent-magnet linear generator in wave energy extraction. Applied energy. 2017;208:571-9. https://doi.org/10.1016/j.apenergy.2017.09.097
Korde UA. Preliminary consideration of energy storage requirements for sub-optimal reactive control of axisymmetric wave energy devices. Annual Reviews in Control. 2015;40:93-101. https://doi.org/10.1016/j.arcontrol.2015.08.004
Anderlini E, Forehand D, Bannon E, Xiao Q, Abusara M. Reactive control of a two-body point absorber using reinforcement learning. Ocean Engineering. 2018;148:650-8. https://doi.org/10.1016/j.oceaneng.2017.08.017
Babarit A, Duclos G, Clément AH. Comparison of latching control strategies for a heaving wave energy device in random sea. Applied Ocean Research. 2004;26(5):227-38. https://doi.org/10.1016/j.apor.2005.05.003
Wu J, Yao Y, Zhou L, Göteman M. Real-time latching control strategies for the solo Duck wave energy converter in irregular waves. Applied Energy. 2018;222:717-28. https://doi.org/10.1016/j.apenergy.2018.04.033
Faedo N, Olaya S, Ringwood JV. Optimal control, MPC and MPC-like algorithms for wave energy systems: An overview. IFAC Journal of Systems and Control. 2017;1:37-56. https://doi.org/10.1016/j.ifacsc.2017.07.001
Hals J, Falnes J, Moan T. Constrained optimal control of a heaving buoy wave-energy converter. 2011. https://doi.org/10.1115/1.4001431
O'Sullivan AC, Lightbody G. Co-design of a wave energy converter using constrained predictive control. Renewable energy. 2017;102:142-56. https://doi.org/10.1016/j.renene.2016.10.034
Li L, Yuan Z, Gao Y. Maximization of energy absorption for a wave energy converter using the deep machine learning. Energy. 2018;165:340-9. https://doi.org/10.1016/j.energy.2018.09.093
Zou S, Abdelkhalik O, Robinett R, Korde U, Bacelli G, Wilson D, et al. Model Predictive Control of parametric excited pitch-surge modes in wave energy converters. International journal of marine energy. 2017;19:32-46. https://doi.org/10.1016/j.ijome.2017.05.002
Korde UA, Lyu J, Robinett III RD, Wilson DG, Bacelli G, Abdelkhalik OO. Constrained near-optimal control of a wave energy converter in three oscillation modes. Applied Ocean Research. 2017;69:126-37. https://doi.org/10.1016/j.apor.2017.10.004
Burgaç A, Yavuz H. Fuzzy Logic based hybrid type control implementation of a heaving wave energy converter. Energy. 2019;170:1202-14. https://doi.org/10.1016/j.energy.2018.12.090
Han J. From PID to active disturbance rejection control. IEEE transactions on Industrial Electronics. 2009;56(3):900-6. https://doi.org/10.1109/TIE.2008.2011621
Zhao Z-L, Guo B-Z. On convergence of nonlinear active disturbance rejection control for SISO nonlinear systems. Journal of Dynamical and Control Systems. 2016;22(2):385-412. https://doi.org/10.1007/s10883-015-9304-5
Hosseini-Pishrobat M, Keighobadi J. Extended state observer-based robust non-linear integral dynamic surface control for triaxial MEMS gyroscope. Robotica. 2019;37(3):481-501. https://doi.org/10.1017/S0263574718001133
Guo B-Z, Zhao Z-l. On the convergence of an extended state observer for nonlinear systems with uncertainty. Systems & Control Letters. 2011;60(6):420-30. https://doi.org/10.1016/j.sysconle.2011.03.008
Li J, Xia Y, Qi X, Wan H. On convergence of the discrete-time nonlinear extended state observer. Journal of the Franklin Institute. 2018;355(1):501-19. https://doi.org/10.1016/j.jfranklin.2017.11.019
Mohammadian KhalafAnsara, H., & Keighobadi, J. (2024). Deep Reinforcement Learning with Immersion- and Invariance-based State Observer Control of Wave Energy Converters. International Journal of Engineering, 37(6), 1085-1097. doi: 10.5829/ije.2024.37.06c.05
MLA
H. Mohammadian KhalafAnsara; J. Keighobadi. "Deep Reinforcement Learning with Immersion- and Invariance-based State Observer Control of Wave Energy Converters". International Journal of Engineering, 37, 6, 2024, 1085-1097. doi: 10.5829/ije.2024.37.06c.05
HARVARD
Mohammadian KhalafAnsara, H., Keighobadi, J. (2024). 'Deep Reinforcement Learning with Immersion- and Invariance-based State Observer Control of Wave Energy Converters', International Journal of Engineering, 37(6), pp. 1085-1097. doi: 10.5829/ije.2024.37.06c.05
VANCOUVER
Mohammadian KhalafAnsara, H., Keighobadi, J. Deep Reinforcement Learning with Immersion- and Invariance-based State Observer Control of Wave Energy Converters. International Journal of Engineering, 2024; 37(6): 1085-1097. doi: 10.5829/ije.2024.37.06c.05
)
)