Abstract-In electrical power engineering, reinforcement learning algorithms can be used to model the strategies of electricity market participants. However, traditional value function based reinforcement learning algorithms suffer from convergence issues when used with value function approximators. Function approximation is required in this domain to capture the characteristics of the complex and continuous multivariate problem space. The contribution of this paper is the comparison of policy gradient reinforcement learning methods, using artificial neural networks for policy function approximation, with traditional value function based methods in simulations of electricity trade. The methods are compared using an AC optimal power flow based power exchange auction market model and a reference electric power system model.
The policy gradient reinforcement learning implemented by artificial neural network for the simulated electric power trade shows the result of maximizing the performance REF .
Comparing Policy Gradient and Value Function Based Reinforcement Learning Methods in Simulated Electrical Power Trade
IEEE Transactions on Power Systems
IEEE Transactions on Power Systems
Computer Science