Patent ID: 11861702
Assignee: NATIONAL TSING HUA UNIVERSITY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. An apparatus for renewable-energy allocation based on reinforcement learning, the apparatus for renewable-energy allocation serving as an energy aggregator to coordinate supply-demand allocation of renewable energy between a plurality of energy suppliers and a plurality of energy demanders, the apparatus for renewable-energy allocation comprising:
an energy storage system, configured to store the renewable energy;
a connection device, configured to connect each of the energy suppliers and each of the energy demanders;
a storage device, configured to store computer programs; and
a processor, coupled to the energy storage system, the connection device, and the storage device, and configured to load and execute the computer programs to:
collect historical power-generation data of each of the energy suppliers, so as to generate a renewable-energy index representing uncertainty of the renewable energy;
collect at least one market index related to renewable-energy market dynamics and integrate the at least one market index with the renewable-energy index and electricity information of the energy storage system into a plurality of states of a Markov decision process;
input the states to a reinforcement learning model, so as to determine a price bid for each of the energy suppliers and the energy demanders through computation of the reinforcement learning model; and
according to a supply amount and a demand amount proposed by the energy suppliers and the energy demanders in response to the price bids, adjust the energy storage system and coordinate supply and demand of the renewable energy between the energy suppliers and the energy demanders, and update the reinforcement learning model.