Abstract: Sum of bid quantities (across price bands) placed by generators in energy markets have been observed to be either constant OR varying over a few finite values. Several researches have used simulated data to investigate desired aspect. However, these approaches have not been accurate in prediction. Embodiments of the present disclosure identified two sets of generators which needed specialized methods for regression (i) generators whose total bid quantity (TBQ) was constant (ii) generators whose total bid quantity varied over a few finite values only. In first category, present disclosure used a softmax output based ANN regressor to capture constant total bid quantity nature of targets and a loss function while training to capture error most meaningfully. For second category, system predicts total bid quantity (TBQ) of a generator and then predicts to allocate TBQ predicted across the various price bands which is accomplished by the softmax regression for constant TBQs.

Abstract: In energy markets in which bidding process is used to sell energy, it is important that a mechanism for deciding bidding amount is in place. State of the art systems in this domain have the disadvantage that they rely on simulation data, and also they make certain assumptions, and both the factors can affect accuracy of results when the systems are deployed and are expected to handle practical scenarios. The disclosure herein generally relates to energy markets, and, more particularly, to a method and a system for Reinforcement Learning (RL) based model for generating bids. The system trains a RL agent using historical data with respect to competitor bids places and Market Clearing Prices (MCPs). The RL agent then processes real-time inputs and generates bidding recommendations.

Abstract: This disclosure relates to method and system for optimal policy learning and recommendation for distribution task using deep RL model, in applications where when the action space has a probability simplex structure. The method includes training a RL agent by defining a policy network for learning the optimal policy using a policy gradient (PG) method, where the policy network comprising an artificial neural network (ANN) with a set of outputs. A continuous action space having a continuous probability simplex structure is defined. The learning of the optimal policy is updated based on one of stochastic and deterministic PG. For stochastic PG, a Dirichlet distribution based stochastic policy parameterized by output of the ANN with an activation function at an output layer of the ANN is selected. For deterministic PG, a soft-max function is selected as activation function at the output layer of the ANN to maintain the probability simplex structure.

Abstract: In energy markets in which bidding process is used to sell energy, it is important that a mechanism for deciding bidding amount is in place. State of the art systems in this domain have the disadvantage that they rely on simulation data, and also they make certain assumptions, and both the factors can affect accuracy of results when the systems are deployed and are expected to handle practical scenarios. The disclosure herein generally relates to energy markets, and, more particularly, to a method and a system for Reinforcement Learning (RL) based model for generating bids. The system trains a RL agent using historical data with respect to competitor bids places and Market Clearing Prices (MCPs). The RL agent then processes real-time inputs and generates bidding recommendations.

Abstract: Sum of bid quantities (across price bands) placed by generators in energy markets have been observed to be either constant OR varying over a few finite values. Several researches have used simulated data to investigate desired aspect. However, these approaches have not been accurate in prediction. Embodiments of the present disclosure identified two sets of generators which needed specialized methods for regression (i) generators whose total bid quantity (TBQ) was constant (ii) generators whose total bid quantity varied over a few finite values only. In first category, present disclosure used a softmax output based ANN regressor to capture constant total bid quantity nature of targets and a loss function while training to capture error most meaningfully. For second category, system predicts total bid quantity (TBQ) of a generator and then predicts to allocate TBQ predicted across the various price bands which is accomplished by the softmax regression for constant TBQs.