Abstract: Various computer-implemented methods for utilizing a modified upper confidence bound (UCB) in an agent-simulator environment in well placement planning for oil fields are disclosed herein. A set of well placement sequences for placing well in a geographical region may be received, where each well placement sequent defines a sequence of multiple oil wells to be placed within the geographical region. A computer-implemented simulation may be executed on each of the well placement sequences to determine, for each of the well placement sequences, a reward based upon a calculated hydrocarbon recovery and a cost of the calculated hydrocarbon recovery. The well placement sequences may be iteratively selected for the computer-implemented simulations using the modified UCB algorithm and based upon the rewards determined for each of the plurality of well placement sequences.

Abstract: Various computer-implemented methods for utilizing a modified upper confidence bound (UCB) in an agent-simulator environment in well placement planning for oil fields are disclosed herein. A set of well placement sequences for placing well in a geographical region may be received, where each well placement sequent defines a sequence of multiple oil wells to be placed within the geographical region. A computer-implemented simulation may be executed on each of the well placement sequences to determine, for each of the well placement sequences, a reward based upon a calculated hydrocarbon recovery and a cost of the calculated hydrocarbon recovery. The well placement sequences may be iteratively selected for the computer-implemented simulations using the modified UCB algorithm and based upon the rewards determined for each of the plurality of well placement sequences.

Abstract: A method may include determining an action associated with field development planning or asset management of an oilfield based on a policy or value function and a state, simulating a reward of the action using information identifying the action and the state as inputs, generating an experience record based on executing the simulation, wherein the experience record identifies the simulated reward associated with the action and a current state or resulting state, storing the experience record in an experience buffer, wherein the experience buffer stores a plurality of previously generated experience records, updating the policy or value function based on the information stored in the experience buffer, selecting an action related to the field development planning based on the updated policy, and displaying information representing the action.

Abstract: A subsurface structure identification system includes one or more processors and a memory coupled to the one or more processors. The memory is encoded with instructions that when executed by the one or more processors cause the one or more processors to provide a convolutional neural network trained to identify a subsurface structure in an input migrated seismic volume, and to partition the input migrated seismic volume into multi-dimensional sub-volumes of seismic data. The instructions also cause the one or more processors to process each of the multi-dimensional sub-volumes of seismic data in the convolutional neural network, and identify the subsurface structure in the input migrated seismic volume based on a probability map of the input migrated seismic volume generated by the convolutional neural network.

Abstract: Various computer-implemented methods for utilizing a modified upper confidence bound (UCB) in an agent-simulator environment in well placement planning for oil fields are disclosed herein. A set of well placement sequences for placing well in a geographical region may be received, where each well placement sequent defines a sequence of multiple oil wells to be placed within the geographical region. A computer-implemented simulation may be executed on each of the well placement sequences to determine, for each of the well placement sequences, a reward based upon a calculated hydrocarbon recovery and a cost of the calculated hydrocarbon recovery. The well placement sequences may be iteratively selected for the computer-implemented simulations using the modified UCB algorithm and based upon the rewards determined for each of the plurality of well placement sequences.