Patents by Inventor William Clinton
William Clinton has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240135182Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. In one aspect, a method comprises: receiving a current observation; for each action of a plurality of actions: randomly sampling one or more probability values; for each probability value: processing the action, the current observation, and the probability value using a quantile function network to generate an estimated quantile value for the probability value with respect to a probability distribution over possible returns that would result from the agent performing the action in response to the current observation; determining a measure of central tendency of the one or more estimated quantile values; and selecting an action to be performed by the agent in response to the current observation using the measures of central tendency for the actions.Type: ApplicationFiled: December 15, 2023Publication date: April 25, 2024Inventors: Georg Ostrovski, William Clinton Dabney
-
Patent number: 11887000Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. In one aspect, a method comprises: receiving a current observation; for each action of a plurality of actions: randomly sampling one or more probability values; for each probability value: processing the action, the current observation, and the probability value using a quantile function network to generate an estimated quantile value for the probability value with respect to a probability distribution over possible returns that would result from the agent performing the action in response to the current observation; determining a measure of central tendency of the one or more estimated quantile values; and selecting an action to be performed by the agent in response to the current observation using the measures of central tendency for the actions.Type: GrantFiled: February 15, 2023Date of Patent: January 30, 2024Assignee: DeepMind Technologies LimitedInventors: Georg Ostrovski, William Clinton Dabney
-
Patent number: 11781689Abstract: A tube fitting for connection to a tube includes a main body structure and a tube liner. The main body structure is configured to receive an end of the tube and fluidly connect the tube to another component. The tube liner is positioned at least partially within the main body structure and is configured to extend into the tube. The main body structure and the tube liner are configured such that, when the tube is fully inserted into the tube fitting, the end of the tube is positioned at a predetermined depth within the tube fitting, and the main body structure and the tube liner cooperate together to provide an audible indication to indicate that the tube has been fully inserted into the tube fitting.Type: GrantFiled: March 12, 2021Date of Patent: October 10, 2023Assignee: RELIANCE WORLDWIDE CORPORATIONInventors: Sai Kishore Ravisankar, William Vernon Kluss, Samantha Kelly, Eliana Pippen, Derres Catalano, William Clinton Osteen
-
Patent number: 11755879Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing and storing inputs for use in a neural network. One of the methods includes receiving input data for storage in a memory system comprising a first set of memory blocks, the memory blocks having an associated order; passing the input data to a highest ordered memory block; for each memory block for which there is a lower ordered memory block: applying a filter function to data currently stored by the memory block to generate filtered data and passing the filtered data to a lower ordered memory block; and for each memory block: combining the data currently stored in the memory block with the data passed to the memory block to generate updated data, and storing the updated data in the memory block.Type: GrantFiled: February 11, 2019Date of Patent: September 12, 2023Assignee: DeepMind Technologies LimitedInventors: Razvan Pascanu, William Clinton Dabney, Thomas Stepleton
-
Publication number: 20230196108Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. In one aspect, a method comprises: receiving a current observation; for each action of a plurality of actions: randomly sampling one or more probability values; for each probability value: processing the action, the current observation, and the probability value using a quantile function network to generate an estimated quantile value for the probability value with respect to a probability distribution over possible returns that would result from the agent performing the action in response to the current observation; determining a measure of central tendency of the one or more estimated quantile values; and selecting an action to be performed by the agent in response to the current observation using the measures of central tendency for the actions.Type: ApplicationFiled: February 15, 2023Publication date: June 22, 2023Inventors: Georg Ostrovski, William Clinton Dabney
-
Patent number: 11621209Abstract: Disclosed is a semiconductor device such as a power amplifier. Unlike conventional power amplifiers, thermal bump is patterned to only cover active devices. In this way, dimensions of the semiconductor device can be reduced.Type: GrantFiled: August 17, 2021Date of Patent: April 4, 2023Assignee: QUALCOMM IncorporatedInventors: Lei Ma, Wenyue Lydia Zhang, Antonino Scuderi, William Clinton Burling Peatman
-
Patent number: 11610118Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. In one aspect, a method comprises: receiving a current observation; for each action of a plurality of actions: randomly sampling one or more probability values; for each probability value: processing the action, the current observation, and the probability value using a quantile function network to generate an estimated quantile value for the probability value with respect to a probability distribution over possible returns that would result from the agent performing the action in response to the current observation; determining a measure of central tendency of the one or more estimated quantile values; and selecting an action to be performed by the agent in response to the current observation using the measures of central tendency for the actions.Type: GrantFiled: February 11, 2019Date of Patent: March 21, 2023Assignee: DeepMind Technologies LimitedInventors: Georg Ostrovski, William Clinton Dabney
-
Publication number: 20230054893Abstract: Disclosed is a semiconductor device such as a power amplifier. Unlike conventional power amplifiers, thermal bump is patterned to only cover active devices. In this way, dimensions of the semiconductor device can be reduced.Type: ApplicationFiled: August 17, 2021Publication date: February 23, 2023Inventors: Lei MA, Wenyue Lydia ZHANG, Antonino SCUDERI, William Clinton Burling PEATMAN
-
Publication number: 20230044163Abstract: A tube fitting for connection to a tube includes a main body structure and a tube liner. The main body structure is configured to receive an end of the tube and fluidly connect the tube to another component. The tube liner is positioned at least partially within the main body structure and is configured to extend into the tube. The main body structure and the tube liner are configured such that, when the tube is fully inserted into the tube fitting, the end of the tube is positioned at a predetermined depth within the tube fitting, and the main body structure and the tube liner cooperate together to provide an audible indication to indicate that the tube has been fully inserted into the tube fitting.Type: ApplicationFiled: September 13, 2022Publication date: February 9, 2023Applicant: RELIANCE WORLDWIDE CORPORATIONInventors: Sai Kishore RAVISANKAR, William Vernon KLUSS, Samantha KELLY, Eliana PIPPEN, Derres CATALANO, William Clinton OSTEEN
-
Patent number: 11287068Abstract: A flexible heater connector can include a hose, a nut having a female tapered thread, and a fitting structure. The female tapered thread of the nut can engage a male tapered thread associated with the heater. The fitting structure can include a first portion to mechanically engage an inner wall of the hose, and a second portion mechanically coupled to the nut. The nut can be a swivel nut.Type: GrantFiled: April 23, 2018Date of Patent: March 29, 2022Assignee: Reliance Worldwide CorporationInventors: William Clinton Osteen, Davide Succurro
-
Publication number: 20210285584Abstract: A tube fitting for connection to a tube includes a main body structure and a tube liner. The main body structure is configured to receive an end of the tube and fluidly connect the tube to another component. The tube liner is positioned at least partially within the main body structure and is configured to extend into the tube. The main body structure and the tube liner are configured such that, when the tube is fully inserted into the tube fitting, the end of the tube is positioned at a predetermined depth within the tube fitting, and the main body structure and the tube liner cooperate together to provide an audible indication to indicate that the tube has been fully inserted into the tube fitting.Type: ApplicationFiled: March 12, 2021Publication date: September 16, 2021Applicant: Reliance Worldwide CorporationInventors: Sai Kishore Ravisankar, William Vernon Kluss, Samantha Kelly, Eliana Pippen, Derres Catalano, William Clinton Osteen
-
Publication number: 20210089908Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling an agent. One of the methods includes sampling a behavior modulation in accordance with a current probability distribution; for each of one or more time steps: processing an input comprising an observation characterizing a current state of the environment at the time step using an action selection neural network to generate a respective action score for each action in a set of possible actions that can be performed by the agent; modifying the action scores using the sampled behavior modulation; and selecting the action to be performed by the agent at the time step based on the modified action scores; determining a fitness measure corresponding to the sampled behavior modulation; and updating the current probability distribution over the set of possible behavior modulations using the fitness measure corresponding to the behavior modulation.Type: ApplicationFiled: September 25, 2020Publication date: March 25, 2021Inventors: Tom Schaul, Diana Luiza Borsa, Fengning Ding, David Szepesvari, Georg Ostrovski, Simon Osindero, William Clinton Dabney
-
Publication number: 20210064970Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. A current observation characterizing a current state of the environment is received. For each action in a set of multiple actions that can be performed by the agent to interact with the environment, a probability distribution is determined over possible Q returns for the action-current observation pair. For each action, a measure of central tendency of the possible Q returns with respect to the probability distributions for the action-current observation pair is determined. An action to be performed by the agent in response to the current observation is selected using the measures of central tendency.Type: ApplicationFiled: November 16, 2020Publication date: March 4, 2021Inventors: Marc Gendron-Bellemare, William Clinton Dabney
-
Patent number: 10860920Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. A current observation characterizing a current state of the environment is received. For each action in a set of multiple actions that can be performed by the agent to interact with the environment, a probability distribution is determined over possible Q returns for the action-current observation pair. For each action, a measure of central tendency of the possible Q returns with respect to the probability distributions for the action-current observation pair is determined. An action to be performed by the agent in response to the current observation is selected using the measures of central tendency.Type: GrantFiled: July 10, 2019Date of Patent: December 8, 2020Assignee: DeepMind Technologies LimitedInventors: Marc Gendron-Bellemare, William Clinton Dabney
-
Publication number: 20200381319Abstract: A wafer carrier comprising a board, a frame and at least one bolt and nut combination. The board includes at least one vacuum cavity and at least one securing cavity. The frame is coupled to the board. The at least one bolt and nut combination is configured to secure the frame to the board. The board may include one or more metal layers. The frame may include a plurality of scattered frames or a disc shaped frame. The frame may comprise a cavity for the bolt travels through the frame. The wafer carrier may include a wafer located over the board, wherein the wafer is located between the board and the frame.Type: ApplicationFiled: November 26, 2019Publication date: December 3, 2020Inventors: Chenjie TANG, Gengming TAO, William Clinton Burling PEATMAN
-
Publication number: 20200378536Abstract: A flexible heater connector can include a hose, a nut having a female tapered thread, and a fitting structure. The female tapered thread of the nut can engage a male tapered thread associated with the heater. The fitting structure can include a first portion to mechanically engage an inner wall of the hose, and a second portion mechanically coupled to the nut. The nut can be a swivel nut.Type: ApplicationFiled: April 23, 2018Publication date: December 3, 2020Applicant: Reliance Worldwide CorporationInventors: William Clinton Osteen, Davide Succurro
-
Publication number: 20200364557Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. In one aspect, a method comprises: receiving a current observation; for each action of a plurality of actions: randomly sampling one or more probability values; for each probability value: processing the action, the current observation, and the probability value using a quantile function network to generate an estimated quantile value for the probability value with respect to a probability distribution over possible returns that would result from the agent performing the action in response to the current observation; determining a measure of central tendency of the one or more estimated quantile values; and selecting an action to be performed by the agent in response to the current observation using the measures of central tendency for the actions.Type: ApplicationFiled: February 11, 2019Publication date: November 19, 2020Inventors: Georg Ostrovski, William Clinton Dabney
-
Patent number: 10755177Abstract: A voice user interface (VUI) system use collaborative filtering to expand its own knowledge base. The system is designed to improve the accuracy and performance of the Natural Language Understanding (NLU) processing that underlies VUIs. The system leverages the knowledge of system users to crowdsource new information.Type: GrantFiled: December 31, 2015Date of Patent: August 25, 2020Assignee: AMAZON TECHNOLOGIES, INC.Inventors: William Clinton Dabney, Arpit Gupta, Faisal Ladhak, Markus Dreyer, Anjishnu Kumar
-
Publication number: 20190332923Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting an action to be performed by a reinforcement learning agent interacting with an environment. A current observation characterizing a current state of the environment is received. For each action in a set of multiple actions that can be performed by the agent to interact with the environment, a probability distribution is determined over possible Q returns for the action-current observation pair. For each action, a measure of central tendency of the possible Q returns with respect to the probability distributions for the action-current observation pair is determined. An action to be performed by the agent in response to the current observation is selected using the measures of central tendency.Type: ApplicationFiled: July 10, 2019Publication date: October 31, 2019Inventors: Marc Gendron-Bellemare, William Clinton Dabney
-
Patent number: D959094Type: GrantFiled: October 31, 2019Date of Patent: August 2, 2022Inventor: William Clinton Tindall