Patents by Inventor Mark Graves
Mark Graves has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11934191Abstract: Methods and systems for predictive control of an autonomous vehicle are described. Predictions of lane centeredness and road angle are generated based on data collected by sensors on the autonomous vehicle and are combined to determine a state of the vehicle that are then used to generate vehicle actions for steering control and speed control of the autonomous vehicle.Type: GrantFiled: July 6, 2020Date of Patent: March 19, 2024Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventor: Daniel Mark Graves
-
Publication number: 20230202477Abstract: A method or system for adaptive vehicle spacing, including determining a current state of a vehicle based on sensor data captured by sensors of the vehicle; for each possible action in a set of possible actions: (i) predicting based on the current vehicle state a future state for the vehicle, and (ii) predicting, based on the current vehicle state a first zone future safety value corresponding to a first safety zone of the vehicle; and selecting, based on the predicted future states and first zone future safety values for each of the possible actions in the set, a vehicle action.Type: ApplicationFiled: November 28, 2022Publication date: June 29, 2023Inventors: Daniel Mark Graves, Kasra Rezaee
-
Patent number: 11605026Abstract: Methods and systems are described for support policy learning in an agent of a robot. A general value function (GVF) is learned for a main policy, where the GVF represents future performance of the agent executing the main policy for a given state of the environment. A master policy selects an action based on the predicted accumulated success value received from the general value function. When the predicted accumulated success value is an acceptable value, the action selected by the master policy is execution of the main policy. When the predicted accumulated success value is not an acceptable value, the master action causes a support policy to be learned. The support policy generates a support action to be performed which causes the robot to transition from to a new state where the predicted accumulated success value has an acceptable value.Type: GrantFiled: May 15, 2020Date of Patent: March 14, 2023Assignee: Huawei Technologies Co. Ltd.Inventors: Daniel Mark Graves, Jun Jin, Jun Luo
-
Patent number: 11511745Abstract: A method or system for adaptive vehicle spacing, including determining a current state of a vehicle based on sensor data captured by sensors of the vehicle; for each possible action in a set of possible actions: (i) predicting based on the current vehicle state a future state for the vehicle, and (ii) predicting, based on the current vehicle state a first zone future safety value corresponding to a first safety zone of the vehicle; and selecting, based on the predicted future states and first zone future safety values for each of the possible actions in the set, a vehicle action.Type: GrantFiled: April 27, 2018Date of Patent: November 29, 2022Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Daniel Mark Graves, Kasra Rezaee
-
Patent number: 11511413Abstract: A robot that includes an RL agent that is configured to learn a policy to maximize the cumulative reward of a task, to determine one or more features that are minimally correlated with each other. The features are then used as pseudo-rewards, called feature rewards, where each feature reward corresponds to an option policy, or skill, the RL agent learns to maximize. In an example, the RL agent is configured to select the most relevant features to learn respective option policies from. The RL agent is configured to, for each of the selected features, learn the respective option policy that maximizes the respective feature reward. Using the learned option policies, the RL agent is configured to learn a new (second) policy for a new (second) task that can choose from any of the learned option policies or actions available to the RL agent.Type: GrantFiled: June 12, 2020Date of Patent: November 29, 2022Assignee: Huawei Technologies Co. Ltd.Inventors: Borislav Mavrin, Daniel Mark Graves
-
Patent number: 11364936Abstract: A method or system for controlling safety of both an ego vehicle and social objects in an environment of the ego vehicle, comprising: receiving data representative of at least one social object and determining a current state of the ego vehicle based on sensor data; predicting an ego safety value corresponding to the ego vehicle, for each possible behavior action in a set of possible behavior actions, based on the current state; predicting a social safety value corresponding to the at least one social object in the environment of the ego vehicle, based on the current state, for each possible behavior action; and selecting a next behavior action for the ego vehicle, based on the ego safety values, the social safety values, and one or more target objectives for the ego vehicle.Type: GrantFiled: February 27, 2020Date of Patent: June 21, 2022Assignee: Huawei Technologies Co., Ltd.Inventor: Daniel Mark Graves
-
Publication number: 20220089079Abstract: A system and method for transporting building materials is provided. The system generally comprises end units and interior units having bolster assemblies and cradles. The bolster assembly preferably comprises a beam, D-rings, and a plurality of attachment plates configured to allow for the attachment of a cradle having a shape configured to securely fit the shape of a building material. Two or more end units of the system may be secured to a transport vehicle, such as a railcar, and building materials may be placed within the cradles, thus stabilizing the building materials and protecting them from damage. Two or more interior units may then be used to create layers of building materials before being topped with two or more end units. A securing member may be used to fasten the end units and interior units to one another, which secures the one or more layers of building materials to the transport vehicle in a way that will prevent shifting of the building materials during transport.Type: ApplicationFiled: September 17, 2021Publication date: March 24, 2022Applicant: Performance Specialized Services, LLCInventors: Matthew Roberts, Mark Graves
-
Publication number: 20210387330Abstract: A robot that includes an RL agent that is configured to learn a policy to maximize the cumulative reward of a task, to determine one or more features that are minimally correlated with each other. The features are then used as pseudo-rewards, called feature rewards, where each feature reward corresponds to an option policy, or skill, the RL agent learns to maximize. In an example, the RL agent is configured to select the most relevant features to learn respective option policies from. The RL agent is configured to, for each of the selected features, learn the respective option policy that maximizes the respective feature reward. Using the learned option policies, the RL agent is configured to learn a new (second) policy for a new (second) task that can choose from any of the learned option policies or actions available to the RL agent.Type: ApplicationFiled: June 12, 2020Publication date: December 16, 2021Inventors: Borislav MAVRIN, Daniel Mark GRAVES
-
Publication number: 20210357782Abstract: Methods and systems are described for support policy learning in an agent of a robot. A general value function (GVF) is learned for a main policy, where the GVF represents future performance of the agent executing the main policy for a given state of the environment. A master policy selects an action based on the predicted accumulated success value received from the general value function. When the predicted accumulated success value is an acceptable value, the action selected by the master policy is execution of the main policy. When the predicted accumulated success value is not an acceptable value, the master action causes a support policy to be learned. The support policy generates a support action to be performed which causes the robot to transition from to a new state where the predicted accumulated success value has an acceptable value.Type: ApplicationFiled: May 15, 2020Publication date: November 18, 2021Inventors: Daniel Mark GRAVES, Jun JIN, Jun LUO
-
Publication number: 20210004006Abstract: Methods and systems for predictive control of an autonomous vehicle are described. Predictions of lane centeredness and road angle are generated based on data collected by sensors on the autonomous vehicle and are combined to determine a state of the vehicle that are then used to generate vehicle actions for steering control and speed control of the autonomous vehicle.Type: ApplicationFiled: July 6, 2020Publication date: January 7, 2021Inventor: Daniel Mark GRAVES
-
Publication number: 20200276988Abstract: A method or system for controlling safety of both an ego vehicle and social objects in an environment of the ego vehicle, comprising: receiving data representative of at least one social object and determining a current state of the ego vehicle based on sensor data; predicting an ego safety value corresponding to the ego vehicle, for each possible behavior action in a set of possible behavior actions, based on the current state; predicting a social safety value corresponding to the at least one social object in the environment of the ego vehicle, based on the current state, for each possible behavior action; and selecting a next behavior action for the ego vehicle, based on the ego safety values, the social safety values, and one or more target objectives for the ego vehicle.Type: ApplicationFiled: February 27, 2020Publication date: September 3, 2020Inventor: Daniel Mark GRAVES
-
Publication number: 20190329772Abstract: A method or system for adaptive vehicle spacing, including determining a current state of a vehicle based on sensor data captured by sensors of the vehicle; for each possible action in a set of possible actions: (i) predicting based on the current vehicle state a future state for the vehicle, and (ii) predicting, based on the current vehicle state a first zone future safety value corresponding to a first safety zone of the vehicle; and selecting, based on the predicted future states and first zone future safety values for each of the possible actions in the set, a vehicle action.Type: ApplicationFiled: April 27, 2018Publication date: October 31, 2019Inventors: Daniel Mark Graves, Kasra Rezaee
-
Publication number: 20140058782Abstract: An integrated scientific research environment includes a method and system of conducting a standardized, collaborative scientific research project. Researchers utilize the integrated scientific research environment to conduct experiments in which information is generated, analyzed, verified, and published in a distributed computing infrastructure that allows for multiple users to work together on experiments and scientific research projects. Multiple modules create a literature review and a research protocol, enable verification and analysis of experiment results, and prepare results for publication to add to existing knowledge in the field of the experiments conducted.Type: ApplicationFiled: August 22, 2012Publication date: February 27, 2014Inventor: MARK GRAVES, JR.
-
Patent number: 6546071Abstract: An apparatus comprises a source of penetrating radiation, a detector for that radiation, a sample container, and a stage between the source and the detector for supporting the sample container, wherein the sample container includes a data storage element and the apparatus includes a reader for that data storage element, the reader being connected to a control means adapted to control the apparatus on the basis of the content of the data storage element. Thus, by including information in the data storage element relating to the nature of the sample, the apparatus can be tuned to that type or class of sample and more reliable results obtained. A suitable data storage element is a bar code, and a suitable sample container is a tray.Type: GrantFiled: May 23, 2001Date of Patent: April 8, 2003Assignee: Spectral Fusion Technologies LimitedInventor: Mark Graves
-
Publication number: 20020012419Abstract: An apparatus comprises a source of penetrating radiation, a detector for that radiation, a sample container, and a stage between the source and the detector for supporting the sample container, wherein the sample container includes a data storage element and the apparatus includes a reader for that data storage element, the reader being connected to a control means adapted to control the apparatus on the basis of the content of the data storage element. Thus, by including information in the data storage element relating to the nature of the sample, the apparatus can be tuned to that type or class of sample and more reliable results obtained. A suitable data storage element is a bar code, and a suitable sample container is a tray.Type: ApplicationFiled: May 23, 2001Publication date: January 31, 2002Inventor: Mark Graves