Patents by Inventor John M. Dolan

John M. Dolan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11016495
    Abstract: Systems and methods are provided for end-to-end learning of commands for controlling an autonomous vehicle. A pre-processor pre-processes image data acquired by sensors at a current time step (CTS) to generate pre-processed image data that is concatenated with additional input(s) (e.g., a segmentation map and/or optical flow map) to generate a dynamic scene output. A convolutional neural network (CNN) processes the dynamic scene output to generate a feature map that includes extracted spatial features that are concatenated with vehicle kinematics to generate a spatial context feature vector. An LSTM network processes, during the (CTS), the spatial context feature vector at the (CTS) and one or more previous LSTM outputs at corresponding previous time steps to generate an encoded temporal context vector at the (CTS). The fully connected layer processes the encoded temporal context vector to learn control command(s) (e.g., steering angle, acceleration rate and/or a brake rate control commands).
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: May 25, 2021
    Assignees: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Praveen Palanisamy, Upali P. Mudalige, Yilun Chen, John M. Dolan, Katharina Muelling
  • Patent number: 10940863
    Abstract: Systems and methods are provided that employ spatial and temporal attention-based deep reinforcement learning of hierarchical lane-change policies for controlling an autonomous vehicle. An actor-critic network architecture includes an actor network that process image data received from an environment to learn the lane-change policies as a set of hierarchical actions, and a critic network that evaluates the lane-change policies to calculate loss and gradients to predict an action-value function (Q) that is used to drive learning and update parameters of the lane-change policies. The actor-critic network architecture implements a spatial attention module to select relevant regions in the image data that are of importance, and a temporal attention module to learn temporal attention weights to be applied to past frames of image data to indicate relative importance in deciding which lane-change policy to select.
    Type: Grant
    Filed: November 1, 2018
    Date of Patent: March 9, 2021
    Assignees: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Praveen Palanisamy, Upali P. Mudalige, Yilun Chen, John M. Dolan, Katharina Muelling
  • Patent number: 10732639
    Abstract: The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: August 4, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Upali P. Mudalige, Katharina Muelling, John M. Dolan
  • Publication number: 20200142421
    Abstract: Systems and methods are provided for end-to-end learning of commands for controlling an autonomous vehicle. A pre-processor pre-processes image data acquired by sensors at a current time step (CTS) to generate pre-processed image data that is concatenated with additional input(s) (e.g., a segmentation map and/or optical flow map) to generate a dynamic scene output. A convolutional neural network (CNN) processes the dynamic scene output to generate a feature map that includes extracted spatial features that are concatenated with vehicle kinematics to generate a spatial context feature vector. An LSTM network processes, during the (CTS), the spatial context feature vector at the (CTS) and one or more previous LSTM outputs at corresponding previous time steps to generate an encoded temporal context vector at the (CTS). The fully connected layer processes the encoded temporal context vector to learn control command(s) (e.g., steering angle, acceleration rate and/or a brake rate control commands).
    Type: Application
    Filed: November 5, 2018
    Publication date: May 7, 2020
    Applicants: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Praveen Palanisamy, Upali P. Mudalige, Yilun Chen, John M. Dolan, Katharina Muelling
  • Publication number: 20200139973
    Abstract: Systems and methods are provided that employ spatial and temporal attention-based deep reinforcement learning of hierarchical lane-change policies for controlling an autonomous vehicle. An actor-critic network architecture includes an actor network that process image data received from an environment to learn the lane-change policies as a set of hierarchical actions, and a critic network that evaluates the lane-change policies to calculate loss and gradients to predict an action-value function (Q) that is used to drive learning and update parameters of the lane-change policies. The actor-critic network architecture implements a spatial attention module to select relevant regions in the image data that are of importance, and a temporal attention module to learn temporal attention weights to be applied to past frames of image data to indicate relative importance in deciding which lane-change policy to select.
    Type: Application
    Filed: November 1, 2018
    Publication date: May 7, 2020
    Applicants: GM GLOBAL TECHNOLOGY OPERATIONS LLC, CARNEGIE MELLON UNIVERSITY
    Inventors: Praveen Palanisamy, Upali P. Mudalige, Yilun Chen, John M. Dolan, Katharina Muelling
  • Publication number: 20200026277
    Abstract: A method in an autonomous vehicle (AV) is provided. The method includes determining, from vehicle sensor data and road geometry data, a plurality of range measurements and obstacle velocity data; determining vehicle state data wherein the vehicle state data includes a velocity of the AV, a distance to a stop line, a distance to a midpoint of an intersection, and a distance to a goal; determining, based on the plurality of range measurements, the obstacle velocity data and the vehicle state data, a set of discrete behavior actions and a unique trajectory control action associated with each discrete behavior action; choosing a discrete behavior action and a unique trajectory control action to perform; and communicating a message to vehicle controls conveying the unique trajectory control action associated with the discrete behavior action.
    Type: Application
    Filed: July 19, 2018
    Publication date: January 23, 2020
    Applicants: GM GLOBAL TECHNOLOGY OPERATIONS LLC, Carnegie Mellon University
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Katharina Muelling, John M. Dolan, Upali P. Mudalige
  • Publication number: 20190278282
    Abstract: The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.
    Type: Application
    Filed: March 8, 2018
    Publication date: September 12, 2019
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Upali P. Mudalige, Katharina Muelling, John M. Dolan
  • Patent number: 10062288
    Abstract: Systems and method are provided for controlling a first vehicle. In one embodiment, a method includes: determining, by a processor, that a second vehicle is going to merge into a current lane of the first vehicle at a merge point; and in response to the determining: obtaining, by the processor, a velocity history of the second vehicle, determining, by the processor, a first time value associated with the first vehicle and the merge point; determining, by the processor, a second time value associated with the second vehicle and the merge point; determining, by the processor, an intention of the second vehicle based on the velocity history, the first time value, and the second time value; and selectively generating, by the processor a command to at least one of control the first vehicle and provide notification based on the intention.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: August 28, 2018
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Bakhtiar B. Litkouhi, Chiyu Dong, John M. Dolan
  • Publication number: 20180033308
    Abstract: Systems and method are provided for controlling a first vehicle. In one embodiment, a method includes: determining, by a processor, that a second vehicle is going to merge into a current lane of the first vehicle at a merge point; and in response to the determining: obtaining, by the processor, a velocity history of the second vehicle, determining, by the processor, a first time value associated with the first vehicle and the merge point; determining, by the processor, a second time value associated with the second vehicle and the merge point; determining, by the processor, an intention of the second vehicle based on the velocity history, the first time value, and the second time value; and selectively generating, by the processor a command to at least one of control the first vehicle and provide notification based on the intention.
    Type: Application
    Filed: July 29, 2016
    Publication date: February 1, 2018
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: BAKHTIAR B. LITKOUHI, CHIYU DONG, JOHN M. DOLAN
  • Patent number: 9457807
    Abstract: A method for automated lane centering and/or lane changing purposes for a vehicle traveling on a roadway that employs roadway points from a map database to determine a reference vehicle path and sensors on the vehicle for detecting static and moving objects to adjust the reference path. The method includes reducing the curvature of the reference path to generate a reduced curvature reference path that reduces the turning requirements of the vehicle and setting the speed of the vehicle from posted roadway speeds from the map database. The method also includes providing multiple candidate vehicle paths and vehicle speeds to avoid the static and moving objects in front of the vehicle.
    Type: Grant
    Filed: June 5, 2014
    Date of Patent: October 4, 2016
    Assignees: GM Global Technology Operations LLC, Carnegie Mellon University
    Inventors: Jin-Woo Lee, Upali Priyantha Mudalige, Tianyu Gu, John M. Dolan
  • Patent number: 9255804
    Abstract: A technique for determining the position of a mobile device includes receiving messages from respective mobile reference devices. Each of the messages is broadcast beginning at one of several predetermined message start opportunity (MSO) times that have known timings relative to a reference time. Each of the messages contains a MSO value identifying the MSO time at which transmission of the message started. The MSO value is used to determine the time of transmission of each of the messages received at the mobile device, and the position of the mobile device is determined via multi-lateration. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of mobile reference devices. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determine the position of the mobile device.
    Type: Grant
    Filed: June 20, 2014
    Date of Patent: February 9, 2016
    Assignee: Exelis Inc.
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Publication number: 20150353082
    Abstract: A method for automated lane centering and/or lane changing purposes for a vehicle traveling on a roadway that employs roadway points from a map database to determine a reference vehicle path and sensors on the vehicle for detecting static and moving objects to adjust the reference path. The method includes reducing the curvature of the reference path to generate a reduced curvature reference path that reduces the turning requirements of the vehicle and setting the speed of the vehicle from posted roadway speeds from the map database. The method also includes providing multiple candidate vehicle paths and vehicle speeds to avoid the static and moving objects in front of the vehicle.
    Type: Application
    Filed: June 5, 2014
    Publication date: December 10, 2015
    Applicant: CARNEGIE MELLON UNIVERSITY
    Inventors: JIN-WOO LEE, UPALI PRIYANTHA MUDALIGE, TIANYU GU, JOHN M. DOLAN
  • Patent number: 9201135
    Abstract: A technique for determining the position of a mobile device includes receiving at the mobile device a set of time-slotted messages from a respective set of reference devices. Each of the time-slotted messages contains a slot ID indicating the assigned time slot in which it was broadcast. The slot ID is used to determine the time of transmission of each of the time-slotted messages received at the mobile device, and the position of the mobile device is determined via multi-lateration based on the time of flight of the time-slotted messages and known positions of the reference devices. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of SBS ground stations. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determined the position of the mobile device.
    Type: Grant
    Filed: September 17, 2013
    Date of Patent: December 1, 2015
    Assignee: Exelis Inc.
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Publication number: 20140302775
    Abstract: A technique for determining the position of a mobile device includes receiving messages from respective mobile reference devices. Each of the messages is broadcast beginning at one of several predetermined message start opportunity (MSO) times that have known timings relative to a reference time. Each of the messages contains a MSO value identifying the MSO time at which transmission of the message started. The MSO value is used to determine the time of transmission of each of the messages received at the mobile device, and the position of the mobile device is determined via multi-lateration. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of mobile reference devices. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determine the position of the mobile device.
    Type: Application
    Filed: June 20, 2014
    Publication date: October 9, 2014
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Patent number: 8791861
    Abstract: A technique for determining the position of a mobile device includes receiving messages from respective mobile reference devices. Each of the messages is broadcast beginning at one of several predetermined message start opportunity (MSO) times that have known timings relative to a reference time. Each of the messages contains a MSO value identifying the MSO time at which transmission of the message started. The MSO value is used to determine the time of transmission of each of the messages received at the mobile device, and the position of the mobile device is determined via multi-lateration. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of mobile reference devices. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determine the position of the mobile device.
    Type: Grant
    Filed: April 15, 2011
    Date of Patent: July 29, 2014
    Assignee: Exelis, Inc.
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Patent number: 8788134
    Abstract: An autonomous driving merge management system includes an autonomous driving control device and an intention decision management system. The management system includes a candidate strategy subsystem generating a plurality of candidate driving strategies, a merging vehicle behavior recognition subsystem predicting a merging intention of a merging vehicle; an intention-based interactive prediction subsystem predicting future merging scenarios between the host vehicle and merging vehicle as a function of inputs by the merging vehicle behavior recognition subsystem and inputs by the candidate strategy subsystem, and a cost function-based evaluation subsystem determining a cost for each future merging scenario generated by the intention-based interactive prediction subsystem. A processor selects a merge strategy of the host vehicle based on intention-based prediction results and cost function-based evaluation results.
    Type: Grant
    Filed: January 4, 2013
    Date of Patent: July 22, 2014
    Assignee: GM Global Technology Operations LLC
    Inventors: Bakhtiar Brian Litkouhi, Junqing Wei, John M. Dolan
  • Publication number: 20140195093
    Abstract: An autonomous driving merge management system includes an autonomous driving control device and an intention decision management system. The management system includes a candidate strategy subsystem generating a plurality of candidate driving strategies, a merging vehicle behavior recognition subsystem predicting a merging intention of a merging vehicle; an intention-based interactive prediction subsystem predicting future merging scenarios between the host vehicle and merging vehicle as a function of inputs by the merging vehicle behavior recognition subsystem and inputs by the candidate strategy subsystem, and a cost function-based evaluation subsystem determining a cost for each future merging scenario generated by the intention-based interactive prediction subsystem. A processor selects a merge strategy of the host vehicle based on intention-based prediction results and cost function-based evaluation results.
    Type: Application
    Filed: January 4, 2013
    Publication date: July 10, 2014
    Applicants: CARNEGIE MELLON UNIVERSITY, GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: BAKHTIAR BRIAN LITKOUHI, JUNQING WEI, JOHN M. DOLAN
  • Patent number: 8559971
    Abstract: A technique for determining the position of a mobile device includes receiving at the mobile device a set of time-slotted messages from a respective set of reference devices. Each of the time-slotted messages contains a slot ID indicating the assigned time slot in which it was broadcast. The slot ID is used to determine the time of transmission of each of the time-slotted messages received at the mobile device, and the position of the mobile device is determined via multi-lateration based on the time of flight of the time-slotted messages and known positions of the reference devices. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of SBS ground stations. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determined the position of the mobile device.
    Type: Grant
    Filed: April 5, 2011
    Date of Patent: October 15, 2013
    Assignee: Exelis, Inc.
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Publication number: 20120262339
    Abstract: A technique for determining the position of a mobile device includes receiving messages from respective mobile reference devices. Each of the messages is broadcast beginning at one of several predetermined message start opportunity (MSO) times that have known timings relative to a reference time. Each of the messages contains a MSO value identifying the MSO time at which transmission of the message started. The MSO value is used to determine the time of transmission of each of the messages received at the mobile device, and the position of the mobile device is determined via multi-lateration. According to another approach, the mobile device receives a set of ADS-B messages from a respective set of mobile reference devices. The time of transmission of each of the ADS-B messages is supplied in the ADS-B message itself or in a subsequent message and used to determine the position of the mobile device.
    Type: Application
    Filed: April 15, 2011
    Publication date: October 18, 2012
    Applicant: ITT MANUFACTURING ENTERPRISES, INC.
    Inventors: Michael A. Garcia, Robert Mueller, John W. Lambert, John M. Dolan
  • Patent number: 5701579
    Abstract: A modular antenna driver is provided for extending the area of coverage between a base station connected to a CATV cable system and a plurality of cordless handsets. The driver includes a duplex circuit connected to the CATV cable and tuned for upstream and downstream communications with the base station over the cable. A core circuit connected to the duplex circuit includes circuitry interconnected to perform and of sufficient bandwidth to perform communication functions common to at least two different handset types. At least one removable module is selectively insertable into the driver and includes circuitry interconnected to perform communication functions characteristic of one handset type wherein one such module will may be replaced by a second module for a different second handset type. In the alternative, multiple removable modules may be simultaneously employed in the driver to permit simultaneous compatibility with a plurality of handset types.
    Type: Grant
    Filed: November 29, 1993
    Date of Patent: December 23, 1997
    Assignee: PCS Solutions, LLC
    Inventors: John M. Dolan, Andrew S. Beasley