Patents by Inventor Rajan Bhattacharyya

Rajan Bhattacharyya has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11661082
    Abstract: A control system of the autonomous vehicle may generate multiple possible behavior control movements based on the driving goal and the assessment of the vehicle environment. In doing so, the method and system selects one of the best behavior control, among the multiple possible movements, and the selection is based on the quantitative grading of its driving behavior.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: May 30, 2023
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Kenji Yamada, Kyungnam Kim, Rajan Bhattacharyya
  • Patent number: 11654933
    Abstract: An ego vehicle includes decider modules and a grader module coupled to a resolver module. The decider modules generate trajectory decisions at a current time, generate a current two-dimensional slice of a flat space around the ego vehicle, generate future two-dimensional slices of the flat space by projecting the current two-dimensional slice of the flat space forward in time, and generate a three-dimensional state space by stacking the current two-dimensional slice and the future two-dimensional slices. The grader module generates rewards for the trajectory decisions based on a recent behavior of an ego vehicle. The resolver module selects a final trajectory decision for the ego vehicle from the trajectory decisions based on the three-dimensional state space and the rewards. The current two-dimensional slice includes a current ego vehicle location and current neighboring vehicle locations. The future two-dimensional slices include future ego vehicle locations and future neighboring vehicle locations.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: May 23, 2023
    Assignee: GM Global Technology Operations LLC
    Inventors: Tiffany J. Hwu, Iman Mohammadrezazadeh, Michael J. Daily, Rajan Bhattacharyya
  • Publication number: 20230109712
    Abstract: A method for performing object detection during autonomous driving includes: performing 3D object detection in a 3D object detection segment; uploading an output of multiple sensors in communication with the 3D object detection segment to multiple point clouds; transferring point cloud data from the multiple point clouds to a Region Proposal Network (RPN); independently performing 2D object detection in a 2D object detector in parallel with the 3D object detection in the 3D object detection segment; and taking a given input image and simultaneously learning box coordinates and class label probabilities in a 2D object detection network operating to treat object detection as a regression problem.
    Type: Application
    Filed: September 28, 2021
    Publication date: April 13, 2023
    Inventors: RODOLFO VALIENTE ROMERO, HYUKSEONG KWON, RAJAN BHATTACHARYYA, MICHAEL J. DAILY, GAVIN D. HOLLAND
  • Patent number: 11618479
    Abstract: A method of path planning for a host vehicle includes: receiving host vehicle, environmental and obstacle information; calculating one or more projected host vehicle locations; computing a projected obstacle location for each obstacle; and determining a collision potential between each projected host vehicle location and each projected obstacle location. Until a maximum number of steps is reached, and while at least one projected host vehicle location has an associated collision potential below a collision threshold, the method further includes repeating the calculating, computing and determining steps.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: April 4, 2023
    Assignee: GM Global Technology Operations LLC
    Inventors: Divya P. Kulkarni, Hyukseong Kwon, Kenji Yamada, Tiffany J. Hwu, Kyungnam Kim, Rajan Bhattacharyya, Michael J. Daily
  • Publication number: 20230100741
    Abstract: A method using unsupervised velocity prediction and correction for urban driving from sequences of noisy position estimates includes: performing a vehicle velocity prediction for one or more other vehicles in a vicinity of a host automobile vehicle; calculating a first heuristic based on a uniformity test; calculating a second heuristic based on a vehicle speed of the one or more other vehicles; combining the first heuristic and the second heuristic using a weighted sum; determining an uncertainty mask applying the combined first heuristic and the second heuristic and a heuristic threshold; and applying the uncertainty mask to identify a velocity correction for use by the host automobile vehicle.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Inventors: AMIT AGARWAL, Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily, Gavin D. Holland
  • Publication number: 20230102443
    Abstract: A method for monitoring uncertainty for human-like behavioral modulation of trajectory planning includes: retrieving map and agent information of a current driving state of an autonomously operated host automobile vehicle; dividing uncertainty conditions affecting a trajectory of the host automobile vehicle into an expected uncertainty and an unexpected uncertainty; calculating the expected uncertainty in a first operation branch by forming attention zones according to identified portions of lanes which may potentially collide with a planned route of the host automobile vehicle; determining the unexpected uncertainty in a second operation branch by calculating an anomaly score for any other vehicles in a surrounding area of the host automobile vehicle positioned in the lanes which may potentially collide with the planned route of the host automobile vehicle; and modulating trajectory operation signals determined for the expected uncertainty if the unexpected uncertainty meets or exceeds a predetermined thresh
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Inventors: RAJAN BHATTACHARYYA, TIFFANY J. HWU, MICHAEL J. DAILY, HYUKSEONG KWON, MIA LEVY
  • Patent number: 11524703
    Abstract: A system for interactive hypothesis estimation of multi-vehicle traffic for autonomous driving is provided. The system includes a sensor upon a host vehicle providing data regarding an operating environment of the host vehicle and a computerized device. The computerized device is operable to monitor the data from the sensor, identify a road surface based upon the data, and identify a neighborhood object based upon the data. The computerized device is further operable to determine a pressure score for the neighborhood object based upon a likelihood that the neighborhood object will conflict with the host vehicle based upon the road surface and the neighborhood object, selectively track the neighborhood object based upon the pressure score, and navigate the host vehicle based upon the tracking of the neighborhood object.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: December 13, 2022
    Assignee: GM Global Technology Operations LLC
    Inventors: Scott Rad, Hyukseong Kwon, Rajan Bhattacharyya
  • Patent number: 11494486
    Abstract: Described is a system for continuously predicting and adapting optimal strategies for attacker elicitation. The system includes a global bot controlling processor unit and one or more local bot controlling processor units. The global bot controlling processor unit includes a multi-layer network software unit for extracting attacker features from diverse, out-of-band (OOB) media sources. The global controlling processing unit further includes an adaptive behavioral game theory (GT) software unit for determining a best strategy for eliciting identifying information from an attacker. Each local bot controlling processor unit includes a cognitive model (CM) software unit for estimating a cognitive state of the attacker and predicting attacker behavior. A generative adversarial network (GAN) software unit predicts the attacker's strategies.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: November 8, 2022
    Assignee: HRL LABORATORIES, LLC
    Inventors: Hyun (Tiffany) J. Kim, Rajan Bhattacharyya, Samuel D. Johnson, Soheil Kolouri, Christian Lebiere, Jiejun Xu
  • Patent number: 11485387
    Abstract: A method of predictive navigation control for an ego vehicle includes: comparing a cue node to each of a plurality of episodic memory nodes in an episodic memory structure, wherein the cue node represents a new event representing distances, speeds and headings of one or more newly observed objects about the ego vehicle, and wherein the episodic memory structure includes a network of nodes each representing a respective previously existing event and having a respective node risk and likelihood; determining which of the nodes has a smallest respective difference metric, thus defining a best matching node; consolidating the cue node with the best matching node if the smallest difference metric is less than a match tolerance, else adding a new node corresponding to the cue node to the episodic memory structure; and identifying a likeliest next node and/or a riskiest next node.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: November 1, 2022
    Assignee: GM Global Technology Operations LLC
    Inventors: Michael D. Howard, Hyukseong Kwon, Rajan Bhattacharyya
  • Publication number: 20220219685
    Abstract: A method of using perception-inspired event generation for situation awareness for a vehicle, including receiving perception input data from a sensor of the vehicle and processing the perception input data to classify and generate parameters related to an external entity in a vicinity of the vehicle. The method includes generating a hierarchical event structure that classifies and prioritizes the perception input data by classifying the external entity into an attention zone and prioritizing the external entity within the attention zone according to a risk level value for the external entity. A higher risk level value indicates a higher priority within the attention zone. The method further includes developing a behavior plan for the vehicle based on the hierarchical event structure.
    Type: Application
    Filed: January 13, 2021
    Publication date: July 14, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily
  • Publication number: 20220221301
    Abstract: A method for updating a localization of an autonomous vehicle includes receiving perception input data from a sensor of the autonomous vehicle and receiving map data including road lane information in a vicinity of the autonomous vehicle. The method includes processing the perception input data to extract perceived road lane information including a perceived x position, a perceived y position, a perceived z position, a perceived lane type, a perceived lane color, and a perceived lane curvature and processing the map data to extract map road lane information including a map x position, a map y position, a map z position, a map lane type, a map lane color, and a map lane curvature. The method includes calculating a transformation matrix from the perceived road lane information and the map road lane information and updating the map data and a localization of the vehicle based on the transformation matrix.
    Type: Application
    Filed: January 13, 2021
    Publication date: July 14, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Meena Nagappan, Hyukseong Kwon, Joshua Lampkins, Rajan Bhattacharyya
  • Patent number: 11364913
    Abstract: A method, autonomous vehicle and system for operating an autonomous vehicle. A sensor obtains data of an agent. A processor determines a measure of complexity of the environment in which the autonomous vehicle is operating from the sensor data, selects a control scheme for operating the autonomous vehicle based on the determined complexity, and operates the autonomous vehicle using the selected control scheme.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: June 21, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Aashish N. Patel, Hyukseong Kwon, Amir M. Rahimi, Rajan Bhattacharyya
  • Patent number: 11364904
    Abstract: Embodiments include methods, systems, and computer readable storage medium for a method for providing path-planning guidance by resolving multiple behavioral predictions associated with operating a vehicle is disclosed. The method includes installing a vehicle system into a vehicle, wherein the vehicle system provides path planning guidance based on training data using and fused hypotheses and/or decisions associated with the training data. The method further includes determining, by a processor, a location of the vehicle on a map containing a road network, and determining, by the processor, whether one or more agents exist within a predetermined range of the vehicle. The method further includes selecting, by the processor, an output trajectory to traverse the road network based on the location of the vehicle on the map and the existence of one or more agents. The method further includes controlling, by the processor, operation of the vehicle using the output trajectory.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: June 21, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Amir M. Rahimi, Aashish N. Patel, Rajan Bhattacharyya
  • Patent number: 11361219
    Abstract: Described is a system for feature selection that extends supervised hierarchical clustering to neural activity signals. The system generates, using a hierarchical clustering process, a hierarchical dendrogram representing a set of neural activity data comprising individual neural data elements having neural activity patterns. The hierarchical dendrogram is searched for an optimal cluster parcellation using a stochastic supervised search process. An optimal cluster parcellation of the hierarchical dendrogram is determined that provides a classification of the set of neural activity data with respect to a supervised classifier, resulting in a reduced neural activity feature set. The set of neural activity data is classified using the reduced neural activity feature set, and the classified set of neural activity data is decoded.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: June 14, 2022
    Assignee: HRL Laboratories, LLC
    Inventors: Rajan Bhattacharyya, Brian L. Burns, Kang-Yu Ni, James Benvenuto
  • Publication number: 20220177000
    Abstract: An autonomous vehicle and a system and method of operating the autonomous vehicle. A maneuver classifier is trained at an offline processor to identify a driving maneuver for a driving context. An online processor is configured to receive the driving context, operate the maneuver classifier to identify the driving maneuver based on the driving context, perform the driving maneuver at the autonomous vehicle, grade the driving maneuver as it is being performed at the autonomous vehicle, and adjust a performance of the driving maneuver at the autonomous vehicle based on the grade.
    Type: Application
    Filed: December 3, 2020
    Publication date: June 9, 2022
    Inventors: Iman Zadeh, Rajan Bhattacharyya, Vincent De Sapio, Amir M. Rahimi
  • Publication number: 20220177002
    Abstract: A method of predictive navigation control for an ego vehicle includes: comparing a cue node to each of a plurality of episodic memory nodes in an episodic memory structure, wherein the cue node represents a new event representing distances, speeds and headings of one or more newly observed objects about the ego vehicle, and wherein the episodic memory structure includes a network of nodes each representing a respective previously existing event and having a respective node risk and likelihood; determining which of the nodes has a smallest respective difference metric, thus defining a best matching node; consolidating the cue node with the best matching node if the smallest difference metric is less than a match tolerance, else adding a new node corresponding to the cue node to the episodic memory structure; and identifying a likeliest next node and/or a riskiest next node.
    Type: Application
    Filed: December 8, 2020
    Publication date: June 9, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Michael D. Howard, Hyukseong Kwon, Rajan Bhattacharyya
  • Publication number: 20220177001
    Abstract: A method of path planning for a host vehicle includes: receiving host vehicle, environmental and obstacle information; calculating one or more projected host vehicle locations; computing a projected obstacle location for each obstacle; and determining a collision potential between each projected host vehicle location and each projected obstacle location. Until a maximum number of steps is reached, and while at least one projected host vehicle location has an associated collision potential below a collision threshold, the method further includes repeating the calculating, computing and determining steps.
    Type: Application
    Filed: December 8, 2020
    Publication date: June 9, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Divya P. Kulkarni, Hyukseong Kwon, Kenji Yamada, Tiffany J. Hwu, Kyungnam Kim, Rajan Bhattacharyya, Michael J. Daily
  • Patent number: 11350039
    Abstract: Described is a system for contrast and entropy-based perception adaption to optimize perception. The system is operable for receiving an input image of a scene with a camera system and detecting one or more objects (having perception data) in the input image. The perception data of the one or more objects is converted into probes, which are then converted into axioms using probabilistic signal temporal logic. The axioms are evaluated based on probe bounds. If the axioms are within the probe bounds, then results are provided; however, if the axioms are outside of the probe bounds, the system estimates optimal contrast bounds and entropy bounds as perception parameters. The contrast and entropy in the camera system are then adjusted based on the perception parameters.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: May 31, 2022
    Assignee: HRL Laboratories, LLC
    Inventors: Hyukseong Kwon, Amir M. Rahimi, Amit Agarwal, Rajan Bhattacharyya
  • Publication number: 20220161825
    Abstract: A system for interactive hypothesis estimation of multi-vehicle traffic for autonomous driving is provided. The system includes a sensor upon a host vehicle providing data regarding an operating environment of the host vehicle and a computerized device. The computerized device is operable to monitor the data from the sensor, identify a road surface based upon the data, and identify a neighborhood object based upon the data. The computerized device is further operable to determine a pressure score for the neighborhood object based upon a likelihood that the neighborhood object will conflict with the host vehicle based upon the road surface and the neighborhood object, selectively track the neighborhood object based upon the pressure score, and navigate the host vehicle based upon the tracking of the neighborhood object.
    Type: Application
    Filed: November 24, 2020
    Publication date: May 26, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Scott Rad, Hyukseong Kwon, Rajan Bhattacharyya
  • Publication number: 20220155455
    Abstract: A system ground surface projection for autonomous driving of a host vehicle is provided. The system includes a LIDAR device of the host vehicle and a computerized device. The computerized device is operable to monitor data from the LIDAR device including a total point cloud. The total point cloud describes an actual ground surface in the operating environment of the host vehicle. The device is further operable to segment the total point cloud into a plurality of local point cloud and, for each of the local point clouds, determine a local polygon estimating a portion of the actual ground surface. The device is further operable to assemble the local polygons into a total estimated ground surface and navigate the host vehicle based upon the total estimated ground surface.
    Type: Application
    Filed: November 16, 2020
    Publication date: May 19, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Jacqueline Staiger, Hyukseong Kwon, Amit Agarwal, Rajan Bhattacharyya