Patents by Inventor Rajan Bhattacharyya
Rajan Bhattacharyya has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12073613Abstract: Described is a system for adapting to perception errors in object detection and recognition. The system receives, with a perception module, perception data from an environment proximate a mobile platform that reflects objects in the environment. Perception probes representing perception characteristics of object detections are generated from the perception data. Using the perception probes, spatial logic-based constraints and temporal logic-based constraints are generated. Spatial perception parameters are determined by solving an optimization problem using a set of the spatial logic-based constraints. Temporal perception parameters are determined by solving an optimization problem using a set of temporal logic-based constraints. The spatial perception parameters and the temporal perception parameters are combined to estimate a final perception parameter. The perception module is adjusted based on the final perception parameter.Type: GrantFiled: May 12, 2022Date of Patent: August 27, 2024Assignee: HRL LABORATORIES, LLCInventors: Hyukseong Kwon, Alexie Pogue, Kevin Lee, Amir M. Rahimi, Amit Agarwal, Rajan Bhattacharyya
-
Publication number: 20240227823Abstract: A system for dynamically adjusting interactions between an ADAS equipped vehicle and occupants of the vehicle includes one or more physiological sensors disposed on the vehicle and one or more control modules having a processor, a memory, and input/output (I/O) ports in communication with the one or more physiological sensors. The control modules execute program code portions stored in the memory that: collect sensor data from the one or more physiological sensors; analyze the sensor data and select a subset of the sensor data corresponding to a subset of the one or more physiological sensors; predicts, based on the subset of the sensor data, that an occupant of the vehicle is experiencing an increase in stress level; and adapt an ADAS action of the vehicle to reduce an occupant stress level from a first level to a second level lower than the first level.Type: ApplicationFiled: October 20, 2022Publication date: July 11, 2024Inventors: Mia Levy, Evelyn Kim, Rajan Bhattacharyya
-
Patent number: 12033393Abstract: A method for performing object detection during autonomous driving includes: performing 3D object detection in a 3D object detection segment; uploading an output of multiple sensors in communication with the 3D object detection segment to multiple point clouds; transferring point cloud data from the multiple point clouds to a Region Proposal Network (RPN); independently performing 2D object detection in a 2D object detector in parallel with the 3D object detection in the 3D object detection segment; and taking a given input image and simultaneously learning box coordinates and class label probabilities in a 2D object detection network operating to treat object detection as a regression problem.Type: GrantFiled: September 28, 2021Date of Patent: July 9, 2024Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Rodolfo Valiente Romero, Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily, Gavin D. Holland
-
Publication number: 20240203131Abstract: A method and apparatus for verifying object classification includes comparing detected object-components with trained component-based descriptors and similarity measures to generate object classification verification data. The object classification verification data represents object classification confidence or misclassification errors to weight uncertainty for perception-based decision making. A sequence of similarity measures associated with a current frame and prior frames within a reference observation time constraint are compared to a reference temporal similarity measure boundary to generate the object classification verification data.Type: ApplicationFiled: July 8, 2022Publication date: June 20, 2024Applicant: HRL Laboratories, LLCInventors: Amir RAHIMI, Hyukseong Kwon, Amit AGARWAL, Rajan BHATTACHARYYA
-
Publication number: 20240132081Abstract: A system for dynamically adjusting interactions between an ADAS equipped vehicle and occupants of the vehicle includes one or more physiological sensors disposed on the vehicle and one or more control modules having a processor, a memory, and input/output (I/O) ports in communication with the one or more physiological sensors. The control modules execute program code portions stored in the memory that: collect sensor data from the one or more physiological sensors; analyze the sensor data and select a subset of the sensor data corresponding to a subset of the one or more physiological sensors; predicts, based on the subset of the sensor data, that an occupant of the vehicle is experiencing an increase in stress level; and adapt an ADAS action of the vehicle to reduce an occupant stress level from a first level to a second level lower than the first level.Type: ApplicationFiled: October 19, 2022Publication date: April 25, 2024Inventors: Mia Levy, Evelyn Kim, Rajan Bhattacharyya
-
Patent number: 11941870Abstract: Described is a system for action recognition error detection and correction using probabilistic signal temporal logic. The system is initiated by training an action recognition system to generate true positive (TP)/false positive (FP) axioms. Thereafter, the system ca be used to classify one or more actions in a video sequence as true action classifications by using the TP/FP axioms to remove false action classifications. With the remaining true classifications, a device can be controlled given the situation and relevant true classification.Type: GrantFiled: March 18, 2022Date of Patent: March 26, 2024Assignee: HRL LABORATORIES, LLCInventors: Hyukseong Kwon, Amit Agarwal, Kevin Lee, Amir M. Rahimi, Alexie Pogue, Rajan Bhattacharyya
-
Patent number: 11873006Abstract: A virtual lane estimation system includes a memory device, a sensor and a computer. The memory device is configured to store a road map that corresponds to a portion of a road ahead of a vehicle. The sensor is configured to observe a plurality of trajectories of a plurality of neighboring vehicles that traverse the portion of the road. The computer is configured to initialize a recursive self-organizing map as a plurality of points arranged as a two-dimensional grid aligned with the road map, train the points in the recursive self-organizing map in response to the trajectories, generate a directed graph that contains one or more virtual lanes through the road map in response to the points trained to the trajectories, and generate a control signal that controls navigation of the vehicle through the portion of the road in response to the virtual lanes in the directed graph.Type: GrantFiled: September 21, 2020Date of Patent: January 16, 2024Assignee: GM Global Technology Operations LLCInventors: Tiffany J. Hwu, Rajan Bhattacharyya, Michael J. Daily, Kyungnam Kim
-
Patent number: 11858507Abstract: A method of using perception-inspired event generation for situation awareness for a vehicle, including receiving perception input data from a sensor of the vehicle and processing the perception input data to classify and generate parameters related to an external entity in a vicinity of the vehicle. The method includes generating a hierarchical event structure that classifies and prioritizes the perception input data by classifying the external entity into an attention zone and prioritizing the external entity within the attention zone according to a risk level value for the external entity. A higher risk level value indicates a higher priority within the attention zone. The method further includes developing a behavior plan for the vehicle based on the hierarchical event structure.Type: GrantFiled: January 13, 2021Date of Patent: January 2, 2024Assignee: GM Global Technology Operations LLCInventors: Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily
-
Patent number: 11854252Abstract: Described is a system for evaluating and correcting perception errors in object detection and recognition. The system receives perception data from an environment proximate a mobile platform. Perception probes are generated from the perception data which describe perception characteristics of object detections in the perception data. For each perception probe, probabilistic distributions for true positive and false positive values are determined, resulting in true positive and false negative perception probes. Statistical characteristics of true positive perception probes and false positive perception probes are then determined. Based on the statistical characteristics, true positive perception probes are clustered. An axiom is generated to determine statistical constraints for perception validity for each perception probe cluster. The axiom is evaluated to classify the perception probes as valid or erroneous. Optimal perception parameters are generated by solving an optimization problem based on the axiom.Type: GrantFiled: March 22, 2022Date of Patent: December 26, 2023Assignee: HRL LABORATORIES, LLCInventors: Hyukseong Kwon, Amit Agarwal, Amir M. Rahimi, Kevin Lee, Alexie Pogue, Rajan Bhattacharyya
-
System for extending functionality of hypotheses generated by symbolic/logic-based reasoning systems
Patent number: 11810006Abstract: A vehicle and a system and a method of operating the vehicle. The system includes a reasoning engine, an episodic memory, a resolver and a controller. The reasoning engine infers a plurality of possible scenarios based on a current state of an environment of the vehicle. The episodic memory determines a historical likelihood for each of the plurality of possible scenarios. The resolver selects a scenario from the plurality of possible scenarios using the historical likelihoods. The controller operates the vehicle based on the selected scenario.Type: GrantFiled: November 18, 2020Date of Patent: November 7, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Jaehoon Choe, Rajan Bhattacharyya, Kyungnam Kim, Kenji Yamada -
Patent number: 11801847Abstract: Described is a system for analyzing time series data. A sequence of symbols is generated from a set of time series input data related to a moving vehicle using automatic segmentation. A grammar is extracted from the sequence of symbols, and the grammar is a subset of a probabilistic context-free grammar (PCFG). Using the grammar, time series input data can be analyzed, and a prediction of the vehicle's movement can be made. Vehicle operations for an autonomous vehicle are determined using the prediction.Type: GrantFiled: July 27, 2021Date of Patent: October 31, 2023Assignee: HRL LABORATORIES, LLCInventors: Kenji Yamada, Rajan Bhattacharyya, Aruna Jammalamadaka, Dmitriy V. Korchev, Chong Ding
-
Patent number: 11747164Abstract: A method for updating a localization of an autonomous vehicle includes receiving perception input data from a sensor of the autonomous vehicle and receiving map data including road lane information in a vicinity of the autonomous vehicle. The method includes processing the perception input data to extract perceived road lane information including a perceived x position, a perceived y position, a perceived z position, a perceived lane type, a perceived lane color, and a perceived lane curvature and processing the map data to extract map road lane information including a map x position, a map y position, a map z position, a map lane type, a map lane color, and a map lane curvature. The method includes calculating a transformation matrix from the perceived road lane information and the map road lane information and updating the map data and a localization of the vehicle based on the transformation matrix.Type: GrantFiled: January 13, 2021Date of Patent: September 5, 2023Assignee: GM Global Technology Operations LLCInventors: Meena Nagappan, Hyukseong Kwon, Joshua Lampkins, Rajan Bhattacharyya
-
Patent number: 11724720Abstract: A method using unsupervised velocity prediction and correction for urban driving from sequences of noisy position estimates includes: performing a vehicle velocity prediction for one or more other vehicles in a vicinity of a host automobile vehicle; calculating a first heuristic based on a uniformity test; calculating a second heuristic based on a vehicle speed of the one or more other vehicles; combining the first heuristic and the second heuristic using a weighted sum; determining an uncertainty mask applying the combined first heuristic and the second heuristic and a heuristic threshold; and applying the uncertainty mask to identify a velocity correction for use by the host automobile vehicle.Type: GrantFiled: September 28, 2021Date of Patent: August 15, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Amit Agarwal, Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily, Gavin D. Holland
-
Patent number: 11694120Abstract: Described is a system for detecting and correcting perception errors in a perception system. In operation, the system generates a list of detected objects from perception data of a scene, which allows for the generation of a list of background classes from backgrounds in the perception data associated with the list of detected objects. For each detected object in the list of detected objects, a closest background class is identified from the list of background classes. Vectors can then be used to determine a semantic feature, which is used to identify axioms. An optimal perception parameter is then generated, which is used to adjust perception parameters in the perception system to minimize perception errors.Type: GrantFiled: March 2, 2021Date of Patent: July 4, 2023Assignee: HRL LABORATORIES, LLCInventors: Amit Agarwal, Amir M. Rahimi, Hyukseong Kwon, Rajan Bhattacharyya
-
Patent number: 11661082Abstract: A control system of the autonomous vehicle may generate multiple possible behavior control movements based on the driving goal and the assessment of the vehicle environment. In doing so, the method and system selects one of the best behavior control, among the multiple possible movements, and the selection is based on the quantitative grading of its driving behavior.Type: GrantFiled: October 28, 2020Date of Patent: May 30, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Kenji Yamada, Kyungnam Kim, Rajan Bhattacharyya
-
Patent number: 11654933Abstract: An ego vehicle includes decider modules and a grader module coupled to a resolver module. The decider modules generate trajectory decisions at a current time, generate a current two-dimensional slice of a flat space around the ego vehicle, generate future two-dimensional slices of the flat space by projecting the current two-dimensional slice of the flat space forward in time, and generate a three-dimensional state space by stacking the current two-dimensional slice and the future two-dimensional slices. The grader module generates rewards for the trajectory decisions based on a recent behavior of an ego vehicle. The resolver module selects a final trajectory decision for the ego vehicle from the trajectory decisions based on the three-dimensional state space and the rewards. The current two-dimensional slice includes a current ego vehicle location and current neighboring vehicle locations. The future two-dimensional slices include future ego vehicle locations and future neighboring vehicle locations.Type: GrantFiled: November 10, 2020Date of Patent: May 23, 2023Assignee: GM Global Technology Operations LLCInventors: Tiffany J. Hwu, Iman Mohammadrezazadeh, Michael J. Daily, Rajan Bhattacharyya
-
Publication number: 20230109712Abstract: A method for performing object detection during autonomous driving includes: performing 3D object detection in a 3D object detection segment; uploading an output of multiple sensors in communication with the 3D object detection segment to multiple point clouds; transferring point cloud data from the multiple point clouds to a Region Proposal Network (RPN); independently performing 2D object detection in a 2D object detector in parallel with the 3D object detection in the 3D object detection segment; and taking a given input image and simultaneously learning box coordinates and class label probabilities in a 2D object detection network operating to treat object detection as a regression problem.Type: ApplicationFiled: September 28, 2021Publication date: April 13, 2023Inventors: RODOLFO VALIENTE ROMERO, HYUKSEONG KWON, RAJAN BHATTACHARYYA, MICHAEL J. DAILY, GAVIN D. HOLLAND
-
Patent number: 11618479Abstract: A method of path planning for a host vehicle includes: receiving host vehicle, environmental and obstacle information; calculating one or more projected host vehicle locations; computing a projected obstacle location for each obstacle; and determining a collision potential between each projected host vehicle location and each projected obstacle location. Until a maximum number of steps is reached, and while at least one projected host vehicle location has an associated collision potential below a collision threshold, the method further includes repeating the calculating, computing and determining steps.Type: GrantFiled: December 8, 2020Date of Patent: April 4, 2023Assignee: GM Global Technology Operations LLCInventors: Divya P. Kulkarni, Hyukseong Kwon, Kenji Yamada, Tiffany J. Hwu, Kyungnam Kim, Rajan Bhattacharyya, Michael J. Daily
-
Publication number: 20230100741Abstract: A method using unsupervised velocity prediction and correction for urban driving from sequences of noisy position estimates includes: performing a vehicle velocity prediction for one or more other vehicles in a vicinity of a host automobile vehicle; calculating a first heuristic based on a uniformity test; calculating a second heuristic based on a vehicle speed of the one or more other vehicles; combining the first heuristic and the second heuristic using a weighted sum; determining an uncertainty mask applying the combined first heuristic and the second heuristic and a heuristic threshold; and applying the uncertainty mask to identify a velocity correction for use by the host automobile vehicle.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Inventors: AMIT AGARWAL, Hyukseong Kwon, Rajan Bhattacharyya, Michael J. Daily, Gavin D. Holland
-
Publication number: 20230102443Abstract: A method for monitoring uncertainty for human-like behavioral modulation of trajectory planning includes: retrieving map and agent information of a current driving state of an autonomously operated host automobile vehicle; dividing uncertainty conditions affecting a trajectory of the host automobile vehicle into an expected uncertainty and an unexpected uncertainty; calculating the expected uncertainty in a first operation branch by forming attention zones according to identified portions of lanes which may potentially collide with a planned route of the host automobile vehicle; determining the unexpected uncertainty in a second operation branch by calculating an anomaly score for any other vehicles in a surrounding area of the host automobile vehicle positioned in the lanes which may potentially collide with the planned route of the host automobile vehicle; and modulating trajectory operation signals determined for the expected uncertainty if the unexpected uncertainty meets or exceeds a predetermined threshType: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Inventors: RAJAN BHATTACHARYYA, TIFFANY J. HWU, MICHAEL J. DAILY, HYUKSEONG KWON, MIA LEVY