Patents by Inventor Sanjay Kumar Boddhu
Sanjay Kumar Boddhu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240344846Abstract: An approach is provided for generating synthetic ground truth drive and sensor observation data. The approach, for instance, receiving, by a processor, a first input specifying ground truth data indicating one or more ground truth locations of one or more map features. The approach also involves receiving a second input specifying one or more simulation characteristics. The approach further involves generating simulated drive data based on the ground truth data and the one or more simulation characteristics. For example, the simulated drive data includes (a) one or more simulated drive paths within a region of interest encompassing the one or more ground truth locations and (b) one or more simulated sensor observations of the one or more map features. The approach further involves providing the simulated drive data as an output.Type: ApplicationFiled: April 11, 2023Publication date: October 17, 2024Inventors: Landis HUFFMAN, Nilesh KADAM, Dennis Scott WILLIAMSON, Roberto RAGGI, James D. LYNCH, Prasad KAVURI, Shishir B. SAXENA, Sanjay Kumar BODDHU
-
Patent number: 11989905Abstract: Systems and methods for synchronization are provided. In some aspects, a method for synchronizing an image sensor is provided. The method includes receiving image data captured using an image sensor that is moving along a pathway, and assembling an image sensor trajectory using the image data. The method also includes receiving position data acquired along the pathway using a position sensor, wherein timestamps for the image data and position data are asynchronous, and assembling a position sensor trajectory using the position data. The method further includes generating a spatial transformation that aligns the image sensor trajectory and position sensor trajectory, and synchronizing the image sensor based on the spatial transformation.Type: GrantFiled: April 27, 2021Date of Patent: May 21, 2024Assignee: HERE GLOBAL B.V.Inventors: Landis Huffman, Joshua Michael Finken, Amey Aroskar, Sumedh Rasal, Sanjay Kumar Boddhu
-
Publication number: 20230298362Abstract: An approach is provided for lane width estimation from incomplete lane marking detections of a road lane. The approach, for example, involves generating one or more perpendicular lines respectively from location centers of one or more first lane marking detections. A respective lane marking detection represents at least a portion of a boundary of the road lane as a line delimited by two location data points in accordance with detections by at least one sensor device onboard at least one vehicle. The approach also involves identifying second lane marking detections that each respectively intersect one of the one or more perpendicular lines. The approach further involves selecting one or more candidate lane widths based on one or more respective distances from the location centers to the second lane marking detections. The approach further involves determining an estimated lane width of the road lane based on the one or more candidate lane widths.Type: ApplicationFiled: March 18, 2022Publication date: September 21, 2023Inventors: Zhenhua ZHANG, Qi MAO, Xiaoying JIN, Lin GAN, Sanjay Kumar BODDHU
-
Publication number: 20230266142Abstract: An approach is provided for reconstructing a road linear feature. The approach, for example, involves receiving two or more linear feature detections that respectively represent a linear feature of a road as a line segment delimited by two feature points. The approach also involves map matching the two or more linear feature detections to a road link segment of a geographic database. The approach further involves determining an orientation difference for each of the two or more linear feature detections based on an angle difference between each linear feature detection and a link orientation of the map matched road link segment. The approach further involves determining a feature orientation of the linear feature based on an aggregation of the orientation difference for each linear feature detection. The approach further involves constructing a representation of the linear feature based at least in part on the feature orientation.Type: ApplicationFiled: February 23, 2022Publication date: August 24, 2023Inventors: Zhenhua ZHANG, Qi MAO, Lin GAN, Xiaoying JIN, Sanjay Kumar BODDHU
-
Patent number: 11710239Abstract: An approach is provided for using a machine learning model for identifying planar region(s) in an image. The approach involves, for example, determining the model for performing image segmentation. The model comprises at least: a trainable filter that convolves the image to generate an input volume comprising a projection of the image at different resolution scales; and feature(s) to identify image region(s) having a texture within a similarity threshold. The approach also involves processing the image using the model by generating the input volume from the image using the trainable filter and extracting the feature(s) from the input volume to determine the region(s) having the texture. The approach further involves determining the planar region(s) by clustering the image regions. The approach further involves generating a planar mask based on the planar region(s). The approach further involves providing the planar mask as an output of the image segmentation.Type: GrantFiled: November 10, 2020Date of Patent: July 25, 2023Assignee: HERE Global B.V.Inventors: Souham Biswas, Sanjay Kumar Boddhu
-
Patent number: 11600006Abstract: An apparatus and method for encoding objects in a camera-captured image with a deep neural network pipeline including multiple convolutional neural networks or convolutional layers. After identifying at least a portion of the camera-capture image, a first convolutional layer is applied to the at least the portion of the camera-captured image and multiple subregion representations are pooled from the output of the first convolutional layer. One or more additional convolutions are performed. At least one deconvolution is performed and concatenated with the output of one or more convolutions. One or more final convolutions are performed. The at least the portion of the camera-captured image is classified as an object category in response to an output of the one or more final convolutions.Type: GrantFiled: October 26, 2018Date of Patent: March 7, 2023Assignee: HERE Global B.V.Inventors: Souham Biswas, Sanjay Kumar Boddhu
-
Publication number: 20220343531Abstract: Systems and methods for synchronization are provided. In some aspects, a method for synchronizing an image sensor is provided. The method includes receiving image data captured using an image sensor that is moving along a pathway, and assembling an image sensor trajectory using the image data. The method also includes receiving position data acquired along the pathway using a position sensor, wherein timestamps for the image data and position data are asynchronous, and assembling a position sensor trajectory using the position data. The method further includes generating a spatial transformation that aligns the image sensor trajectory and position sensor trajectory, and synchronizing the image sensor based on the spatial transformation.Type: ApplicationFiled: April 27, 2021Publication date: October 27, 2022Applicant: HERE GLOBAL B.V.Inventors: LANDIS HUFFMAN, JOSHUA MICHAEL FINKEN, AMEY AROSKAR, SUMEDH RASAL, SANJAY KUMAR BODDHU
-
Publication number: 20220276618Abstract: An approach is provided for providing dynamic model switching and/or model parameter switching (e.g., for object detection). The approach, for example, involves providing a plurality of machine learning models trained to detect one or more objects (e.g., vehicles, pedestrians, etc.) and/or road attributes (e.g., road hazards, road furniture, road signs, etc.). The approach also involves processing sensor data to determine at least one context (e.g., location), at least one use of the one or more road attributes, or a combination thereof. The approach further involves selecting at least one machine learning model of the plurality of machine learning models based on at least one context. The approach further involves providing the selected at least one machine learning model to detect the one or more objects and/or road attributes.Type: ApplicationFiled: August 28, 2020Publication date: September 1, 2022Inventors: Amey AROSKAR, Sanjay Kumar BODDHU, Luke SMORON, Erika RODWELL
-
Publication number: 20220148184Abstract: An approach is provided for using a machine learning model for identifying planar region(s) in an image. The approach involves, for example, determining the model for performing image segmentation. The model comprises at least: a trainable filter that convolves the image to generate an input volume comprising a projection of the image at different resolution scales; and feature(s) to identify image region(s) having a texture within a similarity threshold. The approach also involves processing the image using the model by generating the input volume from the image using the trainable filter and extracting the feature(s) from the input volume to determine the region(s) having the texture. The approach further involves determining the planar region(s) by clustering the image regions. The approach further involves generating a planar mask based on the planar region(s). The approach further involves providing the planar mask as an output of the image segmentation.Type: ApplicationFiled: November 10, 2020Publication date: May 12, 2022Inventors: Souham BISWAS, Sanjay Kumar BODDHU
-
Patent number: 11015941Abstract: A method map matches probe data to a candidate road segment or node. Methods may include: searching for candidate road segments or nodes for each probe data point to be matched to, where searching for candidate road segments or nodes includes: searching within a predefined radius of each probe data point for road segments or nodes and in response to no road segments or nodes being found within the predefined radius of the respective probe data point, iteratively increasing the predefined radius and searching again until a predefined maximum radius is reached or at least two road segment candidates or node candidates are found; map matching each probe data point to a respective road segment candidate or node candidate based on the road segment candidate or node candidate found in the search; and generating a path based on the map matched probe data points from a respective probe.Type: GrantFiled: May 25, 2018Date of Patent: May 25, 2021Assignee: HERE GLOBAL B.V.Inventors: Qi Mao, Qin Chen, Sanjay Kumar Boddhu
-
Patent number: 10997740Abstract: An approach is provided for estimating a real-world depth information from a monocular image. The approach, for example, involves determining a vanishing point of the monocular image captured by a camera. The approach also involves generating a vanishing point ray from an optical center of the camera through the vanishing point on an image plane of the monocular image to infinity. The approach further involves generating a center line ray from the optical center through a geometric center of the image plane to a feature line that is parallel to the vanishing point ray at a lateral distance. The approach further involves generating a feature ray from the optical center through a location of the feature on the image plane to the feature line. The approach further involves computing the real-world distances of the feature based on image coordinates of the rays, lines, angles derived therefrom, and a known pixel-wise distance of the monocular image.Type: GrantFiled: July 15, 2019Date of Patent: May 4, 2021Assignee: HERE Global B.V.Inventors: Souham Biswas, Sanjay Kumar Boddhu
-
Publication number: 20210019897Abstract: An approach is provided for estimating a real-world depth information from a monocular image. The approach, for example, involves determining a vanishing point of the monocular image captured by a camera. The approach also involves generating a vanishing point ray from an optical center of the camera through the vanishing point on an image plane of the monocular image to infinity. The approach further involves generating a center line ray from the optical center through a geometric center of the image plane to a feature line that is parallel to the vanishing point ray at a lateral distance. The approach further involves generating a feature ray from the optical center through a location of the feature on the image plane to the feature line. The approach further involves computing the real-world distances of the feature based on image coordinates of the rays, lines, angles derived therefrom, and a known pixel-wise distance of the monocular image.Type: ApplicationFiled: July 15, 2019Publication date: January 21, 2021Inventors: Souham BISWAS, Sanjay Kumar BODDHU
-
Patent number: 10782138Abstract: A method, apparatus, and computer program product are described herein for determining pedestrian behavior profiles for road segments of a road network, from those pedestrian behavior profiles, determining the likelihood that an adverse pedestrian event will occur, and determining the action to be taken in response. Example embodiments may provide a mapping system including: a memory having map data; and processing circuitry. The processing circuitry may be configured to: receive data points associated with pedestrian movement; associate pedestrian movement with a road segment; determine, based on the data points, a pedestrian behavior profile for the road segment; and in response to the pedestrian behavior profile for the road segment indicating a likelihood for an adverse pedestrian event that satisfies a predetermined likelihood, cause at least one action in response thereto.Type: GrantFiled: October 6, 2017Date of Patent: September 22, 2020Assignee: HERE Global B.V.Inventors: Christof Kaiser, Sanjay Kumar Boddhu, Kevin Johnson, Davide Pietrobon, Noelle Risberg Scilley
-
Publication number: 20200134833Abstract: An apparatus and method for encoding objects in a camera-captured image with a deep neural network pipeline including multiple convolutional neural networks or convolutional layers. After identifying at least a portion of the camera-capture image, a first convolutional layer is applied to the at least the portion of the camera-captured image and multiple subregion representations are pooled from the output of the first convolutional layer. One or more additional convolutions are performed. At least one deconvolution is performed and concatenated with the output of one or more convolutions. One or more final convolutions are performed. The at least the portion of the camera-captured image is classified as an object category in response to an output of the one or more final convolutions.Type: ApplicationFiled: October 26, 2018Publication date: April 30, 2020Inventors: Souham Biswas, Sanjay Kumar Boddhu
-
Publication number: 20190360819Abstract: A method map matches probe data to a candidate road segment or node. Methods may include: searching for candidate road segments or nodes for each probe data point to be matched to, where searching for candidate road segments or nodes includes: searching within a predefined radius of each probe data point for road segments or nodes and in response to no road segments or nodes being found within the predefined radius of the respective probe data point, iteratively increasing the predefined radius and searching again until a predefined maximum radius is reached or at least two road segment candidates or node candidates are found; map matching each probe data point to a respective road segment candidate or node candidate based on the road segment candidate or node candidate found in the search; and generating a path based on the map matched probe data points from a respective probe.Type: ApplicationFiled: May 25, 2018Publication date: November 28, 2019Inventors: Qi MAO, Qin CHEN, Sanjay Kumar BODDHU
-
Publication number: 20190108753Abstract: A method, apparatus, and computer program product are described herein for determining pedestrian behavior profiles for road segments of a road network, from those pedestrian behavior profiles, determining the likelihood that an adverse pedestrian event will occur, and determining the action to be taken in response. Example embodiments may provide a mapping system including: a memory having map data; and processing circuitry. The processing circuitry may be configured to: receive data points associated with pedestrian movement; associate pedestrian movement with a road segment; determine, based on the data points, a pedestrian behavior profile for the road segment; and in response to the pedestrian behavior profile for the road segment indicating a likelihood for an adverse pedestrian event that satisfies a predetermined likelihood, cause at least one action in response thereto.Type: ApplicationFiled: October 6, 2017Publication date: April 11, 2019Inventors: Christof Kaiser, Sanjay Kumar Boddhu, Kevin Johnson, Davide Pietrobon, Noelle Risberg Scilley