Patents by Inventor David Lawlor

David Lawlor has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210033404
    Abstract: Systems and methods for correcting mapping information inaccuracies are provided. In some aspects, the method includes receiving terrestrial data captured in an area of interest, and detecting features in the terrestrial data identifying ground points in the area of interest. The method also includes correlating the ground points with ground control points in the area of interest to determine a correspondence, and computing an aggregate of positional differences between corresponding points. The method further includes generating a report indicating a quality of the terrestrial data captured in the area of interest based on the aggregate.
    Type: Application
    Filed: July 31, 2019
    Publication date: February 4, 2021
    Applicant: HERE Global B.V.
    Inventors: DAVID LAWLOR, ZHANWEI CHEN, ANISH MITTAL
  • Publication number: 20210019516
    Abstract: A method is provided for generating and revising map geometry based on a received image and probe data. A method may include: receiving probe data from a first period of time, where the probe data from a first period of time is from a plurality of probes within a predefined geographic region; generating a first image of the predefined geographic region based on the probe data from the first period of time; receiving probe data from a second period of time different from the first period of time, where the probe data from the second period of time is from a plurality of probes within the predefined geographic region; generating a second image based on the probe data from the second period of time; comparing the first image to the second image; and generating a revised route geometry based on changes detected between the first image and the second image.
    Type: Application
    Filed: September 24, 2020
    Publication date: January 21, 2021
    Inventors: Anish MITTAL, Mark David TABB, Himaanshu GUPTA, Yelena PERELMUTOVA, David LAWLOR
  • Publication number: 20200380271
    Abstract: An approach is provided for an asymmetric evaluation of polygon similarity. The approach, for instance, involves receiving a first polygon representing an object depicted in an image. The approach also involves generating a transformation of the image comprising image elements whose values are based on a respective distance that each image element is from a nearest image element located on a first boundary of the first polygon. The approach further involves determining a subset of the plurality of image elements of the transformation that intersect with a second boundary of a second polygon. The approach further involves calculating a polygon similarity of the second polygon with respect the first polygon based on the values of the subset of image elements normalized to a length of the second boundary of the second polygon.
    Type: Application
    Filed: August 17, 2020
    Publication date: December 3, 2020
    Inventors: Anish MITTAL, Richard KWANT, Zhanwei CHEN, Himaanshu GUPTA, David LAWLOR
  • Patent number: 10810419
    Abstract: A method is provided for generating and revising map geometry based on a received image and probe data. A method may include: receiving probe data from a first period of time, where the probe data from a first period of time is from a plurality of probes within a predefined geographic region; generating a first image of the predefined geographic region based on the probe data from the first period of time; receiving probe data from a second period of time different from the first period of time, where the probe data from the second period of time is from a plurality of probes within the predefined geographic region; generating a second image based on the probe data from the second period of time; comparing the first image to the second image; and generating a revised route geometry based on changes detected between the first image and the second image.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: October 20, 2020
    Assignee: HERE Global B.V.
    Inventors: Anish Mittal, Mark David Tabb, Himaanshu Gupta, Yelena Perelmutova, David Lawlor
  • Patent number: 10789487
    Abstract: An approach is provided for an asymmetric evaluation of polygon similarity. The approach, for instance, involves receiving a first polygon representing an object depicted in an image. The approach also involves generating a transformation of the image comprising image elements whose values are based on a respective distance that each image element is from a nearest image element located on a first boundary of the first polygon. The approach further involves determining a subset of the plurality of image elements of the transformation that intersect with a second boundary of a second polygon. The approach further involves calculating a polygon similarity of the second polygon with respect the first polygon based on the values of the subset of image elements normalized to a length of the second boundary of the second polygon.
    Type: Grant
    Filed: April 5, 2018
    Date of Patent: September 29, 2020
    Assignee: HERE Global B.V.
    Inventors: Anish Mittal, Richard Kwant, Zhanwei Chen, Himaanshu Gupta, David Lawlor
  • Patent number: 10776951
    Abstract: An approach is provided for an asymmetric evaluation of polygon similarity. The approach, for instance, involves receiving a first polygon representing an object depicted in an image. The approach also involves generating a transformation of the image comprising image elements whose values are based on a respective distance that each image element is from a nearest image element located on a first boundary of the first polygon. The approach further involves determining a subset of the plurality of image elements of the transformation that intersect with a second boundary of a second polygon. The approach further involves calculating a polygon similarity of the second polygon with respect the first polygon based on the values of the subset of image elements normalized to a length of the second boundary of the second polygon.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: September 15, 2020
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor
  • Publication number: 20200285862
    Abstract: An approach is provided for detecting degraded ground paint in an image. The approach, for example, involves performing semantic segmentation on the image to determine one or more pixels of the image that are classified in a ground paint category. The approach also involves generating a binary image that contains the one or more pixels of the image that are classified in the ground paint category. The approach further involves generating a hole-filled binary image by filling in the binary image to generate one or more curvilinear structures from the one or more pixels. The approach further involves determining a difference between the image and the hole-filled binary image to identify one or more degraded ground paint pixels of the image and providing the one or more degraded ground paint pixels as an output.
    Type: Application
    Filed: March 5, 2019
    Publication date: September 10, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, David LAWLOR, Zhanwei CHEN
  • Publication number: 20200272847
    Abstract: An approach is provided for determining a feature correspondence based on camera geometry. The approach, for example, involves determining a first labeled or detected pixel location in a first image and a second labeled or detected pixel location in a second image. The approach also involves computing a first ray from a first camera position of the first image through the first labeled or detected pixel location. The approach further involves computing a second ray from a second camera position of the second image through the second labeled or detected pixel location. The approach further involves computing a closeness value of the first ray and the second ray. The approach further involves providing an output indicating the feature correspondence between the first labeled or detected pixel location and the second labeled or detected pixel location based on determining that the closeness value is within a threshold value.
    Type: Application
    Filed: February 27, 2019
    Publication date: August 27, 2020
    Inventors: Anish MITTAL, David LAWLOR, Krishna BALAKRISHNAN, Zhanwei CHEN
  • Publication number: 20200167603
    Abstract: An approach is provided for image labeling for cross view alignment. The approach, for example, involves determining camera pose data, camera trajectory data, or a combination thereof for a first image depicting an area from a first perspective view. The approach also involves processing the camera pose data, the camera trajectory data, or a combination thereof to generate meta data indicating a position, an orientation, or a combination thereof of the first perspective view of the area relative to a second image depicting the area from a second perspective view. The approach further involves providing data for presenting the meta data in a user interface as an overlay on the second perspective view.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Inventors: Alex UNG, Zhanwei CHEN, Anish MITTAL, Nicholas POJMAN, David LAWLOR
  • Publication number: 20200132472
    Abstract: An approach is provided for location correction using feature point correspondences between images or image sources. The approach, for example, involves processing a first image and a second image to identify a feature that is visible in both the first image and the second image. The first image has an image-to-ground correspondence between the feature in the first image and a geographic location. The approach also involves transferring the image-to-ground correspondence from the first image to the second image. The approach further involves using the transferred image-to-ground correspondence to reference the feature in the second image to the geographic location.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Anish MITTAL, Zhanwei CHEN, David LAWLOR, Peter CHRISTIAN
  • Publication number: 20200134311
    Abstract: An approach is provided for determining a ground control point from image data using machine learning. The approach, for example, involves selecting an feature based determining that the feature meets one or more properties for classification as a machine learnable feature. The approach also involves retrieving a plurality of ground truth images depicting the feature. The plurality of ground truth images is labeled with known pixel location data of the feature as respectively depicted in each of the plurality of ground truth images. The approach further involves training a machine learning model using the plurality of ground truth images to identify predicted pixel location data of the ground control point as depicted in an input image.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, Zhanwei CHEN, David LAWLOR
  • Publication number: 20200104727
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Application
    Filed: December 2, 2019
    Publication date: April 2, 2020
    Inventors: Richard KWANT, Anish MITTAL, David LAWLOR, Zhanwei CHEN, Himaanshu GUPTA
  • Publication number: 20200020104
    Abstract: An approach is provided for generating a polyline from line segments (e.g., line segments representing objects detected by a computer vision system). The approach involves selecting a line segment from a plurality of line segments. The approach also involves determining a neighboring line segment from among the plurality of line segments. The determined neighboring line segment has a closest distance to the line segment from among the plurality of line segments. The approach further involves merging the line segment and the neighboring line segment into a polyline based on determining that the closest distance is a mutual closest distance between line segment and the neighboring line segment.
    Type: Application
    Filed: July 12, 2018
    Publication date: January 16, 2020
    Inventors: Anish MITTAL, David LAWLOR, Zhanwei CHEN, Himaanshu GUPTA
  • Patent number: 10535006
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: January 14, 2020
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta
  • Patent number: 10515293
    Abstract: An approach is provided for using one or more skip areas to label, train, and/or evaluate a machine learning model. The approach, for example, involves specifying the one or more skip areas with respect to an image. By way of example, a non-skip area of the image is a portion of the image that is not in the one or more skip areas. The approach also involves initiating a labeling of one or more features in the non-skip area of the image while excluding the one or more skip areas from the labeling to create a partially labeled image. The partially labeled image is then included in a training dataset for training a machine learning model.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: December 24, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta
  • Publication number: 20190347851
    Abstract: An approach is provided for determining a polygon of a geographic database that overlaps a candidate polygon or candidate point. The geographic database represents stored polygons as respective polygon points with zero area. The approach involves determining proximate polygon points from among the respective polygon points with zero area that are within a distance threshold of the candidate polygon or the candidate point. The approach also involves retrieving one or more proximate polygons from the geographic database that correspond to the one or more proximate polygon points. The approach further involves determining an intersection between the one or more proximate polygons and the candidate polygon or the candidate point. The approach then involves selecting the polygon that overlaps the candidate polygon or the candidate point based on the determined intersection.
    Type: Application
    Filed: July 25, 2019
    Publication date: November 14, 2019
    Inventors: Richard KWANT, Anish MITTAL, David LAWLOR
  • Patent number: 10445927
    Abstract: An approach is provided for determining a polygon of a geographic database that overlaps a candidate polygon or candidate point. The geographic database represents stored polygons as respective polygon points with zero area. The approach involves determining proximate polygon points from among the respective polygon points with zero area that are within a distance threshold of the candidate polygon or the candidate point. The approach also involves retrieving one or more proximate polygons from the geographic database that correspond to the one or more proximate polygon points. The approach further involves determining an intersection between the one or more proximate polygons and the candidate polygon or the candidate point. The approach then involves selecting the polygon that overlaps the candidate polygon or the candidate point based on the determined intersection.
    Type: Grant
    Filed: November 16, 2016
    Date of Patent: October 15, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor
  • Publication number: 20190311205
    Abstract: An approach is provided for an asymmetric evaluation of polygon similarity. The approach, for instance, involves receiving a first polygon representing an object depicted in an image. The approach also involves generating a transformation of the image comprising image elements whose values are based on a respective distance that each image element is from a nearest image element located on a first boundary of the first polygon. The approach further involves determining a subset of the plurality of image elements of the transformation that intersect with a second boundary of a second polygon. The approach further involves calculating a polygon similarity of the second polygon with respect the first polygon based on the values of the subset of image elements normalized to a length of the second boundary of the second polygon.
    Type: Application
    Filed: April 5, 2018
    Publication date: October 10, 2019
    Inventors: Anish MITTAL, Richard KWANT, Zhanwei CHEN, Himaanshu GUPTA, David LAWLOR
  • Patent number: 10402995
    Abstract: An approach is provided for object detection. The approach involves receiving a feature map encoding high level features of object contours detected in an image divided into a plurality of grid cells, and further encoding start locations of each detected object contour. The approach also involves selecting a grid cell including a start location of an object contour. The approach further involves determining a precise location of the start location within the grid cell. The approach further involves determining a set of feature values from a set of proximate grid cells. The approach further involves processing the precise location and the set of feature values using a machine learning network to output a displacement vector to indicate a next coordinate of the object contour, and updating a cursor of the machine learning network based on the displacement vector.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: September 3, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor
  • Publication number: 20190228318
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Application
    Filed: January 23, 2018
    Publication date: July 25, 2019
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta