Patents by Inventor Anish Mittal

Anish Mittal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200285862
    Abstract: An approach is provided for detecting degraded ground paint in an image. The approach, for example, involves performing semantic segmentation on the image to determine one or more pixels of the image that are classified in a ground paint category. The approach also involves generating a binary image that contains the one or more pixels of the image that are classified in the ground paint category. The approach further involves generating a hole-filled binary image by filling in the binary image to generate one or more curvilinear structures from the one or more pixels. The approach further involves determining a difference between the image and the hole-filled binary image to identify one or more degraded ground paint pixels of the image and providing the one or more degraded ground paint pixels as an output.
    Type: Application
    Filed: March 5, 2019
    Publication date: September 10, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, David LAWLOR, Zhanwei CHEN
  • Publication number: 20200273201
    Abstract: An approach is provided for feature point detection and representation. The approach, for example, involves processing (e.g., using a neural network or equivalent) image data associated with a grid cell of an image to determine a feature point corresponding to a position of a feature detected in the image data. The approach also involves encoding the position of the feature with respect to a coordinate system referenced to the grid cell. The output comprises one or more parameters indicating the encoded position, one or more attributes of the feature, or a combination thereof.
    Type: Application
    Filed: February 26, 2019
    Publication date: August 27, 2020
    Inventors: Anish MITTAL, Zhanwei CHEN
  • Publication number: 20200272847
    Abstract: An approach is provided for determining a feature correspondence based on camera geometry. The approach, for example, involves determining a first labeled or detected pixel location in a first image and a second labeled or detected pixel location in a second image. The approach also involves computing a first ray from a first camera position of the first image through the first labeled or detected pixel location. The approach further involves computing a second ray from a second camera position of the second image through the second labeled or detected pixel location. The approach further involves computing a closeness value of the first ray and the second ray. The approach further involves providing an output indicating the feature correspondence between the first labeled or detected pixel location and the second labeled or detected pixel location based on determining that the closeness value is within a threshold value.
    Type: Application
    Filed: February 27, 2019
    Publication date: August 27, 2020
    Inventors: Anish MITTAL, David LAWLOR, Krishna BALAKRISHNAN, Zhanwei CHEN
  • Publication number: 20200167689
    Abstract: An approach is provided for selecting machine learning training observations. The approach, for example, involves providing data for presenting a user interface displaying a plurality of training images and specifying a feature to label in the plurality of training images. The feature is selected based on an image selection criterion. The approach also involves receiving a set of feature labels for the plurality of training images via the user interface based on crowd-sourced input data. The approach further involves training a machine learning based image selector to select a plurality of images, a plurality of patches of a larger image, or a combination thereof for labeling based on the set of feature labels and the plurality of training images.
    Type: Application
    Filed: November 28, 2018
    Publication date: May 28, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, Zhanwei CHEN
  • Publication number: 20200167603
    Abstract: An approach is provided for image labeling for cross view alignment. The approach, for example, involves determining camera pose data, camera trajectory data, or a combination thereof for a first image depicting an area from a first perspective view. The approach also involves processing the camera pose data, the camera trajectory data, or a combination thereof to generate meta data indicating a position, an orientation, or a combination thereof of the first perspective view of the area relative to a second image depicting the area from a second perspective view. The approach further involves providing data for presenting the meta data in a user interface as an overlay on the second perspective view.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Inventors: Alex UNG, Zhanwei CHEN, Anish MITTAL, Nicholas POJMAN, David LAWLOR
  • Publication number: 20200134844
    Abstract: An approach is provided for determining a feature correspondence between image views. The approach, for example, involves retrieving a top down image for an area of interest and determining a ground level camera pose path for the area of interest. The approach also involves selecting a portion of the top down image that corresponds to a geographic area within a distance threshold from the ground level camera pose path, and then processing the portion of the top down image to identify a semantic feature. The approach further involves determining a subset of camera poses of the ground level pose path that is within a sphere of visibility of the semantic feature, and retrieving one or more ground level images captured with the subset of camera poses. The approach further involves determining the feature correspondence of the semantic feature between the top down image and the one or more ground level images.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Anish MITTAL, Zhanwei CHEN, Joseph KURIAN
  • Publication number: 20200132472
    Abstract: An approach is provided for location correction using feature point correspondences between images or image sources. The approach, for example, involves processing a first image and a second image to identify a feature that is visible in both the first image and the second image. The first image has an image-to-ground correspondence between the feature in the first image and a geographic location. The approach also involves transferring the image-to-ground correspondence from the first image to the second image. The approach further involves using the transferred image-to-ground correspondence to reference the feature in the second image to the geographic location.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Anish MITTAL, Zhanwei CHEN, David LAWLOR, Peter CHRISTIAN
  • Publication number: 20200134311
    Abstract: An approach is provided for determining a ground control point from image data using machine learning. The approach, for example, involves selecting an feature based determining that the feature meets one or more properties for classification as a machine learnable feature. The approach also involves retrieving a plurality of ground truth images depicting the feature. The plurality of ground truth images is labeled with known pixel location data of the feature as respectively depicted in each of the plurality of ground truth images. The approach further involves training a machine learning model using the plurality of ground truth images to identify predicted pixel location data of the ground control point as depicted in an input image.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, Zhanwei CHEN, David LAWLOR
  • Publication number: 20200104727
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Application
    Filed: December 2, 2019
    Publication date: April 2, 2020
    Inventors: Richard KWANT, Anish MITTAL, David LAWLOR, Zhanwei CHEN, Himaanshu GUPTA
  • Publication number: 20200020104
    Abstract: An approach is provided for generating a polyline from line segments (e.g., line segments representing objects detected by a computer vision system). The approach involves selecting a line segment from a plurality of line segments. The approach also involves determining a neighboring line segment from among the plurality of line segments. The determined neighboring line segment has a closest distance to the line segment from among the plurality of line segments. The approach further involves merging the line segment and the neighboring line segment into a polyline based on determining that the closest distance is a mutual closest distance between line segment and the neighboring line segment.
    Type: Application
    Filed: July 12, 2018
    Publication date: January 16, 2020
    Inventors: Anish MITTAL, David LAWLOR, Zhanwei CHEN, Himaanshu GUPTA
  • Patent number: 10535006
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: January 14, 2020
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta
  • Patent number: 10515293
    Abstract: An approach is provided for using one or more skip areas to label, train, and/or evaluate a machine learning model. The approach, for example, involves specifying the one or more skip areas with respect to an image. By way of example, a non-skip area of the image is a portion of the image that is not in the one or more skip areas. The approach also involves initiating a labeling of one or more features in the non-skip area of the image while excluding the one or more skip areas from the labeling to create a partially labeled image. The partially labeled image is then included in a training dataset for training a machine learning model.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: December 24, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta
  • Publication number: 20190347851
    Abstract: An approach is provided for determining a polygon of a geographic database that overlaps a candidate polygon or candidate point. The geographic database represents stored polygons as respective polygon points with zero area. The approach involves determining proximate polygon points from among the respective polygon points with zero area that are within a distance threshold of the candidate polygon or the candidate point. The approach also involves retrieving one or more proximate polygons from the geographic database that correspond to the one or more proximate polygon points. The approach further involves determining an intersection between the one or more proximate polygons and the candidate polygon or the candidate point. The approach then involves selecting the polygon that overlaps the candidate polygon or the candidate point based on the determined intersection.
    Type: Application
    Filed: July 25, 2019
    Publication date: November 14, 2019
    Inventors: Richard KWANT, Anish MITTAL, David LAWLOR
  • Patent number: 10452956
    Abstract: An approach is provided for providing quality assurance for training a feature prediction model. The approach involves training the feature prediction model to label one or more features by using a training data set comprising a plurality of data items with manually marked feature labels. The approach also involves processing the training data set using the trained feature prediction model to generate automatically marked feature labels for the plurality of data items. The approach further involves computing precision data indicating a respective precision between the manually marked feature labels and the automatically marked feature labels for each of the plurality of data items in the training data set. The approach further involves initiating a quality assurance procedure on said each of the plurality of data items based on a determination that the precision data does not satisfy a quality assurance criterion.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: October 22, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, Nicholas Pojman, Yangyang Chen
  • Patent number: 10445927
    Abstract: An approach is provided for determining a polygon of a geographic database that overlaps a candidate polygon or candidate point. The geographic database represents stored polygons as respective polygon points with zero area. The approach involves determining proximate polygon points from among the respective polygon points with zero area that are within a distance threshold of the candidate polygon or the candidate point. The approach also involves retrieving one or more proximate polygons from the geographic database that correspond to the one or more proximate polygon points. The approach further involves determining an intersection between the one or more proximate polygons and the candidate polygon or the candidate point. The approach then involves selecting the polygon that overlaps the candidate polygon or the candidate point based on the determined intersection.
    Type: Grant
    Filed: November 16, 2016
    Date of Patent: October 15, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor
  • Publication number: 20190311205
    Abstract: An approach is provided for an asymmetric evaluation of polygon similarity. The approach, for instance, involves receiving a first polygon representing an object depicted in an image. The approach also involves generating a transformation of the image comprising image elements whose values are based on a respective distance that each image element is from a nearest image element located on a first boundary of the first polygon. The approach further involves determining a subset of the plurality of image elements of the transformation that intersect with a second boundary of a second polygon. The approach further involves calculating a polygon similarity of the second polygon with respect the first polygon based on the values of the subset of image elements normalized to a length of the second boundary of the second polygon.
    Type: Application
    Filed: April 5, 2018
    Publication date: October 10, 2019
    Inventors: Anish MITTAL, Richard KWANT, Zhanwei CHEN, Himaanshu GUPTA, David LAWLOR
  • Patent number: 10402995
    Abstract: An approach is provided for object detection. The approach involves receiving a feature map encoding high level features of object contours detected in an image divided into a plurality of grid cells, and further encoding start locations of each detected object contour. The approach also involves selecting a grid cell including a start location of an object contour. The approach further involves determining a precise location of the start location within the grid cell. The approach further involves determining a set of feature values from a set of proximate grid cells. The approach further involves processing the precise location and the set of feature values using a machine learning network to output a displacement vector to indicate a next coordinate of the object contour, and updating a cursor of the machine learning network based on the displacement vector.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: September 3, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor
  • Patent number: 10373002
    Abstract: An approach is provided for parametric representation of lane lines. The approach involves segmenting an input image into grid cells. The approach also involves processing a portion of the input image in each grid cell to detect lane lines. The approach further involves, for each grid cell in which lane lines are detected, determining intercepts of the lane lines with edges of the grid cell, and slopes of the lane lines at the intercepts. The approach further involves generating a parametric representation of the lane lines for each grid cell. The parametric representation encodes the intercepts and slopes into a data structure for each grid cell. The approach further involves providing an output parametric representation for the input image that aggregates the parametric representations of each grid cell.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: August 6, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal
  • Publication number: 20190228318
    Abstract: An approach is provided for a redundant feature detection engine. The approach, for instance, involves segmenting an input image into a plurality of grid cells for processing by the redundant feature detection engine. The redundant feature detection engine includes a neural network. The approach also involves, for each of the plurality of grid cells, initiating a prediction of an object code by the redundant feature detection engine. The object code is a predicted feature that uniquely identifies an object depicted in the input image. The approach further involves aggregating the plurality of grid cells into one or more clusters based on the object code predicted for said each grid cell. The approach further involves predicting one or more features of the object corresponding to a respective cluster of the one or more clusters by merging one or more feature prediction outputs of said each grid cell in the respective cluster.
    Type: Application
    Filed: January 23, 2018
    Publication date: July 25, 2019
    Inventors: Richard Kwant, Anish Mittal, David Lawlor, Zhanwei Chen, Himaanshu Gupta
  • Patent number: 10339669
    Abstract: An approach is provided for a vertex-based evaluation of polygon similarity. The approach, for instance, involves processing, by a computer vision system, an image to generate a first set of vertices of a first polygon representing an object depicted in the image. The approach also involves for each vertex in the first set of vertices, determining a closest vertex in a second set of vertices of a second polygon, and determining a distance between said each vertex in the first set of vertices and the closest vertex in the second set of vertices. The approach further involves calculating a polygon similarity of the first polygon with respect to the second polygon based on a total of the distance determined for said each vertex in the first set of vertices normalized to a number of vertices in the first set of vertices.
    Type: Grant
    Filed: August 22, 2017
    Date of Patent: July 2, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, David Lawlor