Patents by Inventor Nicholas POJMAN

Nicholas POJMAN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11501104
    Abstract: An approach is provided for image labeling for cross view alignment. The approach, for example, involves determining camera pose data, camera trajectory data, or a combination thereof for a first image depicting an area from a first perspective view. The approach also involves processing the camera pose data, the camera trajectory data, or a combination thereof to generate meta data indicating a position, an orientation, or a combination thereof of the first perspective view of the area relative to a second image depicting the area from a second perspective view. The approach further involves providing data for presenting the meta data in a user interface as an overlay on the second perspective view.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: November 15, 2022
    Assignee: HERE Global B.V.
    Inventors: Alex Ung, Zhanwei Chen, Anish Mittal, Nicholas Pojman, David Lawlor
  • Patent number: 11182607
    Abstract: An approach is provided for determining a ground control point from image data using machine learning. The approach, for example, involves selecting an feature based determining that the feature meets one or more properties for classification as a machine learnable feature. The approach also involves retrieving a plurality of ground truth images depicting the feature. The plurality of ground truth images is labeled with known pixel location data of the feature as respectively depicted in each of the plurality of ground truth images. The approach further involves training a machine learning model using the plurality of ground truth images to identify predicted pixel location data of the ground control point as depicted in an input image.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: November 23, 2021
    Assignee: HERE Global B.V.
    Inventors: Nicholas Pojman, Anish Mittal, Zhanwei Chen, David Lawlor
  • Patent number: 11023747
    Abstract: An approach is provided for detecting degraded ground paint in an image. The approach, for example, involves performing semantic segmentation on the image to determine one or more pixels of the image that are classified in a ground paint category. The approach also involves generating a binary image that contains the one or more pixels of the image that are classified in the ground paint category. The approach further involves generating a hole-filled binary image by filling in the binary image to generate one or more curvilinear structures from the one or more pixels. The approach further involves determining a difference between the image and the hole-filled binary image to identify one or more degraded ground paint pixels of the image and providing the one or more degraded ground paint pixels as an output.
    Type: Grant
    Filed: March 5, 2019
    Date of Patent: June 1, 2021
    Assignee: HERE Global B.V.
    Inventors: Nicholas Pojman, Anish Mittal, David Lawlor, Zhanwei Chen
  • Publication number: 20200285862
    Abstract: An approach is provided for detecting degraded ground paint in an image. The approach, for example, involves performing semantic segmentation on the image to determine one or more pixels of the image that are classified in a ground paint category. The approach also involves generating a binary image that contains the one or more pixels of the image that are classified in the ground paint category. The approach further involves generating a hole-filled binary image by filling in the binary image to generate one or more curvilinear structures from the one or more pixels. The approach further involves determining a difference between the image and the hole-filled binary image to identify one or more degraded ground paint pixels of the image and providing the one or more degraded ground paint pixels as an output.
    Type: Application
    Filed: March 5, 2019
    Publication date: September 10, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, David LAWLOR, Zhanwei CHEN
  • Publication number: 20200167689
    Abstract: An approach is provided for selecting machine learning training observations. The approach, for example, involves providing data for presenting a user interface displaying a plurality of training images and specifying a feature to label in the plurality of training images. The feature is selected based on an image selection criterion. The approach also involves receiving a set of feature labels for the plurality of training images via the user interface based on crowd-sourced input data. The approach further involves training a machine learning based image selector to select a plurality of images, a plurality of patches of a larger image, or a combination thereof for labeling based on the set of feature labels and the plurality of training images.
    Type: Application
    Filed: November 28, 2018
    Publication date: May 28, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, Zhanwei CHEN
  • Publication number: 20200167603
    Abstract: An approach is provided for image labeling for cross view alignment. The approach, for example, involves determining camera pose data, camera trajectory data, or a combination thereof for a first image depicting an area from a first perspective view. The approach also involves processing the camera pose data, the camera trajectory data, or a combination thereof to generate meta data indicating a position, an orientation, or a combination thereof of the first perspective view of the area relative to a second image depicting the area from a second perspective view. The approach further involves providing data for presenting the meta data in a user interface as an overlay on the second perspective view.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Inventors: Alex UNG, Zhanwei CHEN, Anish MITTAL, Nicholas POJMAN, David LAWLOR
  • Publication number: 20200134311
    Abstract: An approach is provided for determining a ground control point from image data using machine learning. The approach, for example, involves selecting an feature based determining that the feature meets one or more properties for classification as a machine learnable feature. The approach also involves retrieving a plurality of ground truth images depicting the feature. The plurality of ground truth images is labeled with known pixel location data of the feature as respectively depicted in each of the plurality of ground truth images. The approach further involves training a machine learning model using the plurality of ground truth images to identify predicted pixel location data of the ground control point as depicted in an input image.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Inventors: Nicholas POJMAN, Anish MITTAL, Zhanwei CHEN, David LAWLOR
  • Patent number: 10452956
    Abstract: An approach is provided for providing quality assurance for training a feature prediction model. The approach involves training the feature prediction model to label one or more features by using a training data set comprising a plurality of data items with manually marked feature labels. The approach also involves processing the training data set using the trained feature prediction model to generate automatically marked feature labels for the plurality of data items. The approach further involves computing precision data indicating a respective precision between the manually marked feature labels and the automatically marked feature labels for each of the plurality of data items in the training data set. The approach further involves initiating a quality assurance procedure on said each of the plurality of data items based on a determination that the precision data does not satisfy a quality assurance criterion.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: October 22, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, Nicholas Pojman, Yangyang Chen
  • Patent number: 10331957
    Abstract: An approach is provided for estimating a vanishing point or horizon in an image depicting one or more lanes of a roadway. The approach involves processing the image to construct one or more lane models of the one or more road lanes depicted in the image. The approach also involves extending the one or more road lanes through the image using the one or more lane models. The approach further involves determining a horizontal line in the image at which a maximum number of the one or more extended road lanes crosses over a minimum horizontal extent of the horizontal line. The approach further involves designating the horizontal line as the horizon of the image.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: June 25, 2019
    Assignee: HERE Global B.V.
    Inventors: Richard Kwant, Anish Mittal, Nicholas Pojman, Yangyang Chen
  • Publication number: 20190102656
    Abstract: An approach is provided for providing quality assurance for training a feature prediction model. The approach involves training the feature prediction model to label one or more features by using a training data set comprising a plurality of data items with manually marked feature labels. The approach also involves processing the training data set using the trained feature prediction model to generate automatically marked feature labels for the plurality of data items. The approach further involves computing precision data indicating a respective precision between the manually marked feature labels and the automatically marked feature labels for each of the plurality of data items in the training data set. The approach further involves initiating a quality assurance procedure on said each of the plurality of data items based on a determination that the precision data does not satisfy a quality assurance criterion.
    Type: Application
    Filed: September 29, 2017
    Publication date: April 4, 2019
    Inventors: Richard KWANT, Anish MITTAL, Nicholas POJMAN, Yangyang CHEN
  • Publication number: 20190034740
    Abstract: An approach is provided for estimating a vanishing point or horizon in an image depicting one or more lanes of a roadway. The approach involves processing the image to construct one or more lane models of the one or more road lanes depicted in the image. The approach also involves extending the one or more road lanes through the image using the one or more lane models. The approach further involves determining a horizontal line in the image at which a maximum number of the one or more extended road lanes crosses over a minimum horizontal extent of the horizontal line. The approach further involves designating the horizontal line as the horizon of the image.
    Type: Application
    Filed: July 27, 2017
    Publication date: January 31, 2019
    Inventors: Richard KWANT, Anish MITTAL, Nicholas POJMAN, Yangyang CHEN