Patents by Inventor Carl Sebastian Toft

Carl Sebastian Toft has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Feature matching using features extracted from perspective corrected image
    Patent number: 12008740
    Abstract: An image localization system receives an image of a scene and generates a depth map for the image by inputting the image to a model trained for generating depth maps for images. The system determines surface normal vectors for the pixels in the depth map. The system clusters the surface normal vectors to identify regions in the image corresponding to planar surfaces. The system partitions the image into patches, each of which is a region of connected pixels in the image and corresponds to a cluster of surface normal vectors. The system rectifies the perspective distortion of patches and extracts perspective corrected features from the rectified patches. The system matches the perspective corrected features of the image with perspective corrected features of other images for three-dimensional re-localization.
    Type: Grant
    Filed: August 6, 2021
    Date of Patent: June 11, 2024
    Assignee: NIANTIC, INC.
    Inventors: Carl Sebastian Toft, Daniyar Turmukhambetov, Gabriel J. Brostow
  • FEATURE MATCHING USING FEATURES EXTRACTED FROM PERSPECTIVE CORRECTED IMAGE
    Publication number: 20220051372
    Abstract: An image localization system receives an image of a scene and generates a depth map for the image by inputting the image to a model trained for generating depth maps for images. The system determines surface normal vectors for the pixels in the depth map. The system clusters the surface normal vectors to identify regions in the image corresponding to planar surfaces. The system partitions the image into patches, each of which is a region of connected pixels in the image and corresponds to a cluster of surface normal vectors. The system rectifies the perspective distortion of patches and extracts perspective corrected features from the rectified patches. The system matches the perspective corrected features of the image with perspective corrected features of other images for three-dimensional re-localization.
    Type: Application
    Filed: August 6, 2021
    Publication date: February 17, 2022
    Inventors: Carl Sebastian Toft, Daniyar Turmukhambetov, Gabriel J. Brostow