Patents by Inventor Jan Erik Solem

Jan Erik Solem has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240087226
    Abstract: A geographical area, which forms an area to be represented by a model of at least a portion of a scenery, is defined. The model defines three-dimensional structures of objects depicted in a plurality of images. A plurality of new images depicting the scenery is received. The plurality of new images is acquired by a camera from one or more positions within the geographical area. It is determined whether the plurality of new images fulfill a pre-defined updating criterion. In response to a determination that the plurality of new images fulfills the updating criterion, an update of the model is initiated.
    Type: Application
    Filed: October 31, 2023
    Publication date: March 14, 2024
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Patent number: 11928840
    Abstract: A method for analysis of an image comprises: receiving (402) the image to be analyzed; processing (404) the image with a machine-learned model, wherein the machine-learned model is configured to predict at least an intrinsic parameter of the image using at least a first variable of the machine-learned model, wherein the first variable defines a relation between a radial distortion of the image and a focal length of the image; and outputting (406) the intrinsic parameter of the image. Also, methods for forming a 3D reconstruction of a scenery, for training a machine-learned model for analysis of an image and for generating a dataset of images for training a machine-learned model are disclosed.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: March 12, 2024
    Assignee: Meta Platforms, Inc.
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Manuel Antonio López Antequera, Roger Marí Molas, Jan Erik Solem
  • Patent number: 11847742
    Abstract: A geographical area, which forms an area to be represented by a model of at least a portion of a scenery, is defined. A plurality of new images depicting the scenery is received. The plurality of new images is acquired by a camera from one or more positions within the geographical area. It is determined whether the plurality of new images fulfill a pre-defined updating criterion. In response to a determination that the plurality of new images fulfills the updating criterion, an update of the model is initiated. A boundary area enclosing the plurality of new images is defined. The boundary area is defined based at least in part on a distance margin between an edge of the boundary area and a new image included in the plurality of new images that is closest to the edge of the boundary area.
    Type: Grant
    Filed: February 3, 2022
    Date of Patent: December 19, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Publication number: 20220230390
    Abstract: A method in constructing a model of a scenery comprises: receiving (200) a plurality of images depicting the scenery, wherein each image is acquired by a camera (104) from a position at a rotational angle; creating (202) a plurality of sub-models, wherein each sub-model is created by: selecting (400) a basis image; determining (402) images related to the basis image; and determining (404) the sub-model based on the basis image and the related images, wherein the sub-model defines relative positions and rotational angles of the camera (104) for the basis image and the related images and the sub-model further defines three-dimensional structures of objects depicted in the plurality of images; and separately merging (204) the defined relative positions and rotational angles of cameras (104) for the plurality of sub-models.
    Type: Application
    Filed: February 3, 2022
    Publication date: July 21, 2022
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Publication number: 20220198710
    Abstract: A method for analysis of an image comprises: receiving (402) the image to be analyzed; processing (404) the image with a machine-learned model, wherein the machine-learned model is configured to predict at least an intrinsic parameter of the image using at least a first variable of the machine-learned model, wherein the first variable defines a relation between a radial distortion of the image and a focal length of the image; and outputting (406) the intrinsic parameter of the image. Also, methods for forming a 3D reconstruction of a scenery, for training a machine-learned model for analysis of an image and for generating a dataset of images for training a machine-learned model are disclosed.
    Type: Application
    Filed: March 13, 2020
    Publication date: June 23, 2022
    Inventors: Yubin Kuang, Pau Gargallo, Manuel López Antequera, Roger Marí Molas, Jan Erik Solem
  • Patent number: 11282271
    Abstract: A method in constructing a model of a scenery comprises: receiving (200) a plurality of images depicting the scenery, wherein each image is acquired by a camera (104) from a position at a rotational angle; creating (202) a plurality of sub-models, wherein each sub-model is created by: selecting (400) a basis image; determining (402) images related to the basis image; and determining (404) the sub-model based on the basis image and the related images, wherein the sub-model defines relative positions and rotational angles of the camera (104) for the basis image and the related images and the sub-model further defines three-dimensional structures of objects depicted in the plurality of images; and separately merging (204) the defined relative positions and rotational angles of cameras (104) for the plurality of sub-models.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: March 22, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Publication number: 20210326376
    Abstract: Information relating to a subset of images within a set of images is received. The information includes metadata of each image. The subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image. Weight information is received. The weight information controls weights to be given to a plurality of different measures of similarities. A plurality of combined measures of similarity for pairs of images in the subset of images are calculated.
    Type: Application
    Filed: May 6, 2021
    Publication date: October 21, 2021
    Inventors: Jan Erik Solem, Yubin Kuang, Johan Gyllenspetz, Peter Neubauer, Pau Gargallo Piracés
  • Patent number: 11030235
    Abstract: The present invention relates to a method for navigating through a set of images depicting a scenery, said method comprising: receiving information relating to a subset of images within said set of images, said information comprising metadata of each image, said subset of images comprising images being acquired from a geographical position, which is within a bounding area surrounding the geographical position of a current image within the set of images; receiving weight information, said weight information controlling weights to be given to a plurality of different measures of similarities based on different types of metadata; and calculating a plurality of combined measures of similarity for pairs of images in the subset of images, said calculating being performed using said metadata and said weight information.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: June 8, 2021
    Assignee: Facebook, Inc.
    Inventors: Jan Erik Solem, Yubin Kuang, Johan Gyllenspetz, Peter Neubauer, Pau Gargallo Piracés
  • Patent number: 10796207
    Abstract: By providing 3D representations of noteworthy locations for comparison with images, the 3D location of the imaging device, as well as the orientation of the device may be determined. The 3D location and orientation of the imaging device then allows for enhanced navigation in a collection of images, as well as enhanced visualization and editing capabilities. The 3D representations of noteworthy locations may be provided in a database that may be stored local or remote to the imaging device or a programmable device processing images obtained from the imaging device.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: October 6, 2020
    Assignee: Apple Inc.
    Inventors: Jan Erik Solem, Jerremy Holland
  • Publication number: 20200258297
    Abstract: A method in constructing a model of a scenery comprises: receiving (200) a plurality of images depicting the scenery, wherein each image is acquired by a camera (104) from a position at a rotational angle; creating (202) a plurality of sub-models, wherein each sub-model is created by: selecting (400) a basis image; determining (402) images related to the basis image; and determining (404) the sub-model based on the basis image and the related images, wherein the sub-model defines relative positions and rotational angles of the camera (104) for the basis image and the related images and the sub-model further defines three-dimensional structures of objects depicted in the plurality of images; and separately merging (204) the defined relative positions and rotational angles of cameras (104) for the plurality of sub-models.
    Type: Application
    Filed: April 23, 2020
    Publication date: August 13, 2020
    Applicant: Mapillary AB
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Patent number: 10672186
    Abstract: A method in constructing a model of a scenery comprises: receiving (200) a plurality of images depicting the scenery, wherein each image is acquired by a camera (104) from a position at a rotational angle; creating (202) a plurality of sub-models, wherein each sub-model is created by: selecting (400) a basis image; determining (402) images related to the basis image; and determining (404) the sub-model based on the basis image and the related images, wherein the sub-model defines relative positions and rotational angles of the camera (104) for the basis image and the related images and the sub-model further defines three-dimensional structures of objects depicted in the plurality of images; and separately merging (204) the defined relative positions and rotational angles of cameras (104) for the plurality of sub-models.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: June 2, 2020
    Assignee: MAPILLARY AB
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Patent number: 10372191
    Abstract: One embodiment may take the form of a method of operating a computing device in a reduced power state and collecting a first set of data from at least one sensor. Based on the first set of data, the computing device determines a probability that an object is within a threshold distance of the computing device and, if so, the device activates at least one secondary sensor to collect a second set of data. Based on the second set of data, the device determines if the object is a person. If it is a person, a position of the person relative to the computing device is determined and the computing device changes its state based on the position of the person. If the object is not a person, the computing device remains in a reduced power state.
    Type: Grant
    Filed: May 11, 2012
    Date of Patent: August 6, 2019
    Assignee: Apple Inc.
    Inventors: Edward Allen Valko, Matt Waldon, Rudolph van der Merwe, William Matthew Vieta, Myra Haggerty, Alex T. Nelson, Karen Louise Jenkins, Scott Thomas Smith, Jan Erik Solem
  • Publication number: 20190147303
    Abstract: By providing 3D representations of noteworthy locations for comparison with images, the 3D location of the imaging device, as well as the orientation of the device may be determined. The 3D location and orientation of the imaging device then allows for enhanced navigation in a collection of images, as well as enhanced visualization and editing capabilities. The 3D representations of noteworthy locations may be provided in a database that may be stored local or remote to the imaging device or a programmable device processing images obtained from the imaging device.
    Type: Application
    Filed: July 19, 2018
    Publication date: May 16, 2019
    Inventors: Jan Erik Solem, Jerremy Holland
  • Publication number: 20190018861
    Abstract: The present invention relates to a method for navigating through a set of images depicting a scenery, said method comprising: receiving information relating to a subset of images within said set of images, said information comprising metadata of each image, said subset of images comprising images being acquired from a geographical position, which is within a bounding area surrounding the geographical position of a current image within the set of images; receiving weight information, said weight information controlling weights to be given to a plurality of different measures of similarities based on different types of metadata; and calculating a plurality of combined measures of similarity for pairs of images in the subset of images, said calculating being performed using said metadata and said weight information.
    Type: Application
    Filed: December 27, 2016
    Publication date: January 17, 2019
    Applicant: Mapillary AB
    Inventors: Jan Erik Solem, Yubin Kuang, Johan Gyllenspetz, Peter Neubauer, Pau Gargello Piracés
  • Publication number: 20180365891
    Abstract: A method in constructing a model of a scenery comprises: receiving (200) a plurality of images depicting the scenery, wherein each image is acquired by a camera (104) from a position at a rotational angle; creating (202) a plurality of sub-models, wherein each sub-model is created by: selecting (400) a basis image; determining (402) images related to the basis image; and determining (404) the sub-model based on the basis image and the related images, wherein the sub-model defines relative positions and rotational angles of the camera (104) for the basis image and the related images and the sub-model further defines three-dimensional structures of objects depicted in the plurality of images; and separately merging (204) the defined relative positions and rotational angles of cameras (104) for the plurality of sub-models.
    Type: Application
    Filed: June 28, 2016
    Publication date: December 20, 2018
    Applicant: Mapillary AB
    Inventors: Yubin Kuang, Pau Gargallo Piracés, Jan Erik Solem, Johan Gyllenspetz
  • Patent number: 10089762
    Abstract: A method for navigating through a set of images depicting a scene comprises providing a graph representation of correlations of the images and receiving input for navigation that includes an indication of a current image and weight information to control weights to be given to a plurality of measures of similarities of edges in the graph. The indication of the current image is used to determine a current node in the graph representation. At least one best ranked transition image is determined related to the current image by an edge from the current node, said determining comprising using the weight information to weigh the plurality of measures of similarities for forming a combined measure of similarity for edges from the current node, and selecting the at least one best ranked transition image based on a comparison of the combined measure of similarity for the edges from the current node.
    Type: Grant
    Filed: July 1, 2015
    Date of Patent: October 2, 2018
    Assignee: MAPILLARY AB
    Inventors: Jan Erik Solem, Yubin Kuang, Johan Gyllenspetz, Peter Neubauer
  • Patent number: 10068157
    Abstract: By providing 3D representations of noteworthy locations for comparison with images, the 3D location of the imaging device, as well as the orientation of the device may be determined. The 3D location and orientation of the imaging device then allows for enhanced navigation in a collection of images, as well as enhanced visualization and editing capabilities. The 3D representations of noteworthy locations may be provided in a database that may be stored local or remote to the imaging device or a programmable device processing images obtained from the imaging device.
    Type: Grant
    Filed: May 10, 2012
    Date of Patent: September 4, 2018
    Assignee: Apple Inc.
    Inventors: Jan Erik Solem, Jerremy Holland
  • Publication number: 20170200293
    Abstract: A method for navigating through a set of images depicting a scene comprises: providing a graph representation of correlations of the images; receiving input for navigation through the set of images, said input comprising an indication of a current image in the set of images and weight information to control weights to be given to a plurality of measures of similarities of edges in the graph; accessing the graph representation, wherein the indication of the current image is used to determine a current node in the graph representation; and determining at least one best ranked transition image that is related to the current image by an edge from the current node, said determining comprising using the weight information to weigh the plurality of measures of similarities for forming a combined measure of similarity for edges from the current node; and selecting the at least one best ranked transition image based on a comparison of the combined measure of similarity for the edges from the current node.
    Type: Application
    Filed: July 1, 2015
    Publication date: July 13, 2017
    Applicant: Mapillary AB
    Inventors: Jan Erik Solem, Yubin Kuang, Johan Gyllenspetz, Peter Neubauer
  • Publication number: 20170201583
    Abstract: A method is disclosed for setting up a sensor system (100), comprising an optical image sensor (102), a processing unit (110) and a communication unit (114).
    Type: Application
    Filed: May 25, 2015
    Publication date: July 13, 2017
    Applicant: MODCAM AB
    Inventors: Marcus Leyman, Karl-Anders Johansson, Tord Wingren, Bogdan Tudosoiu, Jan Erik Solem
  • Patent number: 9582932
    Abstract: Methods and apparatus for a roof analysis tool for constructing a parameter set, where the parameter set is derived from mapping data for a map region, and where the parameter set describes the roofs for the buildings within the map region. In some cases, the parameter set includes a list of roof type identification values and the respective buildings in the map region for which a given roof type identification value corresponds. The roof analysis tool may operate on a server and work in conjunction with a mobile device, where the mobile device may display map views of a map region such that the map view is based on a three-dimensional model of the map region, and where a portion of the three-dimensional model is based on data generated on the mobile device and a portion of the three-dimensional model is based on data generated on the server.
    Type: Grant
    Filed: July 17, 2012
    Date of Patent: February 28, 2017
    Assignee: Apple Inc.
    Inventors: Rudolph van der Merwe, Jan Erik Solem, Jaron I. Waldman, John W. Kassebaum, Samuel G. Noble, Xiaqing Wu, Yang Liu