Patents by Inventor Mattias WALLS

Mattias WALLS has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11551368
    Abstract: An electronic device includes a processor and a memory coupled to the processor. The memory includes a computer readable storage medium having computer readable program instructions stored therein that are executable by the processor to determine a position and/or orientation of sensor device that is arranged to capture data for a subject from the position and/or at the orientation, and, based on the position and/or orientation that was determined, control creation of a 3D representation of the subject from the data captured by the sensor device. Related methods and computer program products are also discussed.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: January 10, 2023
    Assignee: Sony Group Corporation
    Inventors: Sebastian Farås, Mattias Walls, Johannes Elg, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Patent number: 11288870
    Abstract: A method of guiding a user when performing a three-dimensional scan of an object includes determining two-dimensional feature points from two-dimensional captured images of the object, determining three-dimensional coordinates for the two-dimensional feature points, determining a cut plane based on the three-dimensional coordinates that divides the object into a target portion and a cut-away portion, and displaying the target portion of the object on a display using a first indicium and the cut-away portion of the object on the display using a second indicium that is different from the first indicium.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: March 29, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Mattias Walls, Francesco Michielin, Henrick Tuszynski, Johannes Elg, Fredrik Olofsson, Lars Novak
  • Patent number: 11158036
    Abstract: Methods of determining whether an environment is suitable or acceptable for performing a three-dimensional (3D) scan are provided. The methods may include performing one or more checks on captured image data of the environment, wherein performing each of the one or more checks comprises determining whether the environment satisfies a respective criterion. The method may further include determining that the environment is suitable or unsuitable for performing the 3D scan based on a result of each performed check. Determining that the environment is suitable for performing the 3D scan may include determining that the environment satisfies each of the respective criteria of the performed one or more checks. Determining that the environment is unsuitable for performing the 3D scan may include determining that the environment does not satisfy at least one criterion of the performed one or more checks. Related devices and computer program products are also provided.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 26, 2021
    Assignee: Sony Group Corporation
    Inventors: Mattias Walls, Francesco Michielin, Daniel Linåker, Bo-Erik Månsson, Henrik Tuszynski, Johannes Elg, Henrik Vallgren, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Patent number: 11151740
    Abstract: A method for determining the scale of a digital 3D model may include receiving, corresponding to a plurality of images, a respective plurality of first distances between the camera and the object in the environment and calculating, using a simultaneous localization and mapping (SLAM) algorithm, a plurality of second distances between the camera and the object in the 3D model of the environment. The method may include calculating a plurality of ratios corresponding to the plurality of images based on respective ones of the plurality of first distances and respective ones of the second distances and determining a scale of the 3D model based on the plurality of ratios. The method may include creating a scaled digital 3D model based on the 3 D model and the determined scale of the 3 D model. Distances and sizes in the scaled 3D model may correspond to actual distances and sizes of the environment.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 19, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Daniel Linåker, Mattias Walls, Johannes Elg, Fredrik Olofsson, Fredrik Mattisson
  • Patent number: 11151746
    Abstract: Image processing devices and methods according to embodiments of the invention advantageously utilize computationally efficient and high speed operations based on dynamic camera models to support rapid determination of multiple camera intrinsics. These built-in dynamic models can utilize varying focus distance values as inputs (i.e., operands) to generate respective intrinsic parameters as outputs, as a stream of images are captured and processed in real time to possibly determine pose and position of a three-dimensional (3D) object during 3 image scanning.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 19, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Mattias Walls, Francesco Michielin, Fredrik Olofsson, Fredrik Mattisson
  • Patent number: 11145072
    Abstract: A method for estimating a 3D map and a plurality of poses is described. The method includes non-recursively performing an initialization of the 3D map and the respective poses of the plurality of poses based on a plurality of first 2D images of the series of 2D images, and recursively performing sequential updating of the 3D map based on recursively updating the 3D map for respective ones of a plurality of second 2D images of the series of 2D images. Related systems, devices and computer program products are also described.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 12, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Sebastian Farås, Mattias Walls, Francesco Michielin, Bo-Erik Månsson, Johannes Elg, Fredrik Mattisson, Lars Novak, Fredrik Olofsson, Sebastian Haner, Roderick Köhle
  • Patent number: 11069121
    Abstract: A method for creating a 3D image is described. The method includes receiving a plurality of 2D images of an object, identifying respective 2D positions of one or more features in each of the plurality of 2D images, generating a 3D representation of the object, based on the respective 2D positions of the one or more features in each of the plurality of 2D images, and determining a 3D angular orientation of the 3D representation of the object based on relative positions of the one or more features in the 3D representation of the object. Related systems, devices and computer program products are also described.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Group Corporation
    Inventors: Mattias Walls, Johannes Elg, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Publication number: 20210133995
    Abstract: An electronic device includes a processor and a memory coupled to the processor. The memory includes a computer readable storage medium having computer readable program instructions stored therein that are executable by the processor to determine a position and/or orientation of sensor device that is arranged to capture data for a subject from the position and/or at the orientation, and, based on the position and/or orientation that was determined, control creation of a 3D representation of the subject from the data captured by the sensor device. Related methods and computer program products are also discussed.
    Type: Application
    Filed: August 31, 2017
    Publication date: May 6, 2021
    Inventors: Sebastian FARÅS, Mattias WALLS, Johannes ELG, Fredrik MATTISSON, Fredrik OLOFSSON, Lars NOVAK
  • Publication number: 20210118160
    Abstract: A method for estimating a 3D map and a plurality of poses is described. The method includes non-recursively performing an initialization of the 3D map and the respective poses of the plurality of poses based on a plurality of first 2D images of the series of 2D images, and recursively performing sequential updating of the 3D map based on recursively updating the 3D map for respective ones of a plurality of second 2D images of the series of 2D images. Related systems, devices and computer program products are also described.
    Type: Application
    Filed: August 31, 2017
    Publication date: April 22, 2021
    Inventors: Sebastian FARÅS, Mattias WALLS, Francesco MICHIELIN, Bo-Erik MÅNSSON, Johannes ELG, Fredrik MATTISSON, Lars NOVAK, Fredrik OLOFSSON, Sebastian HANER, Roderick KÖHLE
  • Publication number: 20200286217
    Abstract: Methods of determining whether an environment is suitable or acceptable for performing a three-dimensional (3D) scan are provided. The methods may include performing one or more checks on captured image data of the environment, wherein performing each of the one or more checks comprises determining whether the environment satisfies a respective criterion. The method may further include determining that the environment is suitable or unsuitable for performing the 3D scan based on a result of each performed check. Determining that the environment is suitable for performing the 3D scan may include determining that the environment satisfies each of the respective criteria of the performed one or more checks. Determining that the environment is unsuitable for performing the 3D scan may include determining that the environment does not satisfy at least one criterion of the performed one or more checks. Related devices and computer program products are also provided.
    Type: Application
    Filed: August 31, 2017
    Publication date: September 10, 2020
    Inventors: Mattias WALLS, Francesco MICHIELIN, Daniel LINÅKER, Bo-Erik MÅNSSON, Henrik TUSZYNSKI, Johannes ELG, Henrik VALLGREN, Fredrik MATTISSON, Fredrik OLOFSSON, Lars NOVAK
  • Publication number: 20200211211
    Abstract: A method for determining the scale of a digital 3D model may include receiving, corresponding to a plurality of images, a respective plurality of first distances between the camera and the object in the environment and calculating, using a simultaneous localization and mapping (SLAM) algorithm, a plurality of second distances between the camera and the object in the 3D model of the environment. The method may include calculating a plurality of ratios corresponding to the plurality of images based on respective ones of the plurality of first distances and respective ones of the second distances and determining a scale of the 3D model based on the plurality of ratios. The method may include creating a scaled digital 3D model based on the 3 D model and the determined scale of the 3 D model. Distances and sizes in the scaled 3D model may correspond to actual distances and sizes of the environment.
    Type: Application
    Filed: August 31, 2017
    Publication date: July 2, 2020
    Inventors: Daniel LINÅKER, Mattias WALLS, Johannes ELG, Fredrik OLOFSSON, Fredrik MATTISSON
  • Publication number: 20200167960
    Abstract: Image processing devices and methods according to embodiments of the invention advantageously utilize computationally efficient and high speed operations based on dynamic camera models to support rapid determination of multiple camera intrinsics. These built-in dynamic models can utilize varying focus distance values as inputs (i.e., operands) to generate respective intrinsic parameters as outputs, as a stream of images are captured and processed in real time to possibly determine pose and position of a three-dimensional (3D) object during 3 image scanning.
    Type: Application
    Filed: August 31, 2017
    Publication date: May 28, 2020
    Inventors: Mattias WALLS, Francesco MICHIELIN, Fredrik OLOFSSON, Fredrik MATTISSON
  • Publication number: 20200160586
    Abstract: A method for creating a 3D image is described. The method includes receiving a plurality of 2D images of an object, identifying respective 2D positions of one or more features in each of the plurality of 2D images, generating a 3D representation of the object, based on the respective 2D positions of the one or more features in each of the plurality of 2D images, and determining a 3D angular orientation of the 3D representation of the object based on relative positions of the one or more features in the 3D representation of the object. Related systems, devices and computer program products are also described.
    Type: Application
    Filed: August 31, 2017
    Publication date: May 21, 2020
    Inventors: Mattias WALLS, Johannes ELG, Fredrik MATTISSON, Fredrik OLOFSSON, Lars NOVAK