Patents by Inventor Lars Novak

Lars Novak has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11551368
    Abstract: An electronic device includes a processor and a memory coupled to the processor. The memory includes a computer readable storage medium having computer readable program instructions stored therein that are executable by the processor to determine a position and/or orientation of sensor device that is arranged to capture data for a subject from the position and/or at the orientation, and, based on the position and/or orientation that was determined, control creation of a 3D representation of the subject from the data captured by the sensor device. Related methods and computer program products are also discussed.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: January 10, 2023
    Assignee: Sony Group Corporation
    Inventors: Sebastian Farås, Mattias Walls, Johannes Elg, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Patent number: 11504604
    Abstract: The method of creating a three-dimensional (3D) puzzle of an object includes receiving a 3D model of the object; sequentially extracting a plurality of preliminary segments from the 3D model, and generating a plurality of two-dimensional (2D) printable segments corresponding to the plurality of preliminary segments. The plurality of printable segments may be configured to be printed to create a plurality of printed segments that may be configured to be selectively coupled together to form a 3D representation of the object.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: November 22, 2022
    Assignee: Sony Group Corporation
    Inventors: Lars Novak, Henrik Vallgren, Carl Hartzell, Hans Bjerndell
  • Patent number: 11494817
    Abstract: The present invention relates to a method for setting up a connection between a seller device (10) and a buyer device (30) for enabling the buyer device (30) to send and receive data via the seller (10).
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: November 8, 2022
    Assignee: Sony Group Corporation
    Inventors: Henrik Kinnunen, Alexander Bladh, Anders Kavcic, Johan Helgertz, Lars Novak, Kristofer Ringner, Jonas Graudums, Björn Smedman
  • Patent number: 11348303
    Abstract: Methods of creating a texture for a three-dimensional (3D) model using frequency separation and/or depth buffers are provided. Frequency separation may include splitting one or more images each into higher frequency components (which includes finer details such-as facial pores, lines, birthmarks, spots, or other textural details) and lower frequency components (such as color or tone). Depth buffering may include storing higher frequency components of the images within a depth buffer based on a distance of a corresponding vertex in the 3D model from the camera coordinate system, and then, using the closest pixel to the camera. This pixel likely has a highest amount of sharpness or detail. The lower frequency components can be averaged to account for illumination differences, but because the high frequency components have been separated, detail in the final texture may be preserved. Related devices and computer program products are also provided.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: May 31, 2022
    Assignee: Sony Group Corporation
    Inventors: Johannes Elg, Fredrik Olofsson, Lars Novak, Pal Szasz
  • Patent number: 11315313
    Abstract: A method of generating a 3D model may include receiving a plurality of 2D images of a physical object captured from a respective plurality of viewpoints in a 3D scan of the physical object in a first process. The method may include receiving a first process 3D mesh representation of the physical object and calculating respective second process estimated position and/or orientation information for each one of the respective plurality of viewpoints of the plurality of 2D images. The method may include generating a second process 3D mesh representation of the physical object using the plurality of 2D images, the second process estimated position and/or orientation information, and the first process 3D mesh representation of the physical object. The method may include generating a 3D model of the physical object by applying surface texture information from the plurality of 2D images to the second process 3D mesh representation of the physical object.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: April 26, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Francesco Michielin, Lars Novak, Fredrik Mattisson
  • Patent number: 11288870
    Abstract: A method of guiding a user when performing a three-dimensional scan of an object includes determining two-dimensional feature points from two-dimensional captured images of the object, determining three-dimensional coordinates for the two-dimensional feature points, determining a cut plane based on the three-dimensional coordinates that divides the object into a target portion and a cut-away portion, and displaying the target portion of the object on a display using a first indicium and the cut-away portion of the object on the display using a second indicium that is different from the first indicium.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: March 29, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Mattias Walls, Francesco Michielin, Henrick Tuszynski, Johannes Elg, Fredrik Olofsson, Lars Novak
  • Patent number: 11222430
    Abstract: A method for creating a 3D image is described. The method includes receiving a first 2D image and a second 2D image, identifying a plurality of first feature points in the first 2D image and a corresponding plurality of second feature points in the second 2D image, estimating a plurality of distances based on corresponding ones of the plurality of first feature points and based on corresponding ones of the plurality of second feature points, determining a mean and a standard deviation of inverses of the plurality of distances that were estimated, generating a baseline initialization coordinates based on the mean and the standard deviation of inverses of the plurality of distances, generating the 3D image based on the baseline initialization coordinates, and providing the 3D image for display. Related systems, devices and computer program products are also described.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: January 11, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Johannes Elg, Lars Novak, Fredrik Olofsson, Pal Szasz
  • Patent number: 11158036
    Abstract: Methods of determining whether an environment is suitable or acceptable for performing a three-dimensional (3D) scan are provided. The methods may include performing one or more checks on captured image data of the environment, wherein performing each of the one or more checks comprises determining whether the environment satisfies a respective criterion. The method may further include determining that the environment is suitable or unsuitable for performing the 3D scan based on a result of each performed check. Determining that the environment is suitable for performing the 3D scan may include determining that the environment satisfies each of the respective criteria of the performed one or more checks. Determining that the environment is unsuitable for performing the 3D scan may include determining that the environment does not satisfy at least one criterion of the performed one or more checks. Related devices and computer program products are also provided.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 26, 2021
    Assignee: Sony Group Corporation
    Inventors: Mattias Walls, Francesco Michielin, Daniel Linåker, Bo-Erik Månsson, Henrik Tuszynski, Johannes Elg, Henrik Vallgren, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Patent number: 11151727
    Abstract: Image processing devices utilize computationally efficient operations based on exposure time and object speed to detect and estimate motion blur. These operations include determining, from a plurality of image frames of an object, a representative length of movement associated with at least one feature point of the object, which undergoes movement between the plurality of image frames. This representative length of movement is converted to an estimate of motion blur for a respective image frame, using operations that are function of length of movement and exposure time.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: October 19, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Johannes Elg, Fredrik Mattisson, Lars Novak, Fredrik Olofsson, Pal Szasz
  • Patent number: 11145072
    Abstract: A method for estimating a 3D map and a plurality of poses is described. The method includes non-recursively performing an initialization of the 3D map and the respective poses of the plurality of poses based on a plurality of first 2D images of the series of 2D images, and recursively performing sequential updating of the 3D map based on recursively updating the 3D map for respective ones of a plurality of second 2D images of the series of 2D images. Related systems, devices and computer program products are also described.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 12, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Sebastian Farås, Mattias Walls, Francesco Michielin, Bo-Erik Månsson, Johannes Elg, Fredrik Mattisson, Lars Novak, Fredrik Olofsson, Sebastian Haner, Roderick Köhle
  • Patent number: 11069121
    Abstract: A method for creating a 3D image is described. The method includes receiving a plurality of 2D images of an object, identifying respective 2D positions of one or more features in each of the plurality of 2D images, generating a 3D representation of the object, based on the respective 2D positions of the one or more features in each of the plurality of 2D images, and determining a 3D angular orientation of the 3D representation of the object based on relative positions of the one or more features in the 3D representation of the object. Related systems, devices and computer program products are also described.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Group Corporation
    Inventors: Mattias Walls, Johannes Elg, Fredrik Mattisson, Fredrik Olofsson, Lars Novak
  • Patent number: 11069134
    Abstract: Methods, systems, and computer program products for removing unused portions of a 3D mesh representation of an object may include generating a first mesh representation of the object, the first mesh representation including a plurality of polygons, respective ones of the polygons including at least three vertices and at least three edges, wherein respective ones of the plurality of polygons are associated with a precision value that indicates an extent to which the respective ones of the plurality of polygons in the first mesh representation match the object, and adjusting the first mesh representation of the object to create a second mesh representation of the object by removing, front the first mesh representation, polygons of the plurality of polygons that are associated with precision values that have not been modified from an initial precision value.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Group Corporation
    Inventors: Pal Szasz, Johannes Elg, Fredrik Olofsson, Lars Novak, Fredrik Mattisson
  • Publication number: 20210209663
    Abstract: The present invention relates to a method for setting up a connection between a seller device (10) and a buyer device (30) for enabling the buyer device (30) to send and receive data via the seller (10).
    Type: Application
    Filed: February 13, 2017
    Publication date: July 8, 2021
    Inventors: Henrik KINNUNEN, Alexander BLADH, Anders KAVCIC, Johan HELGERTZ, Lars NOVAK, Kristofer RINGNER, Jonas GRAUDUMS, Björn SMEDMAN
  • Publication number: 20210166405
    Abstract: A method for creating a 3D image is described. The method includes receiving a first 2D image and a second 2D image, identifying a plurality of first feature points in the first 2D image and a corresponding plurality of second feature points in the second 2D image, estimating a plurality of distances based on corresponding ones of the plurality of first feature points and based on corresponding ones of the plurality of second feature points, determining a mean and a standard deviation of inverses of the plurality of distances that were estimated, generating a baseline initialization coordinates based on the mean and the standard deviation of inverses of the plurality of distances, generating the 3D image based on the baseline initialization coordinates, and providing the 3D image for display. Related systems, devices and computer program products are also described.
    Type: Application
    Filed: August 31, 2017
    Publication date: June 3, 2021
    Inventors: Johannes ELG, Lars NOVAK, Fredrik OLOFSSON, Pal SZASZ
  • Publication number: 20210150735
    Abstract: Image processing devices utilize computationally efficient operations based on exposure time and object speed to detect and estimate motion blur. These operations include determining, from a plurality of image frames of an object, a representative length of movement associated with at least one feature point of the object, which undergoes movement between the plurality of image frames. This representative length of movement is converted to an estimate of motion blur for a respective image frame, using operations that are function of length of movement and exposure time.
    Type: Application
    Filed: August 24, 2017
    Publication date: May 20, 2021
    Inventors: Johannes ELG, Fredrik MATTISSON, Lars NOVAK, Fredrik OLOFSSON, Pal SZASZ
  • Publication number: 20210133995
    Abstract: An electronic device includes a processor and a memory coupled to the processor. The memory includes a computer readable storage medium having computer readable program instructions stored therein that are executable by the processor to determine a position and/or orientation of sensor device that is arranged to capture data for a subject from the position and/or at the orientation, and, based on the position and/or orientation that was determined, control creation of a 3D representation of the subject from the data captured by the sensor device. Related methods and computer program products are also discussed.
    Type: Application
    Filed: August 31, 2017
    Publication date: May 6, 2021
    Inventors: Sebastian FARÅS, Mattias WALLS, Johannes ELG, Fredrik MATTISSON, Fredrik OLOFSSON, Lars NOVAK
  • Publication number: 20210118160
    Abstract: A method for estimating a 3D map and a plurality of poses is described. The method includes non-recursively performing an initialization of the 3D map and the respective poses of the plurality of poses based on a plurality of first 2D images of the series of 2D images, and recursively performing sequential updating of the 3D map based on recursively updating the 3D map for respective ones of a plurality of second 2D images of the series of 2D images. Related systems, devices and computer program products are also described.
    Type: Application
    Filed: August 31, 2017
    Publication date: April 22, 2021
    Inventors: Sebastian FARÅS, Mattias WALLS, Francesco MICHIELIN, Bo-Erik MÅNSSON, Johannes ELG, Fredrik MATTISSON, Lars NOVAK, Fredrik OLOFSSON, Sebastian HANER, Roderick KÖHLE
  • Publication number: 20210069580
    Abstract: The method of creating a three-dimensional (3D) puzzle of an object includes receiving a 3D model of the object; sequentially extracting a plurality of preliminary segments from the 3D model, and generating a plurality of two-dimensional (2D) printable segments corresponding to the plurality of preliminary segments. The plurality of printable segments may be configured to be printed to create a plurality of printed segments that may be configured to be selectively coupled together to form a 3D representation of the object.
    Type: Application
    Filed: August 31, 2017
    Publication date: March 11, 2021
    Inventors: Lars Novak, Henrik Vallgren, Carl Hartzell, Hans Bjerndell
  • Publication number: 20200349754
    Abstract: A method of generating a 3D model may include receiving a plurality of 2D images of a physical object captured from a respective plurality of viewpoints in a 3D scan of the physical object in a first process. The method may include receiving a first process 3D mesh representation of the physical object and calculating respective second process estimated position and/or orientation information for each one of the respective plurality of viewpoints of the plurality of 2D images. The method may include generating a second process 3D mesh representation of the physical object using the plurality of 2D images, the second process estimated position and/or orientation information, and the first process 3D mesh representation of the physical object. The method may include generating a 3D model of the physical object by applying surface texture information from the plurality of 2D images to the second process 3D mesh representation of the physical object.
    Type: Application
    Filed: February 23, 2018
    Publication date: November 5, 2020
    Inventors: Francesco MICHIELIN, Lars NOVAK, Fredrik MATTISSON
  • Publication number: 20200334909
    Abstract: A method of guiding a user when performing a three-dimensional scan of an object includes determining two-dimensional feature points from two-dimensional captured images of the object, determining three-dimensional coordinates for the two-dimensional feature points, determining a cut plane based on the three-dimensional coordinates that divides the object into a target portion and a cut-away portion, and displaying the target portion of the object on a display using a first indicium and the cut-away portion of the object on the display using a second indicium that is different from the first indicium.
    Type: Application
    Filed: August 31, 2017
    Publication date: October 22, 2020
    Inventors: Mattias WALLIS, Francesco MICHIELIN, Henrick TUSZYNSKI, Johannes ELG, Fredrik OLOFSSON, Lars NOVAK