Patents Assigned to Matterport, Inc.
  • Patent number: 12361511
    Abstract: Systems, computer-implemented methods, apparatus and/or computer program products are provided that facilitate improving the accuracy of global positioning system (GPS) coordinates of indoor photos. The disclosed subject matter further provides systems, computer-implemented methods, apparatus and/or computer program products that facilitate generating exterior photos of structures based on GPS coordinates of indoor photos.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: July 15, 2025
    Assignee: Matterport, Inc.
    Inventors: Dorra Larnaout, Greg Coombe
  • Publication number: 20250218128
    Abstract: An example method includes receiving 3D data of an interior of a building that has one or more stories and one or more rooms on the one or more stories. The 3D data is classified by receiving multiple 360 degree panoramic images of the interior, applying a trained model to classify the multiple 360 degree panoramic images, and determining, based on applying the trained model to classify the multiple 360 degree panoramic images, one or more room classifications for the 3D data. One or more story identifications of the one or more stories and one or more room identifications of the one or more rooms are generated. A property layout of the building that includes the one or more story identifications and the one or more room classifications is generated. The property layout is provided for display.
    Type: Application
    Filed: December 27, 2024
    Publication date: July 3, 2025
    Applicant: Matterport, Inc.
    Inventors: Kevin Balkoski, David Alan Gausebeck
  • Patent number: 12348698
    Abstract: This application generally relates to capturing and aligning panoramic image and depth data. In one embodiment, a device is provided that comprises a housing and a plurality of cameras configured to capture two-dimensional images, wherein the cameras are arranged at different positions on the housing and have different azimuth orientations relative to a center point such that the cameras have a collective field-of-view spanning up to 360° horizontally. The device further comprises a plurality of depth detection components configured to capture depth data, wherein the depth detection components are arranged at different positions on the housing and have different azimuth orientations relative to the center point such that the depth detection components have the collective field-of-view spanning up to 360° horizontally.
    Type: Grant
    Filed: April 27, 2023
    Date of Patent: July 1, 2025
    Assignee: Matterport, Inc.
    Inventors: Kyle Simek, David Alan Gausebeck, Matthew Tschudy Bell
  • Patent number: 12346823
    Abstract: An example method comprises applying learning (e.g., weights) developed for training a first model for a first data set of image data to training a second model for a second data set of sensor data. The first and the second data sets may be from the same environment. The second data set has a greater number of channels than the first data set. Weights of layers determined in the first model training may be initially applied to training the second model for the second set of data. Channels of the second data set equal to the number of channels of the first data set may be utilized for each of the layers, using the same weights from the first model. All or some of the channels may be applied in training the second model and using the layers, but determining new weights for the generation of the second trained model.
    Type: Grant
    Filed: October 20, 2022
    Date of Patent: July 1, 2025
    Assignee: Matterport, Inc.
    Inventor: Matthieu Francois Perrinel
  • Publication number: 20250173973
    Abstract: A system comprising: processors and memory containing instructions to control processors to: receive images representing an interior of a physical environment, identify, using neural network for object recognition, an object in an image, the object is associated with a location relative to the physical environment, identify, using neural network for object recognition, another object in another image, determine if objects in the images are located near or at a similar location based on location information associated with the objects, if the objects are located near or at a similar location, then objects are an instance of a single object, store similar location associated with the single object, display an interactive walkthrough visualization of a 3D model of the physical environment including the single object, receive request regarding object location through the interactive walkthrough visualization, and provide the similar location of the single object for display in the interactive walkthrough visualiz
    Type: Application
    Filed: January 23, 2025
    Publication date: May 29, 2025
    Applicant: Matterport, Inc.
    Inventors: Gunnar Hovden, Azwad Sabik
  • Patent number: 12315101
    Abstract: Systems, computer-implemented methods, apparatus and/or computer program products are provided that facilitate improving the accuracy of global positioning system (GPS) coordinates of indoor photos. The disclosed subject matter further provides systems, computer-implemented methods, apparatus and/or computer program products that facilitate generating exterior photos of structures based on GPS coordinates of indoor photos.
    Type: Grant
    Filed: May 5, 2023
    Date of Patent: May 27, 2025
    Assignee: Matterport, Inc.
    Inventors: Gunnar Hovden, Scott Adams
  • Publication number: 20250166304
    Abstract: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.
    Type: Application
    Filed: January 17, 2025
    Publication date: May 22, 2025
    Applicant: Matterport, Inc.
    Inventors: Matthew Tschudy Bell, David Alan Gausebeck, Gregory William Coombe, Daniel Ford
  • Publication number: 20250156028
    Abstract: This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.
    Type: Application
    Filed: August 16, 2024
    Publication date: May 15, 2025
    Applicant: Matterport, Inc.
    Inventors: James Mildrew, Matthew Tschudy Bell, Dustin Michael Cook, Preston Cowley, Lester Lee, Peter McColgan, Daniel Prochazka, Brian Schulman, James Sundra, Alan Tan
  • Publication number: 20250097580
    Abstract: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.
    Type: Application
    Filed: September 25, 2024
    Publication date: March 20, 2025
    Applicant: Matterport, Inc.
    Inventors: Japjit Tulsi, Louis D. Marzano, Abhijit Limaye, David Lippman, David Alan Gausebeck
  • Patent number: 12243168
    Abstract: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.
    Type: Grant
    Filed: July 10, 2023
    Date of Patent: March 4, 2025
    Assignee: Matterport, Inc.
    Inventors: Matthew Tschudy Bell, David Alan Gausebeck, Gregory William Coombe, Daniel Ford
  • Patent number: 12223581
    Abstract: An example method comprises simulating an environment including at least one simulated object, a simulated ray source, and a simulated receiver, simulating a plurality of rays emitting from the simulated ray source, tracking each ray in the environment, detecting changes for at least one ray that interacts with the at least one simulated object, the changes for the at least one ray including a reflection from the at least one object, tracking the reflection of the at least part of the ray from the at least one object in the environment, determining measurements for any of the plurality of rays that interact with the simulated receiver in the simulation, the at least part of the ray being received by the receiver, the measurements including intensity for any of the plurality of rays that interact with the receiver, and generating synthetic point cloud data based on the measurements.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: February 11, 2025
    Assignee: Matterport, Inc.
    Inventors: Kevin Balkoski, Eleanor Crane
  • Patent number: 12211150
    Abstract: A system comprising: processors and memory containing instructions to control processors to: receive images representing an interior of a physical environment, identify, using neural network for object recognition, an object in an image, the object is associated with a location relative to the physical environment, identify, using neural network for object recognition, another object in another image, determine if objects in the images are located near or at a similar location based on location information associated with the objects, if the objects are located near or at a similar location, then objects are an instance of a single object, store similar location associated with the single object, display an interactive walkthrough visualization of a 3D model of the physical environment including the single object, receive request regarding object location through the interactive walkthrough visualization, and provide the similar location of the single object for display in the interactive walkthrough visualiz
    Type: Grant
    Filed: March 10, 2023
    Date of Patent: January 28, 2025
    Assignee: Matterport, Inc.
    Inventors: Gunnar Hovden, Azwad Sabik
  • Patent number: 12192641
    Abstract: An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene.
    Type: Grant
    Filed: March 28, 2024
    Date of Patent: January 7, 2025
    Assignee: Matterport, Inc.
    Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
  • Publication number: 20240420437
    Abstract: An example system may access data of a multidimensional space representing a physical environment and identify interior elements within the multidimensional space using a first machine learning model. The interior element may represent furniture in the physical environment. The system may mask one or more of the interior elements with masks and fill each of the masks with imagery of the physical environment to create an appearance of a defurnished space, the defurnished space having the one or more interior elements appearing as missing from the multidimensional space representing the physical environment. The system may provide all or some of the defurnished space for display.
    Type: Application
    Filed: June 13, 2024
    Publication date: December 19, 2024
    Applicant: Matterport, Inc.
    Inventors: David Alan Gausebeck, Japjit Tulsi, RJ Pittman, David Lippman, Vivek Tanna, Nicole Guernsey, Olaf Brandt
  • Publication number: 20240386687
    Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.
    Type: Application
    Filed: May 20, 2024
    Publication date: November 21, 2024
    Applicant: Matterport, Inc.
    Inventors: Matthew Bell, David Gausebeck, Michael Beebe
  • Patent number: 12140679
    Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
    Type: Grant
    Filed: March 28, 2024
    Date of Patent: November 12, 2024
    Assignee: Matterport, Inc.
    Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
  • Patent number: 12140680
    Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
    Type: Grant
    Filed: March 28, 2024
    Date of Patent: November 12, 2024
    Assignee: Matterport, Inc.
    Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
  • Patent number: 12132994
    Abstract: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.
    Type: Grant
    Filed: December 17, 2021
    Date of Patent: October 29, 2024
    Assignee: Matterport, Inc.
    Inventors: Japjit Tulsi, Louis Marzano, Abhijit Limaye, David Lippman, David Alan Gausebeck
  • Publication number: 20240355103
    Abstract: Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.
    Type: Application
    Filed: June 25, 2024
    Publication date: October 24, 2024
    Applicant: Matterport, Inc.
    Inventors: Gunnar Hovden, Mykhaylo Kurinnyy
  • Publication number: 20240353563
    Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
    Type: Application
    Filed: March 28, 2024
    Publication date: October 24, 2024
    Applicant: Matterport, Inc.
    Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn