Patents Assigned to Matterport, Inc.
-
Publication number: 20250097580Abstract: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.Type: ApplicationFiled: September 25, 2024Publication date: March 20, 2025Applicant: Matterport, Inc.Inventors: Japjit Tulsi, Louis D. Marzano, Abhijit Limaye, David Lippman, David Alan Gausebeck
-
Patent number: 12243168Abstract: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.Type: GrantFiled: July 10, 2023Date of Patent: March 4, 2025Assignee: Matterport, Inc.Inventors: Matthew Tschudy Bell, David Alan Gausebeck, Gregory William Coombe, Daniel Ford
-
Patent number: 12223581Abstract: An example method comprises simulating an environment including at least one simulated object, a simulated ray source, and a simulated receiver, simulating a plurality of rays emitting from the simulated ray source, tracking each ray in the environment, detecting changes for at least one ray that interacts with the at least one simulated object, the changes for the at least one ray including a reflection from the at least one object, tracking the reflection of the at least part of the ray from the at least one object in the environment, determining measurements for any of the plurality of rays that interact with the simulated receiver in the simulation, the at least part of the ray being received by the receiver, the measurements including intensity for any of the plurality of rays that interact with the receiver, and generating synthetic point cloud data based on the measurements.Type: GrantFiled: September 28, 2022Date of Patent: February 11, 2025Assignee: Matterport, Inc.Inventors: Kevin Balkoski, Eleanor Crane
-
Patent number: 12211150Abstract: A system comprising: processors and memory containing instructions to control processors to: receive images representing an interior of a physical environment, identify, using neural network for object recognition, an object in an image, the object is associated with a location relative to the physical environment, identify, using neural network for object recognition, another object in another image, determine if objects in the images are located near or at a similar location based on location information associated with the objects, if the objects are located near or at a similar location, then objects are an instance of a single object, store similar location associated with the single object, display an interactive walkthrough visualization of a 3D model of the physical environment including the single object, receive request regarding object location through the interactive walkthrough visualization, and provide the similar location of the single object for display in the interactive walkthrough visualizType: GrantFiled: March 10, 2023Date of Patent: January 28, 2025Assignee: Matterport, Inc.Inventors: Gunnar Hovden, Azwad Sabik
-
Patent number: 12192641Abstract: An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene.Type: GrantFiled: March 28, 2024Date of Patent: January 7, 2025Assignee: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Publication number: 20240420437Abstract: An example system may access data of a multidimensional space representing a physical environment and identify interior elements within the multidimensional space using a first machine learning model. The interior element may represent furniture in the physical environment. The system may mask one or more of the interior elements with masks and fill each of the masks with imagery of the physical environment to create an appearance of a defurnished space, the defurnished space having the one or more interior elements appearing as missing from the multidimensional space representing the physical environment. The system may provide all or some of the defurnished space for display.Type: ApplicationFiled: June 13, 2024Publication date: December 19, 2024Applicant: Matterport, Inc.Inventors: David Alan Gausebeck, Japjit Tulsi, RJ Pittman, David Lippman, Vivek Tanna, Nicole Guernsey, Olaf Brandt
-
Publication number: 20240386687Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.Type: ApplicationFiled: May 20, 2024Publication date: November 21, 2024Applicant: Matterport, Inc.Inventors: Matthew Bell, David Gausebeck, Michael Beebe
-
Patent number: 12140679Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.Type: GrantFiled: March 28, 2024Date of Patent: November 12, 2024Assignee: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Patent number: 12140680Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.Type: GrantFiled: March 28, 2024Date of Patent: November 12, 2024Assignee: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Patent number: 12132994Abstract: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.Type: GrantFiled: December 17, 2021Date of Patent: October 29, 2024Assignee: Matterport, Inc.Inventors: Japjit Tulsi, Louis Marzano, Abhijit Limaye, David Lippman, David Alan Gausebeck
-
Publication number: 20240353563Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.Type: ApplicationFiled: March 28, 2024Publication date: October 24, 2024Applicant: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Publication number: 20240355103Abstract: Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.Type: ApplicationFiled: June 25, 2024Publication date: October 24, 2024Applicant: Matterport, Inc.Inventors: Gunnar Hovden, Mykhaylo Kurinnyy
-
Publication number: 20240346793Abstract: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises receiving, by a system comprising a processor, a panoramic image, and employing, by the system, a three-dimensional data from two-dimensional data (3D-from-2D) convolutional neural network model to derive three-dimensional data from the panoramic image, wherein the 3D-from-2D convolutional neural network model employs convolutional layers that wrap around the panoramic image as projected on a two-dimensional plane to facilitate deriving the three-dimensional data.Type: ApplicationFiled: June 26, 2024Publication date: October 17, 2024Applicant: Matterport, Inc.Inventor: David Alan Gausebeck
-
Patent number: 12086376Abstract: This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.Type: GrantFiled: August 16, 2022Date of Patent: September 10, 2024Assignee: Matterport, Inc.Inventors: James Mildrew, Matthew Tschudy Bell, Dustin Michael Cook, Preston Cowley, Lester Lee, Peter McColgan, Daniel Prochazka, Brian Schulman, James Sundra, Alan Tan
-
Patent number: 12073609Abstract: Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.Type: GrantFiled: April 18, 2023Date of Patent: August 27, 2024Assignee: Matterport, Inc.Inventors: Gunnar Hovden, Mykhaylo Kurinnyy
-
Patent number: 12056837Abstract: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises receiving, by a system comprising a processor, a panoramic image, and employing, by the system, a three-dimensional data from two-dimensional data (3D-from-2D) convolutional neural network model to derive three-dimensional data from the panoramic image, wherein the 3D-from-2D convolutional neural network model employs convolutional layers that wrap around the panoramic image as projected on a two-dimensional plane to facilitate deriving the three-dimensional data.Type: GrantFiled: March 15, 2022Date of Patent: August 6, 2024Assignee: Matterport, Inc.Inventor: David Alan Gausebeck
-
Publication number: 20240244330Abstract: An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene.Type: ApplicationFiled: March 28, 2024Publication date: July 18, 2024Applicant: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Publication number: 20240241262Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.Type: ApplicationFiled: March 28, 2024Publication date: July 18, 2024Applicant: Matterport, Inc.Inventors: David Alan Gausebeck, Kirk Stromberg, Louis D. Marzano, David Proctor, Naoto Sakakibara, Simeon Trieu, Kevin Kane, Simon Wynn
-
Patent number: 12014468Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.Type: GrantFiled: February 2, 2021Date of Patent: June 18, 2024Assignee: Matterport, Inc.Inventors: Matthew Bell, David Gausebeck, Michael Beebe
-
Publication number: 20240193867Abstract: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.Type: ApplicationFiled: July 10, 2023Publication date: June 13, 2024Applicant: Matterport, Inc.Inventors: Matthew Tschudy Bell, David Alan Gausebeck, Gregory William Coombe, Daniel Ford