Patents Assigned to Fyusion, Inc.
  • Publication number: 20250103829
    Abstract: A tag characterizing a portion of a multi-view interactive digital media representation (MVIDMR) may be determined by applying a grammar to natural language data. The MVIDMR may include images of an object and may be navigable in one or more dimensions. An object model location for the tag identifying a location within a three-dimensional object model may be determined by applying the grammar to the natural language data. The tag may then be applied to the MVIDMR by associating it with two or more of the images at positions determined based on the object model location.
    Type: Application
    Filed: December 6, 2024
    Publication date: March 27, 2025
    Applicant: Fyusion, Inc.
    Inventors: Abhishek Kar, Martin Markus Hubert Wawro, Stefan Johannes Josef Holzer, Radu Bogdan Rusu
  • Patent number: 12261990
    Abstract: Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.
    Type: Grant
    Filed: March 14, 2023
    Date of Patent: March 25, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Dave Morrison, Radu Bogdan Rusu, George Haber, Keith Martin
  • Publication number: 20250093281
    Abstract: Images of an object may be captured at a computing device. Each of the images may be captured from a respective viewpoint based on image capture configuration information identifying one or more parameter values. A multiview image digital media representation of the object may be generated that includes some or all of the images of the object and that is navigable in one or more dimensions.
    Type: Application
    Filed: November 25, 2024
    Publication date: March 20, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Santiago Arano Perez, Abhishek Kar, Matteo Munaro, Pavel Hanchar, Radu Bogdan Rusu, Martin Markus Hubert Wawro, Ashley Wakefield, Rodrigo Ortiz Cayon, Josh Faust, Jai Chaudhry, Nico Gregor Sebastian Blodow, Mike Penz
  • Publication number: 20250095132
    Abstract: Damage to an object such as a vehicle may be detected and presented based at least in part on image data. In some configurations, image data may be detected by causing the object to pass through a gate or portal on which cameras are located. Alternatively, or additionally, image data may be selected by a user operating a camera and moving around the object. The cameras may capture image data, which may be combined and analyzed to detect damage. Some or all of the image data and/or analysis of the image data may be presented in a viewer, which may allow a user to perform actions such as navigating around the object in a virtual environment, identifying and viewing areas of the object where damage has been detected, and accessing the results of the analysis.
    Type: Application
    Filed: December 3, 2024
    Publication date: March 20, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matteo Munaro, Krunal Ketan Chande, Julius Santiago, Pantelis Kalogiros, Raul Dronca, Ioannis Spanos, Pavel Hanchar, Aidas Liaudanskas, Santi Arano, Rodrigo Ortiz-Cayon
  • Publication number: 20250087244
    Abstract: According to particular embodiments, one process includes retrieving a multi-view interactive digital media representation that includes numerous images fused together into content and context models. The process next includes retrieving and processing audio data to be integrated into the multi-view interactive digital media representation. A first segment of audio data may be associated with a first position in the multi-view interactive digital media representation. In other examples, a first segment of audio data may be associated with a visual position or the location of a camera in the multi-view interactive digital media representation. The audio data may be played in coordination with the multi-view interactive digital media representation based on a user's navigation through the multi-view interactive digital media representation, where the first segment is played when the first position or first visual position is reached.
    Type: Application
    Filed: November 21, 2024
    Publication date: March 13, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Vladimir Roumenov Glavtchev, Alexander Jay Bruen Trevor
  • Publication number: 20250078203
    Abstract: Images of an undercarriage of a vehicle may be captured via one or more cameras. A point cloud may be determined based on the images. The point cloud may includes points positioned in a virtual three-dimensional space. A stitched image may be determined based on the point cloud by projecting the point cloud onto a virtual camera view.
    Type: Application
    Filed: November 20, 2024
    Publication date: March 6, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Krunal Ketan Chande, Matteo Munaro, Pavel Hanchar, Aidas Liaudanskas, Wook Yeon Hwang, Johan Nordin, Milos Vlaski, Martin Markus Hubert Wawro, Nick Stetco, Martin Saelzle
  • Publication number: 20250078391
    Abstract: Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.
    Type: Application
    Filed: November 20, 2024
    Publication date: March 6, 2025
    Applicant: Fyusion, Inc.
    Inventors: Nico Gregor Sebastian Blodow, Martin Saelzle, Matteo Munaro, Krunal Ketan Chande, Rodrigo Ortiz Cayon, Stefan Johannes Josef Holzer
  • Publication number: 20250078403
    Abstract: A plurality of images of an object and a background may be captured. Three-dimensional representations of the background and the object may be generated based on the captured images. A synthetic image of the object and the background may be rendered. The synthetic image may depict a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images. A corrected synthetic image may be generated. The corrected synthetic image may be stored on a storage medium.
    Type: Application
    Filed: September 6, 2023
    Publication date: March 6, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Rodrigo Ortiz-Cayon, Tanvir Parhar, Matteo Munaro, Martin Saelzle
  • Patent number: 12244784
    Abstract: Inventory at a remote location may be verified by transmitting a security key associated with uniquely identifying object identification information from a verification server to a client machine at the remote location. The security key may then be used to generate a multi-view interactive digital media representation (MVIDMR) of the object that includes a plurality of images captured from different viewpoints. The MVIDMR may then be transmitted to the verification server.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: March 4, 2025
    Assignee: Fyusion, Inc.
    Inventors: Keith George Martin, Dave Morrison, Stefan Johannes Josef Holzer, Radu Bogdan Rusu
  • Patent number: 12243170
    Abstract: A live camera feed may be analyzed to determine the identify of an object, and augmented reality overlay data may be determined based on that identity. The overlay data may include one or more tags that are each associated with a respective location on the object. The live camera feed may be presented on a display screen with the tags being positioned as the respective location.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: March 4, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matteo Munaro, Alexander Jay Bruen Trevor, Aidas Liaudanskas, Radu Bogdan Rusu
  • Publication number: 20250037489
    Abstract: A plurality of images of an object may be processed. The plurality of images may comprise a first image having an annotation. The plurality of images may further comprise second images. The annotation may be absent from the second images. A placement of the annotation for the second images such that the annotation is configured to be included in the second images may be automatically determined. The second images may be caused to include the annotation in accordance with the determined placement. The annotated second images may be stored on a storage device.
    Type: Application
    Filed: July 25, 2023
    Publication date: January 30, 2025
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Tanvir Parhar, Matteo Munaro, Martin Saelzle
  • Patent number: 12211272
    Abstract: Images of an object may be captured via a camera at a mobile computing device at different viewpoints. The images may be used to identify components of the object and to identify damage estimates estimating damage to some or all of the components. Capture coverage levels corresponding with the components may be determined, and then recording guidance may be provided for capturing additional images to increase the capture coverage levels.
    Type: Grant
    Filed: November 16, 2023
    Date of Patent: January 28, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matteo Munaro, Pavel Hanchar, Rodrigo Ortiz-Cayon, Aidas Liaudanskas
  • Patent number: 12204869
    Abstract: A tag characterizing a portion of a multi-view interactive digital media representation (MVIDMR) may be determined by applying a grammar to natural language data. The MVIDMR may include images of an object and may be navigable in one or more dimensions. An object model location for the tag identifying a location within a three-dimensional object model may be determined by applying the grammar to the natural language data. The tag may then be applied to the MVIDMR by associating it with two or more of the images at positions determined based on the object model location.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: January 21, 2025
    Assignee: Fyusion, Inc.
    Inventors: Abhishek Kar, Martin Markus Hubert Wawro, Stefan Johannes Josef Holzer, Radu Bogdan Rusu
  • Patent number: 12203872
    Abstract: Images of an object may be captured at a computing device. Each of the images may be captured from a respective viewpoint based on image capture configuration information identifying one or more parameter values. A multiview image digital media representation of the object may be generated that includes some or all of the images of the object and that is navigable in one or more dimensions.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: January 21, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Santiago Arano Perez, Abhishek Kar, Matteo Munaro, Pavel Hanchar, Radu Bogdan Rusu, Martin Markus Hubert Wawro, Ashley Wakefield, Rodrigo Ortiz-Cayon, Josh Faust, Jai Chaudhry, Nico Gregor Sebastian Blodow, Mike Penz
  • Patent number: 12205266
    Abstract: Damage to an object such as a vehicle may be detected and presented based at least in part on image data. In some configurations, image data may be detected by causing the object to pass through a gate or portal on which cameras are located. Alternatively, or additionally, image data may be selected by a user operating a camera and moving around the object. The cameras may capture image data, which may be combined and analyzed to detect damage. Some or all of the image data and/or analysis of the image data may be presented in a viewer, which may allow a user to perform actions such as navigating around the object in a virtual environment, identifying and viewing areas of the object where damage has been detected, and accessing the results of the analysis.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: January 21, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matteo Munaro, Krunal Ketan Chande, Julius Santiago, Pantelis Kalogiros, Raul Dronca, Ioannis Spanos, Pavel Hanchar, Aidas Liaudanskas, Santi Arano, Rodrigo Ortiz-Cayon
  • Patent number: 12190916
    Abstract: According to particular embodiments, one process includes retrieving a multi-view interactive digital media representation that includes numerous images fused together into content and context models. The process next includes retrieving and processing audio data to be integrated into the multi-view interactive digital media representation. A first segment of audio data may be associated with a first position in the multi-view interactive digital media representation. In other examples, a first segment of audio data may be associated with a visual position or the location of a camera in the multi-view interactive digital media representation. The audio data may be played in coordination with the multi-view interactive digital media representation based on a user's navigation through the multi-view interactive digital media representation, where the first segment is played when the first position or first visual position is reached.
    Type: Grant
    Filed: August 29, 2023
    Date of Patent: January 7, 2025
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Vladimir Roumenov Glavtchev, Alexander Jay Bruen Trevor
  • Patent number: 12182964
    Abstract: Images of an undercarriage of a vehicle may be captured via one or more cameras. A point cloud may be determined based on the images. The point cloud may includes points positioned in a virtual three-dimensional space. A stitched image may be determined based on the point cloud by projecting the point cloud onto a virtual camera view. The stitched image may be stored on a storage device.
    Type: Grant
    Filed: December 6, 2023
    Date of Patent: December 31, 2024
    Assignee: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Krunal Ketan Chande, Matteo Munaro, Pavel Hanchar, Aidas Liaudanskas, Wook Yeon Hwang, Johan Nordin, Milos Vlaski, Martin Markus Hubert Wawro, Nick Stetco, Martin Saelzle
  • Patent number: 12182930
    Abstract: Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.
    Type: Grant
    Filed: February 23, 2023
    Date of Patent: December 31, 2024
    Assignee: Fyusion, Inc.
    Inventors: Nico Gregor Sebastian Blodow, Martin Saelzle, Matteo Munaro, Krunal Ketan Chande, Rodrigo Ortiz Cayon, Stefan Johannes Josef Holzer
  • Publication number: 20240412411
    Abstract: The pose of an object may be estimated based on fiducial points identified in a visual representation of the object. Each fiducial point may correspond with a component of the object, and may be associated with a first location in an image of the object and a second location in a 3D coordinate pace. A 3D skeleton of the object may be determined by connecting the locations in the 3D space, and the object's pose may be determined based on the 3D skeleton.
    Type: Application
    Filed: August 22, 2024
    Publication date: December 12, 2024
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef HOLZER, Pavel HANCHAR, Abhishek KAR, Matteo MUNARO, Krunal Ketan CHANDE, Radu Bogdan RUSU
  • Publication number: 20240386585
    Abstract: Mappings are determined between viewpoints of an object and an object model representing the object. Each mapping identifies a location on the object model corresponding with a portion of the object captured in one of the viewpoints. Defect identifiers for the object model are created based on the mappings, where each defect identifier links one of the viewpoints to one of the locations on the object model. A user interface that includes the object model and the defect identifiers is provided for presentation on a display screen in a user interface. One of the viewpoints is presented in the user interface when the corresponding defect identifier is selected in the object model.
    Type: Application
    Filed: July 22, 2024
    Publication date: November 21, 2024
    Applicant: Fyusion, Inc.
    Inventors: Stefan Johannes Josef Holzer, Matteo Munaro, Radu Bogdan Rusu