Patents by Inventor Ivaylo Boyadzhiev

Ivaylo Boyadzhiev has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240104851
    Abstract: Techniques are described for using computing devices to perform automated operations for using generated building information to further generate and present visual data enhancements on images that are captured by and displayed on a mobile device in the building (e.g., concurrent with capture of the images by a camera of the mobile device, such as in a real-time or near-real-time manner with respect to image capture), such as using descriptive information about a building that is generated from analysis of acquired building images and optionally other building information (e.g., floor plans), and such as to improve navigation of the building (e.g., for autonomous vehicles) and provide other functionality as the mobile device moves through the building. The descriptive building information may include structural elements and other objects identified in the building and other determined attributes of the building, and automatically generated textual descriptions of the objects and other attributes.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 28, 2024
    Inventors: Manjunath Narayana, Eric M. Penner, Ivaylo Boyadzhiev, Sing Bing Kang
  • Patent number: 11935196
    Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
    Type: Grant
    Filed: June 10, 2023
    Date of Patent: March 19, 2024
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Ivaylo Boyadzhiev, Romualdo Impas
  • Publication number: 20240029352
    Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of an automated generation process of a floor plan or other mapping information for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding graphical user interface. The automated analysis and assessment of the building images may, for example, include incrementally generating partial versions of the mapping information, determining acquisition instructions related to further acquisition of additional images and/or other types of data (e.g.
    Type: Application
    Filed: July 25, 2022
    Publication date: January 25, 2024
    Inventors: Zhiqiang Wan, Will A. Hutchcroft, Manjunath Narayana, Ivaylo Boyadzhiev, Yuguang Li
  • Publication number: 20230409766
    Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of an automated generation process of a floor plan or other mapping information for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding graphical user interface. The analysis and assessment of the building images may, for example, include performing an automated assessment of one or more characteristics of the mapping information generation process (e.g., a predicted amount of time for completion) and to provide automated instructions (e.g., to adjust image acquisition device settings) or other feedback to improve the generation process (e.g., reduce that predicted time).
    Type: Application
    Filed: June 16, 2022
    Publication date: December 21, 2023
    Inventors: Manjunath Narayana, Christopher Buehler, Ivaylo Boyadzhiev
  • Patent number: 11842464
    Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information of a defined area via analysis of visual data of images, including by using attribute information exchanged between paired or otherwise grouped images of multiple types to generate enhanced images, and for using the generated mapping information in further automated manners, including to use the generated mapping information for automated navigation and/or to display or otherwise present the generated mapping information. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least one or more enhanced images and/or a partial floor plan and/or other modeled representation of the building, with the generating performed in some cases without having measured depth information about distances from the images' acquisition locations to walls or other objects in the surrounding building.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: December 12, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev
  • Patent number: 11823325
    Abstract: Techniques are described for using computing devices to perform automated operations related to, with respect to a computer model of a house or other building's interior, generating and displaying simulated lighting information in the model based on sunlight or other external light that is estimated to enter the building and be visible in particular rooms of the interior under specified conditions, such as using ambient occlusion and light transport matrix calculations. The computer model may be a 3D (three-dimensional) or 2.5D representation that is generated after the house is built and that shows physical components of the actual house's interior (e.g., walls), and may be displayed to a user of a client computing device in a displayed GUI (graphical user interface) via which the user specifies conditions for which the simulated lighting display is generated.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: November 21, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Joshuah Vincent, Pierre Moulon, Ivaylo Boyadzhiev, Joshua David Maruska
  • Patent number: 11797159
    Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of generating a floor plan for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding GUI (graphical user interface). In some cases, the MIGM system interacts with an MIGM system operator user, such as by displaying a GUI showing information related to the images and/or a floor plan being generated, and by receiving and using input submitted by the user via the GUI to assist with the generating of the floor plan, such as to specify interconnections between particular rooms via particular inter-room wall openings of the rooms.
    Type: Grant
    Filed: January 20, 2023
    Date of Patent: October 24, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Pierre Moulon, Lambert E. Wixson, Christopher Buehler, Ivaylo Boyadzhiev
  • Patent number: 11783385
    Abstract: A valuation system to identify interior features of a property, identify exterior features related to interior features using aerial images, and to generate property valuations based on the identified features is provided. The valuation system identifies, using a computer vision module, interior features based on interior image data (e.g., photos) of a property, and further identifies exterior features associated with any of the interior features based on an aerial photo of the property. For example, trees and buildings (e.g., exterior features) adjacent to a window (e.g., an interior feature) can be identified by a computer vision module through the combination of interior and exterior image data. In other words, the identification of property features by the computer vision module can be enriched by correlating interior image data (e.g., photos, video walkthroughs) to exterior image data (e.g., satellite photos, aerial photos).
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: October 10, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev, Pierre Moulon, Yujie Li
  • Publication number: 20230316660
    Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
    Type: Application
    Filed: June 10, 2023
    Publication date: October 5, 2023
    Inventors: Yuguang Li, Ivaylo Boyadzhiev, Romualdo Impas
  • Publication number: 20230206393
    Abstract: Techniques are described for automated operations to analyze visual data from images acquired in multiple rooms of a building to generate multiple types of building information (e.g., to include a floor plan for the building), such as by using a trained neural network to jointly generate the multiple types of building information by combining visual data from pairs of the images, and for subsequently using the generated building information in one or more further automated manners, with the building information generation further performed in some cases without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room. The automated operations may include generating some types of building information with respect to each image pixel column, and other types of building information by combining data from both images of a pair.
    Type: Application
    Filed: December 28, 2021
    Publication date: June 29, 2023
    Inventors: Will Adrian Hutchcroft, Yuguang Li, Zhiqiang Wan, Ivaylo Boyadzhiev
  • Publication number: 20230196684
    Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building’s interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house’s interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
    Type: Application
    Filed: February 21, 2023
    Publication date: June 22, 2023
    Inventors: Yuguang Li, Ivaylo Boyadzhiev, Romualdo Impas, Michael P. Caputo, Gregory J. Doerr, Joshua Weisberg
  • Patent number: 11676344
    Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: June 13, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Ivaylo Boyadzhiev, Romualdo Impas
  • Patent number: 11645781
    Abstract: Techniques are described for computing devices to perform automated operations to determine the acquisition locations of images, such as within a building interior based on automatically determined shapes of rooms of the building, and for using the determined image acquisition location information in further automated manners. The image may be a panorama image or of another type (e.g., a rectilinear perspective image) and acquired at an acquisition location in a multi-room building's interior, and the determined acquisition location for such an image may be at least a location on the building's floor plan and optionally an orientation/direction for at least a part of the image—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.
    Type: Grant
    Filed: October 7, 2022
    Date of Patent: May 9, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Will A. Hutchcroft, Naji Khosravan, Ivaylo Boyadzhiev
  • Publication number: 20230138762
    Abstract: Techniques are described for automated operations to analyze visual data from panorama images captured in multiple rooms of a building and having little-to-no visual overlap in order to generate a floor plan for the building, and subsequently using the generated floor plan in one or more further automated manners, with the floor plan generation further performed in some cases without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room. The automated operations may include identifying and aligning pairs of target images acquired at acquisition locations proximate to each other, refining the alignment of inter-image directions and acquisition locations into a global alignment using a common coordinate system, and then using information identified from the images' visual data that includes structural room layouts to generate the floor plan of the building.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 4, 2023
    Inventors: John W. Lambert, Yuguang Li, Ivaylo Boyadzhiev, Lambert E. Wixson
  • Publication number: 20230125295
    Abstract: Techniques are described for using computing devices to perform automated operations for determining the acquisition location of an image using an analysis of the image's visual contents. In at least some situations, images to be analyzed include panorama images acquired at acquisition locations in an interior of a multi-room building, and the determined acquisition location information includes a location on a floor plan of the building and in some cases orientation direction information—in at least some such situations, the acquisition location determination is performed without having or using information from any distance-measuring devices about distances from an image's acquisition location to objects in the surrounding building. The acquisition location information may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on one or more client devices in corresponding graphical user interfaces, etc.
    Type: Application
    Filed: August 27, 2022
    Publication date: April 27, 2023
    Inventors: Zhixiang Min, Naji Khosravan, Manjunath Narayana, Zachary S. Bessinger, Sing Bing Kang, Ivaylo Boyadzhiev
  • Patent number: 11632516
    Abstract: Techniques are described for automated operations involving capturing and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture visual data from multiple viewing locations (e.g., video captured while the mobile device is rotated for some or all of a full 360 degree rotation at each viewing location) within multiple rooms, capturing data linking the multiple viewing locations, analyzing each viewing location's visual data to create a panorama image from that viewing location, analyzing the linking data to determine relative positions/directions between at least some viewing locations, creating inter-panorama links in the panoramas to each of one or more other panoramas based on such determined positions/directions, and providing information to display multiple linked panorama images to represent the interior.
    Type: Grant
    Filed: July 5, 2021
    Date of Patent: April 18, 2023
    Assignee: MFIB Holdco, Inc.
    Inventors: Ivaylo Boyadzhiev, Alex Colburn, Li Guan, Qi Shan
  • Publication number: 20230095173
    Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information of a defined area via analysis of visual data of images, including by using attribute information exchanged between paired or otherwise grouped images of multiple types to generate enhanced images, and for using the generated mapping information in further automated manners, including to use the generated mapping information for automated navigation and/or to display or otherwise present the generated mapping information. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least one or more enhanced images and/or a partial floor plan and/or other modeled representation of the building, with the generating performed in some cases without having measured depth information about distances from the images acquisition locations to walls or other objects in the surrounding building.
    Type: Application
    Filed: September 22, 2021
    Publication date: March 30, 2023
    Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev
  • Publication number: 20230071446
    Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information via analysis of visual data of photos of a defined area, and for using the generated mapping information in further automated manners, including to display the generated mapping information via various types of visualizations corresponding graphical user interfaces. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least a partial floor plan and/or other modeled representation of the building—in addition, the generating may be further performed without having measured depth information about distances from the photos' acquisition locations to walls or other objects in the surrounding building. The generated floor plan and/or other mapping-related information may be further used in various manners, including for controlling navigation of devices (e.g., autonomous vehicles), etc.
    Type: Application
    Filed: August 27, 2021
    Publication date: March 9, 2023
    Inventors: Manjunath Narayana, Ivaylo Boyadzhiev
  • Patent number: 11592969
    Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of generating a floor plan for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding GUI (graphical user interface). In some cases, the MIGM system interacts with an MIGM system operator user, such as by displaying a GUI showing information related to the images and/or a floor plan being generated, and by receiving and using input submitted by the user via the GUI to assist with the generating of the floor plan, such as to specify interconnections between particular rooms via particular inter-room wall openings of the rooms.
    Type: Grant
    Filed: October 13, 2020
    Date of Patent: February 28, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Pierre Moulon, Lambert E. Wixson, Christopher Buehler, Ivaylo Boyadzhiev
  • Publication number: 20230032888
    Abstract: Techniques are described for computing devices to perform automated operations to determine the acquisition locations of images, such as within a building interior based on automatically determined shapes of rooms of the building, and for using the determined image acquisition location information in further automated manners. The image may be a panorama image or of another type (e.g., a rectilinear perspective image) and acquired at an acquisition location in a multi-room building's interior, and the determined acquisition location for such an image may be at least a location on the building's floor plan and optionally an orientation/direction for at least a part of the image—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.
    Type: Application
    Filed: October 7, 2022
    Publication date: February 2, 2023
    Inventors: Yuguang Li, Will A. Hutchcroft, Naji Khosravan, Ivaylo Boyadzhiev