Patents by Inventor Sing Bing Kang
Sing Bing Kang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240104851Abstract: Techniques are described for using computing devices to perform automated operations for using generated building information to further generate and present visual data enhancements on images that are captured by and displayed on a mobile device in the building (e.g., concurrent with capture of the images by a camera of the mobile device, such as in a real-time or near-real-time manner with respect to image capture), such as using descriptive information about a building that is generated from analysis of acquired building images and optionally other building information (e.g., floor plans), and such as to improve navigation of the building (e.g., for autonomous vehicles) and provide other functionality as the mobile device moves through the building. The descriptive building information may include structural elements and other objects identified in the building and other determined attributes of the building, and automatically generated textual descriptions of the objects and other attributes.Type: ApplicationFiled: September 22, 2022Publication date: March 28, 2024Inventors: Manjunath Narayana, Eric M. Penner, Ivaylo Boyadzhiev, Sing Bing Kang
-
Publication number: 20240096097Abstract: Techniques are described for using computing devices to perform automated operations for automatically generating information about attributes of buildings from automated analysis of building information that includes floor plans and acquired building images and to subsequently using the generated building information in one or more further automated manners. In some situations, such automated generation of building information includes automatically determining objects in a building and other attributes of the building, and automatically generating descriptions about the determined building attributes. Information about such determined attributes and generated descriptions may be used in various automated manners, including for updating and/or validating information in existing building descriptions, for determining matching buildings that have similarities to indicated building descriptions or other specified criteria, for controlling device navigation (e.g.Type: ApplicationFiled: August 27, 2022Publication date: March 21, 2024Inventors: Eric M. Penner, Naji Khosravan, Sing Bing Kang, Lichen Wang, Zachary S. Bessinger
-
Publication number: 20230419662Abstract: Techniques are described for automated operations related to analyzing visual data from images captured in rooms of a building and optionally additional captured data about the rooms to assess room layout and other usability information for the building's rooms and optionally for the overall building, and to subsequently using the assessed usability information in one or more further automated manners, such as to improve navigation of the building. The automated operations may include identifying one or more objects in each of the rooms to assess, evaluating one or more target attributes of each object, assessing usability of each object using its target attributes' evaluations and each room using its objects' assessment and other room information with respect to an indicated purpose, and combining the assessments of multiple rooms in a building and other building information to assess usability of the building with respect to its indicated purpose.Type: ApplicationFiled: September 11, 2023Publication date: December 28, 2023Inventors: Viktoriya Stoeva, Sing Bing Kang, Naji Khosravan, Lambert E. Wixson
-
Patent number: 11842464Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information of a defined area via analysis of visual data of images, including by using attribute information exchanged between paired or otherwise grouped images of multiple types to generate enhanced images, and for using the generated mapping information in further automated manners, including to use the generated mapping information for automated navigation and/or to display or otherwise present the generated mapping information. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least one or more enhanced images and/or a partial floor plan and/or other modeled representation of the building, with the generating performed in some cases without having measured depth information about distances from the images' acquisition locations to walls or other objects in the surrounding building.Type: GrantFiled: September 22, 2021Date of Patent: December 12, 2023Assignee: MFTB Holdco, Inc.Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev
-
Patent number: 11830135Abstract: Techniques are described for using computing devices to perform automated operations for determining matching buildings and using corresponding information in further automated manners, such as by determining buildings having similarities to other indicated buildings based at least in part on building floor plans and/or other attributes, and by automatically generating descriptions of the similarities. In some situations, such matching building determinations are based on generating and using adjacency graphs for floor plans that represent inter-connections between rooms and other attributes of the buildings, and further generating and comparing vector-based embeddings that concisely represent the information of the adjacency graphs for use in performing inter-building comparisons and generating the descriptions. Information about such determined buildings may be used in various automated manners, including for controlling device navigation (e.g.Type: GrantFiled: July 13, 2022Date of Patent: November 28, 2023Assignee: MFTB Holdco, Inc.Inventors: Naji Khosravan, Lichen Wang, Sing Bing Kang
-
Publication number: 20230332886Abstract: Aspects of the subject disclosure are directed towards safely projecting a diffracted light pattern, such as in an infrared laser-based projection/illumination system. Non-diffracted (zero-order) light is refracted once to diffuse (defocus) the non-diffracted light to an eye safe level. Diffracted (non-zero-order) light is aberrated twice, e.g., once as part of diffraction by a diffracting optical element encoded with a Fresnel lens (which does not aberrate the non-diffracted light), and another time to cancel out the other aberration; the two aberrations may occur in either order. Various alternatives include upstream and downstream positioning of the diffracting optical element relative to a refractive optical element, and/or refraction via positive and negative lenses.Type: ApplicationFiled: March 20, 2023Publication date: October 19, 2023Inventors: Andreas GEORGIOU, Joel Steven KOLLIN, Sing Bing KANG
-
Patent number: 11790648Abstract: Techniques are described for automated operations related to analyzing visual data from images captured in rooms of a building and optionally additional captured data about the rooms to assess room layout and other usability information for the building's rooms and optionally for the overall building, and to subsequently using the assessed usability information in one or more further automated manners, such as to improve navigation of the building. The automated operations may include identifying one or more objects in each of the rooms to assess, evaluating one or more target attributes of each object, assessing usability of each object using its target attributes' evaluations and each room using its objects' assessment and other room information with respect to an indicated purpose, and combining the assessments of multiple rooms in a building and other building information to assess usability of the building with respect to its indicated purpose.Type: GrantFiled: February 25, 2021Date of Patent: October 17, 2023Assignee: MFTB Holdco, Inc.Inventors: Viktoriya Stoeva, Sing Bing Kang, Naji Khosravan, Lambert E. Wixson
-
Patent number: 11783385Abstract: A valuation system to identify interior features of a property, identify exterior features related to interior features using aerial images, and to generate property valuations based on the identified features is provided. The valuation system identifies, using a computer vision module, interior features based on interior image data (e.g., photos) of a property, and further identifies exterior features associated with any of the interior features based on an aerial photo of the property. For example, trees and buildings (e.g., exterior features) adjacent to a window (e.g., an interior feature) can be identified by a computer vision module through the combination of interior and exterior image data. In other words, the identification of property features by the computer vision module can be enriched by correlating interior image data (e.g., photos, video walkthroughs) to exterior image data (e.g., satellite photos, aerial photos).Type: GrantFiled: November 18, 2020Date of Patent: October 10, 2023Assignee: MFTB Holdco, Inc.Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev, Pierre Moulon, Yujie Li
-
Publication number: 20230125295Abstract: Techniques are described for using computing devices to perform automated operations for determining the acquisition location of an image using an analysis of the image's visual contents. In at least some situations, images to be analyzed include panorama images acquired at acquisition locations in an interior of a multi-room building, and the determined acquisition location information includes a location on a floor plan of the building and in some cases orientation direction information—in at least some such situations, the acquisition location determination is performed without having or using information from any distance-measuring devices about distances from an image's acquisition location to objects in the surrounding building. The acquisition location information may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on one or more client devices in corresponding graphical user interfaces, etc.Type: ApplicationFiled: August 27, 2022Publication date: April 27, 2023Inventors: Zhixiang Min, Naji Khosravan, Manjunath Narayana, Zachary S. Bessinger, Sing Bing Kang, Ivaylo Boyadzhiev
-
Patent number: 11632602Abstract: Techniques are described for using multiple devices to automatically determine the acquisition location of an image from a camera device, such as within a building interior and by using data from the multiple devices (e.g., visual data from the camera device's image, and additional data captured by a separate mobile computing device in the same area as the camera device), and for subsequently using determined image acquisition location information in one or more further automated manners. The image may be a panorama image or of another type, and the determined acquisition location for such an image may be at least a location on the building's floor plan—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.Type: GrantFiled: January 11, 2022Date of Patent: April 18, 2023Assignee: MFIB Holdco, Inc.Inventors: Sean P. Cier, Sing Bing Kang, Mitchell David Dawson, Pierre Moulon
-
Publication number: 20230095173Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information of a defined area via analysis of visual data of images, including by using attribute information exchanged between paired or otherwise grouped images of multiple types to generate enhanced images, and for using the generated mapping information in further automated manners, including to use the generated mapping information for automated navigation and/or to display or otherwise present the generated mapping information. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least one or more enhanced images and/or a partial floor plan and/or other modeled representation of the building, with the generating performed in some cases without having measured depth information about distances from the images acquisition locations to walls or other objects in the surrounding building.Type: ApplicationFiled: September 22, 2021Publication date: March 30, 2023Inventors: Naji Khosravan, Sing Bing Kang, Ivaylo Boyadzhiev
-
Publication number: 20220269888Abstract: Techniques are described for automated operations related to analyzing visual data from images captured in rooms of a building and optionally additional captured data about the rooms to assess room layout and other usability information for the building's rooms and optionally for the overall building, and to subsequently using the assessed usability information in one or more further automated manners, such as to improve navigation of the building. The automated operations may include identifying one or more objects in each of the rooms to assess, evaluating one or more target attributes of each object, assessing usability of each object using its target attributes' evaluations and each room using its objects' assessment and other room information with respect to an indicated purpose, and combining the assessments of multiple rooms in a building and other building information to assess usability of the building with respect to its indicated purpose.Type: ApplicationFiled: February 25, 2021Publication date: August 25, 2022Inventors: Viktoriya Stoeva, Sing Bing Kang, Naji Khosravan, Lambert E. Wixson
-
Patent number: 11405549Abstract: Techniques are described for using a smart phone or other mobile device to perform automated operations for generating panorama images of building environments and for subsequently using the generated panorama images in further automated manners. In at least some situations, the generation of a panorama image by a mobile device is based at least in part on automatically acquiring multiple constituent images on the mobile device in multiple directions from an acquisition location and on concurrently combining acquired constituent images on the mobile device, such as in a real-time manner relative to the constituent image capture, to generate a panorama image with 360° of horizontal coverage of the view from that acquisition location. Information about such identified building floor plans may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on client devices in corresponding graphical user interfaces, etc.Type: GrantFiled: April 28, 2021Date of Patent: August 2, 2022Assignee: Zillow, Inc.Inventors: Sean P. Cier, Sing Bing Kang, Mitchell David Dawson
-
Publication number: 20220224833Abstract: Techniques are described for using multiple devices to automatically determine the acquisition location of an image from a camera device, such as within a building interior and by using data from the multiple devices (e.g., visual data from the camera device's image, and additional data captured by a separate mobile computing device in the same area as the camera device), and for subsequently using determined image acquisition location information in one or more further automated manners. The image may be a panorama image or of another type, and the determined acquisition location for such an image may be at least a location on the building's floor plan—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.Type: ApplicationFiled: January 11, 2022Publication date: July 14, 2022Inventors: Sean P. Cier, Sing Bing Kang, Mitchell David Dawson, Pierre Moulon
-
Publication number: 20220092227Abstract: Techniques are described for using computing devices to perform automated operations for identifying building floor plans that have attributes satisfying target criteria and for subsequently using the identified floor plans in further automated manners. In at least some situations, the identification of such building floor plans is based on generating and using adjacency graphs generated for the floor plans that represent inter-connections between rooms and other attributes of the buildings, and in some cases is further based on generating and using embedding vectors that concisely represent the information of the adjacency graphs. Information about such identified building floor plans may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on client devices in corresponding graphical user interfaces, for further analysis to identify shared and/or aggregate characteristics, etc.Type: ApplicationFiled: September 10, 2021Publication date: March 24, 2022Inventors: Yu Yin, Will A. Hutchcroft, Ivaylo Boyadzhiev, Sing Bing Kang, Yujie Li, Pierre Moulon
-
Patent number: 11265534Abstract: The subject disclosure is directed towards controlling the intensity of illumination of a scene or part of a scene, including to conserve illumination power. Quality of depth data in stereo images may be measured with different illumination states; environmental conditions, such as ambient light, natural texture may affect the quality. The illumination intensity may be controllably varied to obtain sufficient quality while conserving power. The control may be directed to one or more regions of interest corresponding to an entire scene or part of a scene.Type: GrantFiled: February 8, 2014Date of Patent: March 1, 2022Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Adam G. Kirk, Christoph Rhemann, Oliver A. Whyte, Shahram Izadi, Sing Bing Kang, Andreas Georgiou
-
Patent number: 11252329Abstract: Techniques are described for using multiple devices to automatically determine the acquisition location of an image from a camera device, such as within a building interior and by using data from the multiple devices (e.g., visual data from the camera device's image, and additional data captured by a separate mobile computing device in the same area as the camera device), and for subsequently using determined image acquisition location information in one or more further automated manners. The image may be a panorama image or of another type, and the determined acquisition location for such an image may be at least a location on the building's floor plan—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.Type: GrantFiled: January 15, 2021Date of Patent: February 15, 2022Assignee: Zillow, Inc.Inventors: Sean P. Cier, Sing Bing Kang, Mitchell David Dawson, Pierre Moulon
-
Publication number: 20210385378Abstract: Techniques are described for using a smart phone or other mobile device to perform automated operations for generating panorama images of building environments and for subsequently using the generated panorama images in further automated manners. In at least some situations, the generation of a panorama image by a mobile device is based at least in part on automatically acquiring multiple constituent images on the mobile device in multiple directions from an acquisition location and on concurrently combining acquired constituent images on the mobile device, such as in a real-time manner relative to the constituent image capture, to generate a panorama image with 360° of horizontal coverage of the view from that acquisition location. Information about such identified building floor plans may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on client devices in corresponding graphical user interfaces, etc.Type: ApplicationFiled: April 28, 2021Publication date: December 9, 2021Inventors: Sean P. Cier, Sing Bing Kang, Mitchell David Dawson
-
Patent number: 11128822Abstract: An “Adaptive Exposure Corrector” performs automated real-time exposure correction of individual images or image sequences of arbitrary length. “Exposure correction” is defined herein as automated adjustments or corrections to any combination of shadows, highlights, high-frequency features, and color saturation of images. The Adaptive Exposure Corrector outputs perceptually improved images based on image ISO and camera ISO capabilities in combination with camera noise characteristics via exposure corrections by a variety of noise-aware image processing functions. An initial calibration process adapts these noise aware image processing functions to noise characteristics of particular camera models and types in combination with particular camera ISO settings. More specifically, this calibration process precomputes a Noise Aware Scaling Function (NASF) and a Color Scalar Function (CSF).Type: GrantFiled: July 26, 2016Date of Patent: September 21, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Lu Yuan, Sing Bing Kang, Chintan A. Shah
-
Publication number: 20210250531Abstract: An “Adaptive Exposure Corrector” performs automated real-time exposure correction of individual images or image sequences of arbitrary length. “Exposure correction” is defined herein as automated adjustments or corrections to any combination of shadows, highlights, high-frequency features, and color saturation of images. The Adaptive Exposure Corrector outputs perceptually improved images based on image ISO and camera ISO capabilities in combination with camera noise characteristics via exposure corrections by a variety of noise-aware image processing functions. An initial calibration process adapts these noise aware image processing functions to noise characteristics of particular camera models and types in combination with particular camera ISO settings. More specifically, this calibration process precomputes a Noise Aware Scaling Function (NASF) and a Color Scalar Function (CSF).Type: ApplicationFiled: July 26, 2016Publication date: August 12, 2021Applicant: Microsoft Technology Licensing, LLCInventors: Lu YUAN, Sing Bing KANG, Chintan A. SHAH