Abstract: Methods of retrofit analysis and verification for a building are presented including: analyzing a pre-retrofitted building; performing a retrofit on the pre-retrofitted building; and verifying the post-retrofitted building. In some embodiments, the analyzing the pre-retrofitted building includes: receiving a long view red-green-blue (RGB) stream of the pre-retrofitted building and storing to an RGB image repository; creating an RGB panorama of the pre-retrofitted building; receiving a close view RGB stream of the pre-retrofitted building and storing to the RGB image repository; receiving a close view pre-retrofit infrared (IR) thermography stream of the pre-retrofitted building and storing to a pre-retrofit IR image repository; and identifying pre-retrofit anomalies of the pre-retrofitted building.

Abstract: Methods for defining a building internal framework from external imagery are presented, the method including: receiving a number of raw images of a building; processing the number of raw images of the building to establish a number of facades; and determining the building internal framework for each of the number of facades. In some embodiments, the processing the number of raw images includes: for each of the number of façades, selecting a façade; selecting all IR thermography images corresponding with the selected façade; removing distortion from the selected IR thermography images; stitching the selected IR thermography images corresponding with the selected façade together to form a single façade image corresponding with the selected facade; correcting perspective distortion of the single facade image; cropping the single façade image; and receiving dimensions of an actual façade corresponding with the single façade image.

Abstract: Methods for processing a 3D point cloud of a building into polygons using an electronic computing device are presented, the methods including: causing the electronic computing device to receive the 3D point cloud; causing the electronic computing device to segment the 3D point cloud into a number of facades; and causing the electronic computing device to generate a number of polygons representing the number of facades. In some embodiments, the causing the electronic computing device to segment the 3D point cloud into a number of facades includes: performing voxel downsampling operation on the 3D point cloud; calculating a point normal for every point in the voxel downsampled 3D point cloud; and performing region growing to find each of the number of facades.

Abstract: Methods for processing a 3D point cloud of a building into polygons using an electronic computing device are presented, the methods including: causing the electronic computing device to receive the 3D point cloud; causing the electronic computing device to segment the 3D point cloud into a number of facades; and causing the electronic computing device to generate a number of polygons representing the number of facades. In some embodiments, the causing the electronic computing device to segment the 3D point cloud into a number of facades includes: performing voxel downsampling operation on the 3D point cloud; calculating a point normal for every point in the voxel downsampled 3D point cloud; and performing region growing to find each of the number of facades.

Abstract: Methods for generating a floor plan from a building scan of a building using an electronic computing device are presented, the method including: causing the electronic computing device to receive the building scan; converting the building scan to a floor plan; and refining the floor plan to approximate the building. In some embodiments, the causing the electronic computing device to receive the building scan further includes: extracting information from an input file to obtain a representation of a number of rooms and walls corresponding with the building scan, where the information is selected from the group consisting of: a set of vertices, a set of triangles, and a set of rooms.

Abstract: Methods for detecting a windows in a building utilizing a building scan using an electronic computing device are presented, the methods including: causing the electronic computing device to receive the building scan; processing the building scan; detecting the windows based on no return transparency of portions of the building scan; and incorporating the detected windows into a 3D model corresponding with the building scan. In some embodiments, processing the building scan generates at least the following: a colored point cloud; a 2D floor plan of the building; and a walked path. In some embodiments, detecting the windows based on transparency of a portions of the building scan further includes: decomposing the colored point cloud into walls; rotating and pixilating the walls; extracting transparent features corresponding with the windows; and classifying and smoothing the transparent features corresponding with the windows.

Abstract: Methods for indoor 3D surface reconstruction and 2D floor plan recovery by segmenting a number of objects and building structure elements from a building scan using an electronic computing device are presented, the methods including: causing the electronic computing device to capture the building scan, where the building scan includes a number of scan points; pre-processing scan data from the building scan; generating an octree and a 2.5D model from the pre-processed scan data; extracting interior and exterior volumes from the octree model and the 2.5D model; and meshing the extracted volumes to generate a 3D object geometry and a 3D building geometry, where the 3D object geometry corresponds with the number of objects and the 3D building geometry corresponds with the indoor 3D surface reconstruction of building structure elements.

Abstract: Methods for interior climate control of a building utilizing multimodal sensor positioning using an electronic mobile device are presented, the method including: causing the electronic mobile device to receive a building floor plan; generating a number of fingerprint databases corresponding with the building floor plan; determining positions of users each having a mobile electronic device in the building; receiving occupancy climate parameters; and adjusting interior climate control for a zone corresponding with users in the zone and occupation climate parameters.

Abstract: Methods for detecting a number of luminary fixtures in an indoor environment using an electronic image capture device and electronic computing device are presented, the methods including: capturing a ceiling scan of the indoor environment with at least the electronic image capture device; analyzing a synthetic ceiling image corresponding with the ceiling scan using the electronic computing device to identify a number of luminary candidates; and converting the number of luminary candidates to define the number of luminary fixtures. In some embodiments, the capturing the ceiling scan further includes: moving the electronic image capture device through the indoor environment; capturing the indoor environment; generating a point cloud of the indoor environment; colorizing the point cloud; extracting the colored point cloud of a ceiling; dividing the extracted point cloud into a number of rooms; and generating the synthetic ceiling image for each of the number of rooms.

Abstract: Methods for detecting a windows in a building utilizing a building scan using an electronic computing device are presented, the methods including: causing the electronic computing device to receive the building scan; processing the building scan; detecting the windows based on no return transparency of portions of the building scan; and incorporating the detected windows into a 3D model corresponding with the building scan. In some embodiments, processing the building scan generates at least the following: a colored point cloud; a 2D floor plan of the building; and a walked path. In some embodiments, detecting the windows based on transparency of a portions of the building scan further includes: decomposing the colored point cloud into walls; rotating and pixilating the walls; extracting transparent features corresponding with the windows; and classifying and smoothing the transparent features corresponding with the windows.

Abstract: Methods for indoor 3D surface reconstruction and 2D floor plan recovery by segmenting a number of objects and building structure elements from a building scan using an electronic computing device are presented, the methods including: causing the electronic computing device to capture the building scan, where the building scan includes a number of scan points; pre-processing scan data from the building scan; generating an octree and a 2.5D model from the pre-processed scan data; extracting interior and exterior volumes from the octree model and the 2.5D model; and meshing the extracted volumes to generate a 3D object geometry and a 3D building geometry, where the 3D object geometry corresponds with the number of objects and the 3D building geometry corresponds with the indoor 3D surface reconstruction of building structure elements.

Abstract: Systems for producing 3D spherical imagery for a virtual walkthrough corresponding with a real environment are presented, the systems including: a rightward facing camera for capturing real-time rightward facing images, the rightward facing camera electronically coupled with a computing system; a leftward facing camera for capturing real-time leftward facing image data; a backward facing camera for capturing real-time backward facing image data; a frontward facing camera for capturing real-time frontward facing image data; an upward facing camera for capturing real-time upward facing image data; a number of laser scanners; and an inertial movement unit (IMU), where data from the number of laser scanners and the IMU captures 3D geometry information of the real environment and is rendered to provide a 3D virtual model of the real environment, and where image data from the cameras is rendered to provide image texture blending of the 3D virtual model.

Abstract: Methods for image based localization using an electronic computing device are presented, the methods including: capturing a local image with an image capture device; associating metadata with the local image; causing the electronic computing device to receive the local image; causing the electronic computing device to match the local image with a database image, where the database image is three-dimensional (3D); and calculating a pose of the image capture device based on a pose of the database image and metadata associated with the local image. In some embodiments, the metadata includes at least pitch and roll data corresponding with the image capture device at a time of image capture.

Abstract: Methods for image based localization using an electronic computing device are presented, the methods including: capturing a local image with an image capture device; associating metadata with the local image; causing the electronic computing device to receive the local image; causing the electronic computing device to match the local image with a database image, where the database image is three-dimensional (3D); and calculating a pose of the image capture device based on a pose of the database image and metadata associated with the local image. In some embodiments, the metadata includes at least pitch and roll data corresponding with the image capture device at a time of image capture.

Abstract: Multiple TRFC connections transport streaming data through a wireless channel, and the difference between measured round trip times of packets and minimum round trip time is used to adjust the number of TFRC connections to fully utilize bandwidth through the wireless channel.

Abstract: Optical proximity correction (OPC) is a technique used to compensate for optical distortions, process effects, or both, by modifying a pattern that is used during lithography. A reference OPC model is used to create an OPC design layout pattern based on pre-distorting a desired design layout pattern associated with an integrated circuit (IC). The OPC design layout pattern is used when the IC is produced, such that the fabricated IC ideally matches the desired design layout pattern. The present invention relates to using a regression OPC model to create estimated fragment movements of the desired design layout pattern. The estimated fragment movements are then provided as initial fragment movements to the reference OPC model, which then creates the OPC design layout pattern. The initial fragment movements provided by the regression OPC model may reduce the number of iterations needed by the reference OPC model, thereby reducing computation time.

Abstract: Multiple TRFC connections transport streaming data through a wireless channel, and the difference between measured round trip times of packets and minimum round trip time is used to adjust the number of TFRC connections to fully utilize bandwidth through the wireless channel.

Abstract: Multiple TRFC connections transport streaming data through a wireless channel, and the difference between measured round trip times of packets and minimum round trip time is used to adjust the number of TFRC connections to fully utilize bandwidth through the wireless channel.

Abstract: This invention relates to the creation of dictionary functions for the encoding of video signals using matching pursuit compression techniques. After an initial set of reference dictionary images is chosen, training video sequences are selected, and motion residuals are calculated. High energy portions of the residual images are extracted and stored when they match selection criteria with the reference dictionary. An energy threshold is used to limit the number of video signal “atoms” encoded for each frame, thus avoiding the encoding of noise. A new dictionary is then synthesized from the stored portions of the image residuals and the original reference dictionary. The process can then be repeated using the synthesized dictionary as the new reference dictionary. This achieves low bit rate signals with a higher signal-to-noise ratio than have been previously achieved.

Abstract: This invention relates to the creation of dictionary functions for the encoding of video signals using matching pursuit compression techniques. After an initial set of reference dictionary images is chosen, training video sequences are selected, and motion residuals are calculated. High energy portions of the residual images are extracted and stored when they match selection criteria with the reference dictionary. An energy threshold is used to limit the number of video signal “atoms” encoded for each frame, thus avoiding the encoding of noise. A new dictionary is then synthesized from the stored portions of the image residuals and the original reference dictionary. The process can then be repeated using the synthesized dictionary as the new reference dictionary. This achieves low bit rate signals with a higher signal-to-noise ratio than have been previously achieved.