Abstract: In various implementations, technology is disclosed to dynamically assess airway deformation. A depth prediction model is used to estimate airway depth from monocular endoscopic images of an airway and to create a dynamic point cloud representation of the airway. The depth prediction model is trained using synthetic image and depth data derived from a 3D airway model. The dynamic point cloud representation of the airway can be used to visualize and quantify airway contours and to classify airway obstructions and behavior. The technology described provides objective measures of airway deformations and behavioral analysis of pulmonary related conditions.

Abstract: Systems and methods for contagion mapping are disclosed herein. An implementation of the contagion modeling system based on a thermal depth video capture is disclosed. The modelling system includes two CO2 thermal depth imaging cameras connected to a processor. The CO2 thermal depth imaging cameras are configured so that they have fields of view within a modeling area. The modeling area includes a stationary object, a moving object and a gaseous fluid source, which is a contagion source.

Abstract: Various embodiments of the disclosed technology present a structural foundation for volumetric flow reconstructions for expiratory modeling enabled through multi-modal imaging for pulmonology. In some embodiments, this integrated multi-modal system includes infrared (IR) imaging, thermal imaging of carbon dioxide (CO2), depth imaging (D), and visible spectrum imaging. These multiple image modalities can be integrated into flow models of exhale behaviors enable the creation of three-dimensional volume reconstructions based on visualized CO2 distributions over time, formulating a four-dimensional exhale model which can be used to estimate various pulmonological traits (e.g., breathing rate, flow rate, exhale velocity, nose/mouth distribution, tidal volume estimation, and CO2 density distributions).

Abstract: Systems and methods are described for mobile and augmented reality-based depth and thermal fusion scan imaging. Some embodiments of the present technology use sophisticated techniques to fuse information from both thermal and depth imaging channels together to achieve synergistic effects for object recognition and personal identification. Hence, the techniques used in various embodiments provide a much better solution for, say, first responders, disaster relief agents, search and rescue, and law enforcement officials to gather more detailed forensic data. Some embodiments provide a series of unique features including small size, wearable devices, and ability to feed fused depth and thermal streams into AR glasses. In addition, some embodiments use a two-layer architecture for performing device local fusion and cloud-based platform for integration of data from multiple devices and cross-scene analysis and reconstruction.

Abstract: Systems and methods are described for mobile and augmented reality-based depth and thermal fusion scan imaging Some embodiments of the present technology use sophisticated techniques to fuse information from both thermal and depth imaging channels together to achieve synergistic effects for object recognition and personal identification. Hence, the techniques used in various embodiments provide a much better solution for, say, first responders, disaster relief agents, search and rescue, and law enforcement officials to gather more detailed forensic data. Some embodiments provide a series of unique features including small size, wearable devices, and ability to feed fused depth and thermal streams into AR glasses. In addition, some embodiments use a two-layer architecture for performing device local fusion and cloud-based platform for integration of data from multiple devices and cross-scene analysis and reconstruction.

Abstract: An imaging system is provided. The imaging system includes a 3D image capture device, which is configured to capture a depth image of an object, and a thermal image capture device, which is configured to capture a thermal image of the object. The imaging system also includes a processing system, which is coupled with the 3D image capture device and the thermal image capture device. The processing system is configured to process the depth image and the thermal image to produce a thermal-depth fusion image by aligning the thermal image with the depth image, and assigning a thermal value derived from the thermal image to a plurality of points of the depth image.

Abstract: Various embodiments of the disclosed technology present a structural foundation for volumetric flow reconstructions for expiratory modeling enabled through multi-modal imaging for pulmonology. In some embodiments, this integrated multi-modal system includes infrared (IR) imaging, thermal imaging of carbon dioxide (CO2), depth imaging (D), and visible spectrum imaging. These multiple image modalities can be integrated into flow models of exhale behaviors enable the creation of three-dimensional volume reconstructions based on visualized CO2 distributions over time, formulating a four-dimensional exhale model which can be used to estimate various pulmonological traits (e.g., breathing rate, flow rate, exhale velocity, nose/mouth distribution, tidal volume estimation, and CO2 density distributions).

Abstract: Various embodiments of the present technology present a structural foundation for respiratory analysis of turbulent exhale flows through a technique called Thin Medium Thermal Imaging (TMTI). TMTI is a respiration monitoring method that uses a thin medium and thermal imaging to sense breathing activity. This technique is presented as an alternative to existing non-contact methods of respiratory analysis. As with all non-contact methods, remote monitoring of patients' respiratory behaviors preserves patient comfort. However, unlike other respiratory monitoring methods, the TMTI method monitors respiration directly, and can therefore provide more respiratory information than other non-contact methods. Various embodiments may make use of different medium materials, different measurement setups, additional thermal imaging cameras and sensors, and setups with entertainment media such as Virtual Reality (VR).

Abstract: An imaging system is provided. The imaging system includes a 3D image capture device, which is configured to capture a depth image of an object, and a thermal image capture device, which is configured to capture a thermal image of the object. The imaging system also includes a processing system, which is coupled with the 3D image capture device and the thermal image capture device. The processing system is configured to process the depth image and the thermal image to produce a thermal-depth fusion image by aligning the thermal image with the depth image, and assigning a thermal value derived from the thermal image to a plurality of points of the depth image.